2024-09-18T12:15:41.985 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-18T12:15:41.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T12:15:42.071 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7911040 branch: wip-bharath11-testing-2024-09-18-1115-quincy description: rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} email: skanta@redhat.com first_in_suite: false job_id: '7911040' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-bharath11-testing-2024-09-18-1115-quincy ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd debug verify cached snaps: true osd debug verify missing on start: true osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd op queue: debug_random osd op queue cut off: debug_random flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 7061ea6ca50908d104e9f3979dc615e118d9e153 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 7061ea6ca50908d104e9f3979dc615e118d9e153 workunit: branch: wip-bharath11-testing-2024-09-18-1115-quincy sha1: 7061ea6ca50908d104e9f3979dc615e118d9e153 owner: scheduled_skanta@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - osd.4 - osd.5 - osd.6 - osd.7 - osd.8 - osd.9 - client.0 seed: 4631 sha1: 7061ea6ca50908d104e9f3979dc615e118d9e153 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath11-testing-2024-09-18-1115-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_7061ea6ca50908d104e9f3979dc615e118d9e153/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 7061ea6ca50908d104e9f3979dc615e118d9e153 targets: smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: null - ceph: conf: osd: osd max object name len: 400 osd max object namespace len: 64 log-ignorelist: - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - workunit: clients: all: - rados/test_health_warnings.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_09:13:00 tube: smithi user: skanta verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-18T12:15:42.071 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_7061ea6ca50908d104e9f3979dc615e118d9e153/qa; will attempt to use it 2024-09-18T12:15:42.072 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_7061ea6ca50908d104e9f3979dc615e118d9e153/qa/tasks 2024-09-18T12:15:42.072 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-18T12:15:42.074 INFO:teuthology.task.internal:Checking packages... 2024-09-18T12:15:42.095 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7061ea6ca50908d104e9f3979dc615e118d9e153' 2024-09-18T12:15:42.095 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T12:15:42.095 INFO:teuthology.packaging:ref: None 2024-09-18T12:15:42.095 INFO:teuthology.packaging:tag: None 2024-09-18T12:15:42.095 INFO:teuthology.packaging:branch: wip-bharath11-testing-2024-09-18-1115-quincy 2024-09-18T12:15:42.095 INFO:teuthology.packaging:sha1: 7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T12:15:42.096 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-bharath11-testing-2024-09-18-1115-quincy 2024-09-18T12:15:42.244 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1645-g7061ea6c-1focal 2024-09-18T12:15:42.246 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-18T12:15:42.252 INFO:teuthology.task.internal:no buildpackages task found 2024-09-18T12:15:42.252 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-18T12:15:42.259 INFO:teuthology.task.internal:Saving configuration 2024-09-18T12:15:42.271 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-18T12:15:42.277 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-18T12:15:42.297 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7911040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 12:10:09.897752', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-18T12:15:42.298 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-18T12:15:42.304 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'osd.8', 'osd.9', 'client.0'] 2024-09-18T12:15:42.304 INFO:teuthology.run_tasks:Running task console_log... 2024-09-18T12:15:42.393 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f542ab93ac0>, signals=[15]) 2024-09-18T12:15:42.393 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-18T12:15:42.399 INFO:teuthology.task.internal:Opening connections... 2024-09-18T12:15:42.400 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-09-18T12:15:42.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:15:42.510 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-18T12:15:42.516 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-09-18T12:15:42.635 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-09-18T12:15:42.635 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-09-18T12:15:42.642 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Ubuntu" 2024-09-18T12:15:42.642 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-18T12:15:42.642 INFO:teuthology.orchestra.run.smithi042.stdout:ID=ubuntu 2024-09-18T12:15:42.642 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE=debian 2024-09-18T12:15:42.642 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-18T12:15:42.643 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="20.04" 2024-09-18T12:15:42.643 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-18T12:15:42.643 INFO:teuthology.orchestra.run.smithi042.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-18T12:15:42.643 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-18T12:15:42.643 INFO:teuthology.orchestra.run.smithi042.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-18T12:15:42.643 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_CODENAME=focal 2024-09-18T12:15:42.643 INFO:teuthology.orchestra.run.smithi042.stdout:UBUNTU_CODENAME=focal 2024-09-18T12:15:42.644 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-09-18T12:15:42.667 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-18T12:15:42.676 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-18T12:15:42.681 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-18T12:15:42.681 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-09-18T12:15:42.686 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-18T12:15:42.693 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-18T12:15:42.694 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-09-18T12:15:42.709 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-18T12:15:42.738 INFO:teuthology.run_tasks:Running task kernel... 2024-09-18T12:15:42.752 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-18T12:15:42.752 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-18T12:15:42.752 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T12:15:42.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:15:42.758 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-18T12:15:42.764 INFO:teuthology.orchestra.run.smithi042.stdout:5.4.0-124-generic 2024-09-18T12:15:42.764 INFO:teuthology.task.kernel:Running kernel on smithi042: 5.4.0-124-generic 2024-09-18T12:15:42.765 DEBUG:teuthology.orchestra.run.smithi042:> sudo apt-get clean 2024-09-18T12:15:42.860 DEBUG:teuthology.orchestra.run.smithi042:> sudo apt-get update 2024-09-18T12:15:43.044 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-18T12:15:43.059 INFO:teuthology.orchestra.run.smithi042.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-18T12:15:43.115 INFO:teuthology.orchestra.run.smithi042.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-18T12:15:43.134 INFO:teuthology.orchestra.run.smithi042.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-18T12:15:43.436 INFO:teuthology.orchestra.run.smithi042.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,598 kB] 2024-09-18T12:15:43.599 INFO:teuthology.orchestra.run.smithi042.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,036 kB] 2024-09-18T12:15:43.616 INFO:teuthology.orchestra.run.smithi042.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [553 kB] 2024-09-18T12:15:43.620 INFO:teuthology.orchestra.run.smithi042.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-18T12:15:43.621 INFO:teuthology.orchestra.run.smithi042.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,279 kB] 2024-09-18T12:15:43.648 INFO:teuthology.orchestra.run.smithi042.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-18T12:15:43.648 INFO:teuthology.orchestra.run.smithi042.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [459 kB] 2024-09-18T12:15:43.652 INFO:teuthology.orchestra.run.smithi042.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-18T12:15:43.652 INFO:teuthology.orchestra.run.smithi042.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,231 kB] 2024-09-18T12:15:43.666 INFO:teuthology.orchestra.run.smithi042.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [808 kB] 2024-09-18T12:15:43.673 INFO:teuthology.orchestra.run.smithi042.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-18T12:15:43.675 INFO:teuthology.orchestra.run.smithi042.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.3 kB] 2024-09-18T12:15:43.676 INFO:teuthology.orchestra.run.smithi042.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-18T12:15:43.676 INFO:teuthology.orchestra.run.smithi042.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-18T12:15:43.677 INFO:teuthology.orchestra.run.smithi042.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-18T12:15:43.677 INFO:teuthology.orchestra.run.smithi042.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-18T12:15:43.678 INFO:teuthology.orchestra.run.smithi042.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-18T12:15:43.678 INFO:teuthology.orchestra.run.smithi042.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-18T12:15:43.694 INFO:teuthology.orchestra.run.smithi042.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-18T12:15:43.695 INFO:teuthology.orchestra.run.smithi042.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-18T12:15:43.704 INFO:teuthology.orchestra.run.smithi042.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-18T12:15:43.704 INFO:teuthology.orchestra.run.smithi042.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-18T12:15:43.786 INFO:teuthology.orchestra.run.smithi042.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [817 kB] 2024-09-18T12:15:44.122 INFO:teuthology.orchestra.run.smithi042.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,223 kB] 2024-09-18T12:15:44.314 INFO:teuthology.orchestra.run.smithi042.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [475 kB] 2024-09-18T12:15:44.328 INFO:teuthology.orchestra.run.smithi042.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-18T12:15:44.329 INFO:teuthology.orchestra.run.smithi042.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,152 kB] 2024-09-18T12:15:44.420 INFO:teuthology.orchestra.run.smithi042.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-18T12:15:44.421 INFO:teuthology.orchestra.run.smithi042.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [441 kB] 2024-09-18T12:15:44.434 INFO:teuthology.orchestra.run.smithi042.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-18T12:15:44.434 INFO:teuthology.orchestra.run.smithi042.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-18T12:15:44.452 INFO:teuthology.orchestra.run.smithi042.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,012 kB] 2024-09-18T12:15:44.481 INFO:teuthology.orchestra.run.smithi042.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-18T12:15:44.486 INFO:teuthology.orchestra.run.smithi042.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.4 kB] 2024-09-18T12:15:44.486 INFO:teuthology.orchestra.run.smithi042.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-18T12:15:44.487 INFO:teuthology.orchestra.run.smithi042.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-18T12:15:44.565 INFO:teuthology.orchestra.run.smithi042.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-18T12:15:44.566 INFO:teuthology.orchestra.run.smithi042.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-18T12:15:48.201 INFO:teuthology.orchestra.run.smithi042.stdout:Fetched 22.0 MB in 3s (6,816 kB/s) 2024-09-18T12:15:49.905 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2024-09-18T12:15:49.933 DEBUG:teuthology.orchestra.run.smithi042:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-18T12:15:50.022 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2024-09-18T12:15:50.249 INFO:teuthology.orchestra.run.smithi042.stdout:Building dependency tree... 2024-09-18T12:15:50.249 INFO:teuthology.orchestra.run.smithi042.stdout:Reading state information... 2024-09-18T12:15:50.464 INFO:teuthology.orchestra.run.smithi042.stdout:The following additional packages will be installed: 2024-09-18T12:15:50.464 INFO:teuthology.orchestra.run.smithi042.stdout: linux-generic linux-headers-5.4.0-196 linux-headers-5.4.0-196-generic 2024-09-18T12:15:50.464 INFO:teuthology.orchestra.run.smithi042.stdout: linux-headers-generic linux-image-5.4.0-196-generic 2024-09-18T12:15:50.464 INFO:teuthology.orchestra.run.smithi042.stdout: linux-modules-5.4.0-196-generic linux-modules-extra-5.4.0-196-generic 2024-09-18T12:15:50.465 INFO:teuthology.orchestra.run.smithi042.stdout:Suggested packages: 2024-09-18T12:15:50.465 INFO:teuthology.orchestra.run.smithi042.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-18T12:15:50.465 INFO:teuthology.orchestra.run.smithi042.stdout:Recommended packages: 2024-09-18T12:15:50.465 INFO:teuthology.orchestra.run.smithi042.stdout: thermald 2024-09-18T12:15:50.529 INFO:teuthology.orchestra.run.smithi042.stdout:The following NEW packages will be installed: 2024-09-18T12:15:50.529 INFO:teuthology.orchestra.run.smithi042.stdout: linux-headers-5.4.0-196 linux-headers-5.4.0-196-generic 2024-09-18T12:15:50.529 INFO:teuthology.orchestra.run.smithi042.stdout: linux-image-5.4.0-196-generic linux-modules-5.4.0-196-generic 2024-09-18T12:15:50.530 INFO:teuthology.orchestra.run.smithi042.stdout: linux-modules-extra-5.4.0-196-generic 2024-09-18T12:15:50.531 INFO:teuthology.orchestra.run.smithi042.stdout:The following packages will be upgraded: 2024-09-18T12:15:50.531 INFO:teuthology.orchestra.run.smithi042.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-18T12:15:50.584 INFO:teuthology.orchestra.run.smithi042.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-18T12:15:50.584 INFO:teuthology.orchestra.run.smithi042.stdout:Need to get 77.2 MB of archives. 2024-09-18T12:15:50.584 INFO:teuthology.orchestra.run.smithi042.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-18T12:15:50.585 INFO:teuthology.orchestra.run.smithi042.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-196-generic amd64 5.4.0-196.216 [15.0 MB] 2024-09-18T12:15:50.914 INFO:teuthology.orchestra.run.smithi042.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-196-generic amd64 5.4.0-196.216 [10.5 MB] 2024-09-18T12:15:51.010 INFO:teuthology.orchestra.run.smithi042.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-196-generic amd64 5.4.0-196.216 [39.2 MB] 2024-09-18T12:15:51.491 INFO:teuthology.orchestra.run.smithi042.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.196.194 [1,900 B] 2024-09-18T12:15:51.491 INFO:teuthology.orchestra.run.smithi042.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.196.194 [2,592 B] 2024-09-18T12:15:51.491 INFO:teuthology.orchestra.run.smithi042.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-196 all 5.4.0-196.216 [11.0 MB] 2024-09-18T12:15:51.592 INFO:teuthology.orchestra.run.smithi042.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-196-generic amd64 5.4.0-196.216 [1,386 kB] 2024-09-18T12:15:51.602 INFO:teuthology.orchestra.run.smithi042.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.196.194 [2,460 B] 2024-09-18T12:15:52.354 INFO:teuthology.orchestra.run.smithi042.stdout:Fetched 77.2 MB in 1s (72.6 MB/s) 2024-09-18T12:15:52.560 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-modules-5.4.0-196-generic. 2024-09-18T12:15:54.267 INFO:teuthology.orchestra.run.smithi042.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-18T12:15:54.272 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../0-linux-modules-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-18T12:15:54.390 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-modules-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-18T12:15:56.341 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-image-5.4.0-196-generic. 2024-09-18T12:15:56.356 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../1-linux-image-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-18T12:15:56.465 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-image-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-18T12:15:57.569 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-196-generic. 2024-09-18T12:15:57.582 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-18T12:15:57.627 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-modules-extra-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-18T12:16:02.475 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../3-linux-generic_5.4.0.196.194_amd64.deb ... 2024-09-18T12:16:02.601 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-generic (5.4.0.196.194) over (5.4.0.124.125) ... 2024-09-18T12:16:02.962 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.196.194_amd64.deb ... 2024-09-18T12:16:03.113 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-image-generic (5.4.0.196.194) over (5.4.0.124.125) ... 2024-09-18T12:16:03.482 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-headers-5.4.0-196. 2024-09-18T12:16:03.496 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../5-linux-headers-5.4.0-196_5.4.0-196.216_all.deb ... 2024-09-18T12:16:03.532 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-headers-5.4.0-196 (5.4.0-196.216) ... 2024-09-18T12:16:09.281 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-headers-5.4.0-196-generic. 2024-09-18T12:16:09.303 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../6-linux-headers-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-18T12:16:09.367 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-headers-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-18T12:16:12.155 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.196.194_amd64.deb ... 2024-09-18T12:16:12.310 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-headers-generic (5.4.0.196.194) over (5.4.0.124.125) ... 2024-09-18T12:16:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-headers-5.4.0-196 (5.4.0-196.216) ... 2024-09-18T12:16:12.781 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-headers-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-18T12:16:12.924 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-headers-generic (5.4.0.196.194) ... 2024-09-18T12:16:13.042 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-modules-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-18T12:16:14.320 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-image-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-18T12:16:15.510 INFO:teuthology.orchestra.run.smithi042.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-196-generic 2024-09-18T12:16:15.511 INFO:teuthology.orchestra.run.smithi042.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-196-generic 2024-09-18T12:16:15.646 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-modules-extra-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-18T12:16:16.864 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-image-generic (5.4.0.196.194) ... 2024-09-18T12:16:16.990 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-generic (5.4.0.196.194) ... 2024-09-18T12:16:17.142 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for linux-image-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-18T12:16:17.214 INFO:teuthology.orchestra.run.smithi042.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-18T12:16:17.214 INFO:teuthology.orchestra.run.smithi042.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-196-generic 2024-09-18T12:16:39.536 INFO:teuthology.orchestra.run.smithi042.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-18T12:16:39.537 INFO:teuthology.orchestra.run.smithi042.stdout:Sourcing file `/etc/default/grub' 2024-09-18T12:16:39.545 INFO:teuthology.orchestra.run.smithi042.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-18T12:16:39.571 INFO:teuthology.orchestra.run.smithi042.stdout:Generating grub configuration file ... 2024-09-18T12:16:39.925 INFO:teuthology.orchestra.run.smithi042.stdout:Found linux image: /boot/vmlinuz-5.4.0-196-generic 2024-09-18T12:16:39.950 INFO:teuthology.orchestra.run.smithi042.stdout:Found initrd image: /boot/initrd.img-5.4.0-196-generic 2024-09-18T12:16:40.352 INFO:teuthology.orchestra.run.smithi042.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-18T12:16:40.364 INFO:teuthology.orchestra.run.smithi042.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-18T12:16:42.540 INFO:teuthology.orchestra.run.smithi042.stdout:done 2024-09-18T12:16:43.010 DEBUG:teuthology.orchestra.run.smithi042:> dpkg -s linux-image-generic 2024-09-18T12:16:43.068 INFO:teuthology.orchestra.run.smithi042.stdout:Package: linux-image-generic 2024-09-18T12:16:43.068 INFO:teuthology.orchestra.run.smithi042.stdout:Status: install ok installed 2024-09-18T12:16:43.068 INFO:teuthology.orchestra.run.smithi042.stdout:Priority: optional 2024-09-18T12:16:43.068 INFO:teuthology.orchestra.run.smithi042.stdout:Section: kernel 2024-09-18T12:16:43.068 INFO:teuthology.orchestra.run.smithi042.stdout:Installed-Size: 20 2024-09-18T12:16:43.068 INFO:teuthology.orchestra.run.smithi042.stdout:Maintainer: Ubuntu Kernel Team 2024-09-18T12:16:43.068 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: amd64 2024-09-18T12:16:43.068 INFO:teuthology.orchestra.run.smithi042.stdout:Source: linux-meta 2024-09-18T12:16:43.068 INFO:teuthology.orchestra.run.smithi042.stdout:Version: 5.4.0.196.194 2024-09-18T12:16:43.068 INFO:teuthology.orchestra.run.smithi042.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-18T12:16:43.068 INFO:teuthology.orchestra.run.smithi042.stdout:Depends: linux-image-5.4.0-196-generic, linux-modules-extra-5.4.0-196-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-18T12:16:43.069 INFO:teuthology.orchestra.run.smithi042.stdout:Recommends: thermald 2024-09-18T12:16:43.069 INFO:teuthology.orchestra.run.smithi042.stdout:Description: Generic Linux kernel image 2024-09-18T12:16:43.069 INFO:teuthology.orchestra.run.smithi042.stdout: This package will always depend on the latest generic kernel image 2024-09-18T12:16:43.069 INFO:teuthology.orchestra.run.smithi042.stdout: available. 2024-09-18T12:16:43.069 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-196-generic 2024-09-18T12:16:43.069 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T12:16:43.069 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T12:16:43.069 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-18T12:16:43.070 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T12:16:43.070 DEBUG:teuthology.orchestra.run.smithi042:> sudo apt-get clean 2024-09-18T12:16:43.170 DEBUG:teuthology.orchestra.run.smithi042:> sudo apt-get update 2024-09-18T12:16:43.308 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-18T12:16:43.428 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-18T12:16:43.507 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-18T12:16:43.589 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-18T12:16:45.229 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2024-09-18T12:16:45.255 DEBUG:teuthology.orchestra.run.smithi042:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-18T12:16:45.328 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2024-09-18T12:16:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:Building dependency tree... 2024-09-18T12:16:45.529 INFO:teuthology.orchestra.run.smithi042.stdout:Reading state information... 2024-09-18T12:16:45.774 INFO:teuthology.orchestra.run.smithi042.stdout:linux-image-generic is already the newest version (5.4.0.196.194). 2024-09-18T12:16:45.774 INFO:teuthology.orchestra.run.smithi042.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-18T12:16:45.774 DEBUG:teuthology.orchestra.run.smithi042:> dpkg -s linux-image-generic 2024-09-18T12:16:45.796 INFO:teuthology.orchestra.run.smithi042.stdout:Package: linux-image-generic 2024-09-18T12:16:45.796 INFO:teuthology.orchestra.run.smithi042.stdout:Status: install ok installed 2024-09-18T12:16:45.796 INFO:teuthology.orchestra.run.smithi042.stdout:Priority: optional 2024-09-18T12:16:45.796 INFO:teuthology.orchestra.run.smithi042.stdout:Section: kernel 2024-09-18T12:16:45.796 INFO:teuthology.orchestra.run.smithi042.stdout:Installed-Size: 20 2024-09-18T12:16:45.797 INFO:teuthology.orchestra.run.smithi042.stdout:Maintainer: Ubuntu Kernel Team 2024-09-18T12:16:45.797 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: amd64 2024-09-18T12:16:45.797 INFO:teuthology.orchestra.run.smithi042.stdout:Source: linux-meta 2024-09-18T12:16:45.797 INFO:teuthology.orchestra.run.smithi042.stdout:Version: 5.4.0.196.194 2024-09-18T12:16:45.797 INFO:teuthology.orchestra.run.smithi042.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-18T12:16:45.797 INFO:teuthology.orchestra.run.smithi042.stdout:Depends: linux-image-5.4.0-196-generic, linux-modules-extra-5.4.0-196-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-18T12:16:45.797 INFO:teuthology.orchestra.run.smithi042.stdout:Recommends: thermald 2024-09-18T12:16:45.797 INFO:teuthology.orchestra.run.smithi042.stdout:Description: Generic Linux kernel image 2024-09-18T12:16:45.797 INFO:teuthology.orchestra.run.smithi042.stdout: This package will always depend on the latest generic kernel image 2024-09-18T12:16:45.797 INFO:teuthology.orchestra.run.smithi042.stdout: available. 2024-09-18T12:16:45.798 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-09-18T12:16:45.805 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.4IaAnu28LK 2024-09-18T12:16:45.805 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub/grub.cfg /tmp/tmp.4IaAnu28LK 2024-09-18T12:16:45.871 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.4IaAnu28LK 2024-09-18T12:16:45.919 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.4IaAnu28LK is 9KB 2024-09-18T12:16:45.933 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.4IaAnu28LK 2024-09-18T12:16:45.939 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-18T12:16:45.994 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:16:45.994 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-18T12:16:45.995 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-18T12:16:46.070 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-196-generic 2024-09-18T12:16:46.071 DEBUG:teuthology.orchestra.run.smithi042:> sudo update-grub 2024-09-18T12:16:47.832 INFO:teuthology.orchestra.run.smithi042.stderr:Sourcing file `/etc/default/grub' 2024-09-18T12:16:47.839 INFO:teuthology.orchestra.run.smithi042.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-18T12:16:47.853 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-09-18T12:16:48.133 INFO:teuthology.orchestra.run.smithi042.stderr:Found linux image: /boot/vmlinuz-5.4.0-196-generic 2024-09-18T12:16:48.145 INFO:teuthology.orchestra.run.smithi042.stderr:Found initrd image: /boot/initrd.img-5.4.0-196-generic 2024-09-18T12:16:48.518 INFO:teuthology.orchestra.run.smithi042.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-18T12:16:48.530 INFO:teuthology.orchestra.run.smithi042.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-18T12:16:49.573 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-09-18T12:16:49.575 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-09-18T12:17:19.609 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-18T12:17:19.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-18T12:17:19.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:17:38.113 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-09-18T12:17:47.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-18T12:17:47.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:18:47.187 DEBUG:teuthology.orchestra.remote:timed out 2024-09-18T12:18:59.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-18T12:18:59.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:18:59.456 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-18T12:19:00.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-18T12:19:00.039 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-196-generic"... 2024-09-18T12:19:00.039 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-18T12:19:00.045 INFO:teuthology.orchestra.run.smithi042.stdout:5.4.0-196-generic 2024-09-18T12:19:00.046 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-196-generic vs 5.4.0-196-generic 2024-09-18T12:19:00.046 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T12:19:00.046 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-18T12:19:01.046 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-18T12:19:01.047 DEBUG:teuthology.orchestra.run.smithi042:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T12:19:01.149 INFO:teuthology.orchestra.run.smithi042.stdout:ttyS1 2024-09-18T12:19:01.179 DEBUG:teuthology.parallel:result is None 2024-09-18T12:19:01.179 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-18T12:19:01.186 INFO:teuthology.task.internal:Creating test directory... 2024-09-18T12:19:01.186 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T12:19:01.193 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-18T12:19:01.225 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-18T12:19:01.231 INFO:teuthology.task.internal:Creating archive directory... 2024-09-18T12:19:01.231 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T12:19:01.256 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-18T12:19:01.262 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-18T12:19:01.262 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T12:19:01.280 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:19:01.291 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T12:19:01.293 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-18T12:19:01.300 INFO:teuthology.task.internal:Configuring sudo... 2024-09-18T12:19:01.300 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T12:19:01.352 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-18T12:19:01.361 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-18T12:19:01.361 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T12:19:01.366 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T12:19:01.371 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T12:19:01.378 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:19:01.378 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T12:19:01.451 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-09-18T12:19:01.500 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-18T12:19:01.507 INFO:teuthology.task.internal:Starting timer... 2024-09-18T12:19:01.507 INFO:teuthology.run_tasks:Running task pcp... 2024-09-18T12:19:01.517 INFO:teuthology.run_tasks:Running task selinux... 2024-09-18T12:19:01.526 DEBUG:teuthology.task.selinux:Excluding smithi042: OS 'ubuntu' does not support SELinux 2024-09-18T12:19:01.526 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-18T12:19:01.526 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-18T12:19:01.526 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-18T12:19:01.526 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-18T12:19:01.534 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-18T12:19:01.546 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-18T12:19:01.547 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi042.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-18T12:24:42.317 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi042.front.sepia.ceph.com')] 2024-09-18T12:24:42.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-18T12:24:42.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T12:24:42.421 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-18T12:24:42.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-18T12:24:42.546 INFO:teuthology.run_tasks:Running task clock... 2024-09-18T12:24:42.557 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-18T12:24:42.557 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T12:24:42.558 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T12:24:42.590 INFO:teuthology.orchestra.run.smithi042.stdout:18 Sep 12:24:42 ntpd[13649]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-18T12:24:42.590 INFO:teuthology.orchestra.run.smithi042.stdout:18 Sep 12:24:42 ntpd[13649]: Command line: ntpd -gq 2024-09-18T12:24:42.591 INFO:teuthology.orchestra.run.smithi042.stdout:18 Sep 12:24:42 ntpd[13649]: proto: precision = 0.123 usec (-23) 2024-09-18T12:24:42.591 INFO:teuthology.orchestra.run.smithi042.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-18T12:24:42.592 INFO:teuthology.orchestra.run.smithi042.stdout:18 Sep 12:24:42 ntpd[13649]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-18T12:24:42.592 INFO:teuthology.orchestra.run.smithi042.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-18T12:24:42.593 INFO:teuthology.orchestra.run.smithi042.stdout:18 Sep 12:24:42 ntpd[13649]: restrict ::: KOD does nothing without LIMITED. 2024-09-18T12:24:42.593 INFO:teuthology.orchestra.run.smithi042.stdout:18 Sep 12:24:42 ntpd[13649]: Listen and drop on 0 v6wildcard [::]:123 2024-09-18T12:24:42.593 INFO:teuthology.orchestra.run.smithi042.stdout:18 Sep 12:24:42 ntpd[13649]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-18T12:24:42.594 INFO:teuthology.orchestra.run.smithi042.stdout:18 Sep 12:24:42 ntpd[13649]: Listen normally on 2 lo 127.0.0.1:123 2024-09-18T12:24:42.594 INFO:teuthology.orchestra.run.smithi042.stdout:18 Sep 12:24:42 ntpd[13649]: Listen normally on 3 ens1f0 172.21.15.42:123 2024-09-18T12:24:42.594 INFO:teuthology.orchestra.run.smithi042.stdout:18 Sep 12:24:42 ntpd[13649]: Listen normally on 4 lo [::1]:123 2024-09-18T12:24:42.594 INFO:teuthology.orchestra.run.smithi042.stdout:18 Sep 12:24:42 ntpd[13649]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1440%3]:123 2024-09-18T12:24:42.594 INFO:teuthology.orchestra.run.smithi042.stdout:18 Sep 12:24:42 ntpd[13649]: Listening on routing socket on fd #22 for interface updates 2024-09-18T12:24:43.591 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:43 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:43.591 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:43 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:43.591 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:43 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:43.591 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:43 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:43.591 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:43 ntpd[13649]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T12:24:43.591 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:43 ntpd[13649]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T12:24:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:44 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:44.591 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:44 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:45.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:45.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:45.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:45.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:45.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T12:24:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T12:24:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T12:24:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T12:24:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T12:24:45.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:45 ntpd[13649]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T12:24:47.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:47.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:47.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:47.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:47.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:47.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:47.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:47.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:47.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T12:24:47.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T12:24:47.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:47.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:47.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T12:24:47.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T12:24:47.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:47.594 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:47.594 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T12:24:47.594 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:47 ntpd[13649]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T12:24:49.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:49.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:49.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:49.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:49.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:49.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:49.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:49.592 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:49.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T12:24:49.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T12:24:49.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-18T12:24:49.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: can't open /var/log/ntpstats/rawstats.20240918: Permission denied 2024-09-18T12:24:49.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-18T12:24:49.593 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: can't open /var/log/ntpstats/peerstats.20240918: Permission denied 2024-09-18T12:24:49.593 INFO:teuthology.orchestra.run.smithi042.stdout:18 Sep 12:24:49 ntpd[13649]: ntpd: time slew +0.002791 s 2024-09-18T12:24:49.593 INFO:teuthology.orchestra.run.smithi042.stdout:ntpd: time slew +0.002791s 2024-09-18T12:24:49.594 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-18T12:24:49.594 INFO:teuthology.orchestra.run.smithi042.stderr:18 Sep 12:24:49 ntpd[13649]: can't open /var/log/ntpstats/loopstats.20240918: Permission denied 2024-09-18T12:24:49.664 INFO:teuthology.orchestra.run.smithi042.stdout: remote refid st t when poll reach delay offset jitter 2024-09-18T12:24:49.665 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================== 2024-09-18T12:24:49.665 INFO:teuthology.orchestra.run.smithi042.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-18T12:24:49.665 INFO:teuthology.orchestra.run.smithi042.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-18T12:24:49.665 INFO:teuthology.orchestra.run.smithi042.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-18T12:24:49.665 INFO:teuthology.orchestra.run.smithi042.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-18T12:24:49.666 INFO:teuthology.run_tasks:Running task install... 2024-09-18T12:24:49.675 DEBUG:teuthology.task.install:project ceph 2024-09-18T12:24:49.676 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}} 2024-09-18T12:24:49.676 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'} 2024-09-18T12:24:49.676 INFO:teuthology.task.install:Using flavor: default 2024-09-18T12:24:49.682 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-18T12:24:49.682 INFO:teuthology.task.install:extra packages: [] 2024-09-18T12:24:49.682 DEBUG:teuthology.orchestra.run.smithi042:> sudo apt-key list | grep Ceph 2024-09-18T12:24:49.783 INFO:teuthology.orchestra.run.smithi042.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-18T12:24:49.844 INFO:teuthology.orchestra.run.smithi042.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-18T12:24:49.845 INFO:teuthology.orchestra.run.smithi042.stdout:uid [ unknown] Ceph.com (release key) 2024-09-18T12:24:49.846 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-18T12:24:49.846 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T12:24:50.000 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default/ 2024-09-18T12:24:50.000 INFO:teuthology.task.install.deb:Package version is 17.2.7-1645-g7061ea6c-1focal 2024-09-18T12:24:50.115 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:24:50.116 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-18T12:24:50.132 DEBUG:teuthology.orchestra.run.smithi042:> sudo apt-get update 2024-09-18T12:24:50.334 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-18T12:24:50.340 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-18T12:24:50.358 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-18T12:24:50.372 INFO:teuthology.orchestra.run.smithi042.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal InRelease 2024-09-18T12:24:50.393 INFO:teuthology.orchestra.run.smithi042.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-18T12:24:50.416 INFO:teuthology.orchestra.run.smithi042.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal Release.gpg 2024-09-18T12:24:50.431 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-18T12:24:50.438 INFO:teuthology.orchestra.run.smithi042.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main i386 Packages [3,390 B] 2024-09-18T12:24:50.471 INFO:teuthology.orchestra.run.smithi042.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-09-18T12:24:51.003 INFO:teuthology.orchestra.run.smithi042.stdout:Fetched 28.4 kB in 1s (43.2 kB/s) 2024-09-18T12:24:52.207 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2024-09-18T12:24:52.234 DEBUG:teuthology.orchestra.run.smithi042:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1645-g7061ea6c-1focal cephadm=17.2.7-1645-g7061ea6c-1focal ceph-mds=17.2.7-1645-g7061ea6c-1focal ceph-mgr=17.2.7-1645-g7061ea6c-1focal ceph-common=17.2.7-1645-g7061ea6c-1focal ceph-fuse=17.2.7-1645-g7061ea6c-1focal ceph-test=17.2.7-1645-g7061ea6c-1focal ceph-volume=17.2.7-1645-g7061ea6c-1focal radosgw=17.2.7-1645-g7061ea6c-1focal python3-rados=17.2.7-1645-g7061ea6c-1focal python3-rgw=17.2.7-1645-g7061ea6c-1focal python3-cephfs=17.2.7-1645-g7061ea6c-1focal python3-rbd=17.2.7-1645-g7061ea6c-1focal libcephfs2=17.2.7-1645-g7061ea6c-1focal libcephfs-dev=17.2.7-1645-g7061ea6c-1focal librados2=17.2.7-1645-g7061ea6c-1focal librbd1=17.2.7-1645-g7061ea6c-1focal rbd-fuse=17.2.7-1645-g7061ea6c-1focal 2024-09-18T12:24:52.306 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2024-09-18T12:24:52.528 INFO:teuthology.orchestra.run.smithi042.stdout:Building dependency tree... 2024-09-18T12:24:52.528 INFO:teuthology.orchestra.run.smithi042.stdout:Reading state information... 2024-09-18T12:24:52.733 INFO:teuthology.orchestra.run.smithi042.stdout:The following packages were automatically installed and are no longer required: 2024-09-18T12:24:52.735 INFO:teuthology.orchestra.run.smithi042.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-18T12:24:52.735 INFO:teuthology.orchestra.run.smithi042.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-18T12:24:52.735 INFO:teuthology.orchestra.run.smithi042.stdout:The following additional packages will be installed: 2024-09-18T12:24:52.735 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-18T12:24:52.735 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-18T12:24:52.735 INFO:teuthology.orchestra.run.smithi042.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-18T12:24:52.735 INFO:teuthology.orchestra.run.smithi042.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-18T12:24:52.735 INFO:teuthology.orchestra.run.smithi042.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-18T12:24:52.736 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-18T12:24:52.736 INFO:teuthology.orchestra.run.smithi042.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-09-18T12:24:52.736 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-09-18T12:24:52.736 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 2024-09-18T12:24:52.736 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-18T12:24:52.736 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-18T12:24:52.736 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-18T12:24:52.737 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-18T12:24:52.737 INFO:teuthology.orchestra.run.smithi042.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-18T12:24:52.737 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-18T12:24:52.737 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2024-09-18T12:24:52.737 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2024-09-18T12:24:52.737 INFO:teuthology.orchestra.run.smithi042.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-18T12:24:52.737 INFO:teuthology.orchestra.run.smithi042.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2024-09-18T12:24:52.737 INFO:teuthology.orchestra.run.smithi042.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2024-09-18T12:24:52.737 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket python3-webtest python3-werkzeug qttranslations5-l10n 2024-09-18T12:24:52.737 INFO:teuthology.orchestra.run.smithi042.stdout: socat xmlstarlet 2024-09-18T12:24:52.738 INFO:teuthology.orchestra.run.smithi042.stdout:Suggested packages: 2024-09-18T12:24:52.738 INFO:teuthology.orchestra.run.smithi042.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-18T12:24:52.738 INFO:teuthology.orchestra.run.smithi042.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-18T12:24:52.738 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-18T12:24:52.738 INFO:teuthology.orchestra.run.smithi042.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-18T12:24:52.738 INFO:teuthology.orchestra.run.smithi042.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-18T12:24:52.738 INFO:teuthology.orchestra.run.smithi042.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-18T12:24:52.738 INFO:teuthology.orchestra.run.smithi042.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-18T12:24:52.738 INFO:teuthology.orchestra.run.smithi042.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-18T12:24:52.738 INFO:teuthology.orchestra.run.smithi042.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-18T12:24:52.738 INFO:teuthology.orchestra.run.smithi042.stdout:Recommended packages: 2024-09-18T12:24:52.738 INFO:teuthology.orchestra.run.smithi042.stdout: btrfs-tools 2024-09-18T12:24:52.864 INFO:teuthology.orchestra.run.smithi042.stdout:The following NEW packages will be installed: 2024-09-18T12:24:52.864 INFO:teuthology.orchestra.run.smithi042.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-18T12:24:52.864 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-18T12:24:52.864 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-18T12:24:52.865 INFO:teuthology.orchestra.run.smithi042.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-09-18T12:24:52.865 INFO:teuthology.orchestra.run.smithi042.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-09-18T12:24:52.865 INFO:teuthology.orchestra.run.smithi042.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-18T12:24:52.865 INFO:teuthology.orchestra.run.smithi042.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-09-18T12:24:52.865 INFO:teuthology.orchestra.run.smithi042.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-natsort-doc 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-18T12:24:52.866 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-18T12:24:52.867 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-18T12:24:52.867 INFO:teuthology.orchestra.run.smithi042.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-18T12:24:52.867 INFO:teuthology.orchestra.run.smithi042.stdout:The following packages will be upgraded: 2024-09-18T12:24:52.867 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 librbd1 2024-09-18T12:24:53.017 INFO:teuthology.orchestra.run.smithi042.stdout:2 upgraded, 108 newly installed, 0 to remove and 295 not upgraded. 2024-09-18T12:24:53.017 INFO:teuthology.orchestra.run.smithi042.stdout:Need to get 201 MB of archives. 2024-09-18T12:24:53.017 INFO:teuthology.orchestra.run.smithi042.stdout:After this operation, 938 MB of additional disk space will be used. 2024-09-18T12:24:53.017 INFO:teuthology.orchestra.run.smithi042.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1645-g7061ea6c-1focal [3,507 kB] 2024-09-18T12:24:53.060 INFO:teuthology.orchestra.run.smithi042.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-18T12:24:53.185 INFO:teuthology.orchestra.run.smithi042.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1645-g7061ea6c-1focal [3,562 kB] 2024-09-18T12:24:53.236 INFO:teuthology.orchestra.run.smithi042.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1645-g7061ea6c-1focal [761 kB] 2024-09-18T12:24:53.247 INFO:teuthology.orchestra.run.smithi042.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1645-g7061ea6c-1focal [414 kB] 2024-09-18T12:24:53.253 INFO:teuthology.orchestra.run.smithi042.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1645-g7061ea6c-1focal [22.6 kB] 2024-09-18T12:24:53.254 INFO:teuthology.orchestra.run.smithi042.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1645-g7061ea6c-1focal [200 kB] 2024-09-18T12:24:53.257 INFO:teuthology.orchestra.run.smithi042.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1645-g7061ea6c-1focal [49.1 kB] 2024-09-18T12:24:53.258 INFO:teuthology.orchestra.run.smithi042.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1645-g7061ea6c-1focal [390 kB] 2024-09-18T12:24:53.265 INFO:teuthology.orchestra.run.smithi042.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1645-g7061ea6c-1focal [5,637 kB] 2024-09-18T12:24:53.358 INFO:teuthology.orchestra.run.smithi042.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1645-g7061ea6c-1focal [116 kB] 2024-09-18T12:24:53.359 INFO:teuthology.orchestra.run.smithi042.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1645-g7061ea6c-1focal [479 kB] 2024-09-18T12:24:53.366 INFO:teuthology.orchestra.run.smithi042.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1645-g7061ea6c-1focal [27.0 MB] 2024-09-18T12:24:53.461 INFO:teuthology.orchestra.run.smithi042.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-18T12:24:53.469 INFO:teuthology.orchestra.run.smithi042.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-18T12:24:53.512 INFO:teuthology.orchestra.run.smithi042.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-18T12:24:53.524 INFO:teuthology.orchestra.run.smithi042.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-18T12:24:53.650 INFO:teuthology.orchestra.run.smithi042.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-18T12:24:53.656 INFO:teuthology.orchestra.run.smithi042.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-18T12:24:53.685 INFO:teuthology.orchestra.run.smithi042.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-18T12:24:53.874 INFO:teuthology.orchestra.run.smithi042.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-18T12:24:53.936 INFO:teuthology.orchestra.run.smithi042.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-18T12:24:53.936 INFO:teuthology.orchestra.run.smithi042.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1645-g7061ea6c-1focal [5,177 kB] 2024-09-18T12:24:53.952 INFO:teuthology.orchestra.run.smithi042.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-18T12:24:53.954 INFO:teuthology.orchestra.run.smithi042.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-18T12:24:53.954 INFO:teuthology.orchestra.run.smithi042.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-18T12:24:53.956 INFO:teuthology.orchestra.run.smithi042.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-18T12:24:53.957 INFO:teuthology.orchestra.run.smithi042.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-18T12:24:53.957 INFO:teuthology.orchestra.run.smithi042.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-18T12:24:53.957 INFO:teuthology.orchestra.run.smithi042.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-18T12:24:53.959 INFO:teuthology.orchestra.run.smithi042.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-18T12:24:53.983 INFO:teuthology.orchestra.run.smithi042.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1645-g7061ea6c-1focal [223 kB] 2024-09-18T12:24:53.985 INFO:teuthology.orchestra.run.smithi042.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1645-g7061ea6c-1focal [157 kB] 2024-09-18T12:24:53.986 INFO:teuthology.orchestra.run.smithi042.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1645-g7061ea6c-1focal [1,594 kB] 2024-09-18T12:24:54.010 INFO:teuthology.orchestra.run.smithi042.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1645-g7061ea6c-1focal [4,688 kB] 2024-09-18T12:24:54.039 INFO:teuthology.orchestra.run.smithi042.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-18T12:24:54.040 INFO:teuthology.orchestra.run.smithi042.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-18T12:24:54.041 INFO:teuthology.orchestra.run.smithi042.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-18T12:24:54.042 INFO:teuthology.orchestra.run.smithi042.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-18T12:24:54.043 INFO:teuthology.orchestra.run.smithi042.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-18T12:24:54.044 INFO:teuthology.orchestra.run.smithi042.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-18T12:24:54.087 INFO:teuthology.orchestra.run.smithi042.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1645-g7061ea6c-1focal [23.1 MB] 2024-09-18T12:24:54.120 INFO:teuthology.orchestra.run.smithi042.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-18T12:24:54.123 INFO:teuthology.orchestra.run.smithi042.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-18T12:24:54.124 INFO:teuthology.orchestra.run.smithi042.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-18T12:24:54.126 INFO:teuthology.orchestra.run.smithi042.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-18T12:24:54.202 INFO:teuthology.orchestra.run.smithi042.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-18T12:24:54.202 INFO:teuthology.orchestra.run.smithi042.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-18T12:24:54.212 INFO:teuthology.orchestra.run.smithi042.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-18T12:24:54.212 INFO:teuthology.orchestra.run.smithi042.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-18T12:24:54.212 INFO:teuthology.orchestra.run.smithi042.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-18T12:24:54.212 INFO:teuthology.orchestra.run.smithi042.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-18T12:24:54.283 INFO:teuthology.orchestra.run.smithi042.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-18T12:24:54.287 INFO:teuthology.orchestra.run.smithi042.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-18T12:24:54.289 INFO:teuthology.orchestra.run.smithi042.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-18T12:24:54.290 INFO:teuthology.orchestra.run.smithi042.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-18T12:24:54.364 INFO:teuthology.orchestra.run.smithi042.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-18T12:24:54.366 INFO:teuthology.orchestra.run.smithi042.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-18T12:24:54.369 INFO:teuthology.orchestra.run.smithi042.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-18T12:24:54.370 INFO:teuthology.orchestra.run.smithi042.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-18T12:24:54.371 INFO:teuthology.orchestra.run.smithi042.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-18T12:24:54.543 INFO:teuthology.orchestra.run.smithi042.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1645-g7061ea6c-1focal [3,936 B] 2024-09-18T12:24:54.543 INFO:teuthology.orchestra.run.smithi042.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1645-g7061ea6c-1focal [872 kB] 2024-09-18T12:24:54.556 INFO:teuthology.orchestra.run.smithi042.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1645-g7061ea6c-1focal [2,416 kB] 2024-09-18T12:24:54.574 INFO:teuthology.orchestra.run.smithi042.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1645-g7061ea6c-1focal [81.4 kB] 2024-09-18T12:24:54.575 INFO:teuthology.orchestra.run.smithi042.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1645-g7061ea6c-1focal [120 kB] 2024-09-18T12:24:54.575 INFO:teuthology.orchestra.run.smithi042.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1645-g7061ea6c-1focal [6,653 kB] 2024-09-18T12:24:54.647 INFO:teuthology.orchestra.run.smithi042.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-18T12:24:54.757 INFO:teuthology.orchestra.run.smithi042.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-18T12:24:54.757 INFO:teuthology.orchestra.run.smithi042.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1645-g7061ea6c-1focal [7,884 kB] 2024-09-18T12:24:54.759 INFO:teuthology.orchestra.run.smithi042.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-18T12:24:54.792 INFO:teuthology.orchestra.run.smithi042.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-18T12:24:54.792 INFO:teuthology.orchestra.run.smithi042.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-18T12:24:54.793 INFO:teuthology.orchestra.run.smithi042.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-18T12:24:54.794 INFO:teuthology.orchestra.run.smithi042.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-18T12:24:54.794 INFO:teuthology.orchestra.run.smithi042.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-18T12:24:54.796 INFO:teuthology.orchestra.run.smithi042.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-18T12:24:54.797 INFO:teuthology.orchestra.run.smithi042.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-18T12:24:54.839 INFO:teuthology.orchestra.run.smithi042.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1645-g7061ea6c-1focal [4,056 B] 2024-09-18T12:24:54.840 INFO:teuthology.orchestra.run.smithi042.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1645-g7061ea6c-1focal [53.4 MB] 2024-09-18T12:24:54.853 INFO:teuthology.orchestra.run.smithi042.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-18T12:24:54.853 INFO:teuthology.orchestra.run.smithi042.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-18T12:24:54.937 INFO:teuthology.orchestra.run.smithi042.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-18T12:24:54.939 INFO:teuthology.orchestra.run.smithi042.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-18T12:24:54.941 INFO:teuthology.orchestra.run.smithi042.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-18T12:24:54.944 INFO:teuthology.orchestra.run.smithi042.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-18T12:24:54.946 INFO:teuthology.orchestra.run.smithi042.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-18T12:24:54.949 INFO:teuthology.orchestra.run.smithi042.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-18T12:24:54.952 INFO:teuthology.orchestra.run.smithi042.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-18T12:24:55.025 INFO:teuthology.orchestra.run.smithi042.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-18T12:24:55.029 INFO:teuthology.orchestra.run.smithi042.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-18T12:24:55.190 INFO:teuthology.orchestra.run.smithi042.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-18T12:24:55.192 INFO:teuthology.orchestra.run.smithi042.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-18T12:24:55.192 INFO:teuthology.orchestra.run.smithi042.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-18T12:24:55.192 INFO:teuthology.orchestra.run.smithi042.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-18T12:24:55.193 INFO:teuthology.orchestra.run.smithi042.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-18T12:24:55.194 INFO:teuthology.orchestra.run.smithi042.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-18T12:24:55.207 INFO:teuthology.orchestra.run.smithi042.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-18T12:24:55.207 INFO:teuthology.orchestra.run.smithi042.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-18T12:24:55.234 INFO:teuthology.orchestra.run.smithi042.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-18T12:24:55.273 INFO:teuthology.orchestra.run.smithi042.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-18T12:24:55.354 INFO:teuthology.orchestra.run.smithi042.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-18T12:24:55.355 INFO:teuthology.orchestra.run.smithi042.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-18T12:24:55.355 INFO:teuthology.orchestra.run.smithi042.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-18T12:24:55.358 INFO:teuthology.orchestra.run.smithi042.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-18T12:24:55.359 INFO:teuthology.orchestra.run.smithi042.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-18T12:24:55.944 INFO:teuthology.orchestra.run.smithi042.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1645-g7061ea6c-1focal [231 kB] 2024-09-18T12:24:55.949 INFO:teuthology.orchestra.run.smithi042.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1645-g7061ea6c-1focal [21.9 kB] 2024-09-18T12:24:55.949 INFO:teuthology.orchestra.run.smithi042.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1645-g7061ea6c-1focal [17.2 MB] 2024-09-18T12:24:56.317 INFO:teuthology.orchestra.run.smithi042.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1645-g7061ea6c-1focal [80.6 kB] 2024-09-18T12:24:56.986 INFO:teuthology.orchestra.run.smithi042.stdout:Fetched 201 MB in 3s (58.4 MB/s) 2024-09-18T12:24:57.147 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-18T12:24:57.203 INFO:teuthology.orchestra.run.smithi042.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-18T12:24:57.207 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-18T12:24:57.279 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-18T12:24:57.632 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../001-librbd1_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:24:57.758 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking librbd1 (17.2.7-1645-g7061ea6c-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-18T12:24:58.486 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../002-librados2_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:24:58.621 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking librados2 (17.2.7-1645-g7061ea6c-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-18T12:24:59.424 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libcephfs2. 2024-09-18T12:24:59.442 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../003-libcephfs2_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:24:59.482 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libcephfs2 (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:24:59.852 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-rados. 2024-09-18T12:24:59.868 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../004-python3-rados_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:24:59.910 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-rados (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:00.271 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-18T12:25:00.290 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../005-python3-ceph-argparse_17.2.7-1645-g7061ea6c-1focal_all.deb ... 2024-09-18T12:25:00.329 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-ceph-argparse (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:00.565 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-cephfs. 2024-09-18T12:25:00.584 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../006-python3-cephfs_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:00.615 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-cephfs (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:00.960 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-18T12:25:00.975 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../007-python3-ceph-common_17.2.7-1645-g7061ea6c-1focal_all.deb ... 2024-09-18T12:25:01.018 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-ceph-common (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:01.371 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-prettytable. 2024-09-18T12:25:01.387 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../008-python3-prettytable_0.7.2-5_all.deb ... 2024-09-18T12:25:01.429 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-18T12:25:01.724 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-rbd. 2024-09-18T12:25:01.740 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../009-python3-rbd_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:01.782 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-rbd (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:02.170 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-18T12:25:02.189 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../010-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-18T12:25:02.226 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-18T12:25:02.554 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-18T12:25:02.570 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../011-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-18T12:25:02.613 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-18T12:25:02.974 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-18T12:25:02.990 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../012-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-18T12:25:03.032 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-18T12:25:03.394 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-18T12:25:03.410 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../013-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-18T12:25:03.443 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-18T12:25:03.796 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-18T12:25:03.814 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../014-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-18T12:25:03.854 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-18T12:25:04.383 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-18T12:25:04.399 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../015-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-18T12:25:04.452 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-18T12:25:04.928 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-18T12:25:04.949 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../016-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-18T12:25:05.011 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-18T12:25:05.389 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-18T12:25:05.406 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../017-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-18T12:25:05.439 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-18T12:25:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-18T12:25:05.835 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../018-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-18T12:25:05.887 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-18T12:25:06.262 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package librgw2. 2024-09-18T12:25:06.281 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../019-librgw2_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:06.320 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking librgw2 (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:07.139 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-rgw. 2024-09-18T12:25:07.155 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../020-python3-rgw_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:07.197 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-rgw (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:07.525 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package liboath0. 2024-09-18T12:25:07.542 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-18T12:25:07.575 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-18T12:25:07.913 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libradosstriper1. 2024-09-18T12:25:07.930 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../022-libradosstriper1_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:07.971 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libradosstriper1 (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:08.383 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-common. 2024-09-18T12:25:08.399 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../023-ceph-common_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:08.433 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-common (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:11.038 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-base. 2024-09-18T12:25:11.059 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../024-ceph-base_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:11.190 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-base (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:12.093 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-cryptography. 2024-09-18T12:25:12.110 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../025-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-18T12:25:12.142 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-18T12:25:12.563 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-openssl. 2024-09-18T12:25:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../026-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-18T12:25:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-18T12:25:12.941 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-packaging. 2024-09-18T12:25:12.960 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../027-python3-packaging_20.3-1_all.deb ... 2024-09-18T12:25:12.999 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-18T12:25:13.285 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-18T12:25:13.301 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../028-ceph-mgr-modules-core_17.2.7-1645-g7061ea6c-1focal_all.deb ... 2024-09-18T12:25:13.343 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:13.740 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-18T12:25:13.756 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../029-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-18T12:25:13.814 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-18T12:25:14.131 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-18T12:25:14.149 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../030-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-18T12:25:14.192 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-18T12:25:14.546 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-natsort. 2024-09-18T12:25:14.565 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../031-python3-natsort_7.0.1-1_all.deb ... 2024-09-18T12:25:14.604 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-18T12:25:14.932 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-jwt. 2024-09-18T12:25:14.948 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../032-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-18T12:25:14.990 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-18T12:25:15.293 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-logutils. 2024-09-18T12:25:15.310 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-7_all.deb ... 2024-09-18T12:25:15.343 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-18T12:25:15.680 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-18T12:25:15.695 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../034-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-18T12:25:15.738 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-18T12:25:16.049 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-mako. 2024-09-18T12:25:16.068 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../035-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-18T12:25:16.107 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-18T12:25:16.469 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-18T12:25:16.486 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-18T12:25:16.527 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-18T12:25:16.838 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-18T12:25:16.857 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-18T12:25:16.888 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-18T12:25:17.189 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-webob. 2024-09-18T12:25:17.206 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../038-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-18T12:25:17.247 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-18T12:25:17.583 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-18T12:25:17.599 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../039-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-18T12:25:17.675 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-18T12:25:17.961 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-bs4. 2024-09-18T12:25:17.980 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../040-python3-bs4_4.8.2-1_all.deb ... 2024-09-18T12:25:18.052 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-18T12:25:18.439 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-waitress. 2024-09-18T12:25:18.457 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../041-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-18T12:25:18.500 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-18T12:25:18.876 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-tempita. 2024-09-18T12:25:18.892 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6_all.deb ... 2024-09-18T12:25:18.933 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-18T12:25:19.245 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-paste. 2024-09-18T12:25:19.264 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../043-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-18T12:25:19.303 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-18T12:25:19.665 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-18T12:25:19.685 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-18T12:25:19.723 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-18T12:25:20.059 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-18T12:25:20.076 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-18T12:25:20.142 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-18T12:25:20.583 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-webtest. 2024-09-18T12:25:20.601 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../046-python3-webtest_2.0.32-2_all.deb ... 2024-09-18T12:25:20.641 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-18T12:25:20.969 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pecan. 2024-09-18T12:25:20.986 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-18T12:25:21.027 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-18T12:25:21.431 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-18T12:25:21.447 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../048-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-18T12:25:21.506 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-18T12:25:21.876 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-18T12:25:21.894 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../049-libsqlite3-mod-ceph_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:21.934 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:22.345 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mgr. 2024-09-18T12:25:22.365 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../050-ceph-mgr_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:22.403 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mgr (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:22.899 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mon. 2024-09-18T12:25:22.918 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../051-ceph-mon_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:22.957 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mon (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:23.936 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-osd. 2024-09-18T12:25:23.957 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../052-ceph-osd_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:23.994 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-osd (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:26.181 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph. 2024-09-18T12:25:26.201 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../053-ceph_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:26.257 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:26.550 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-fuse. 2024-09-18T12:25:26.569 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../054-ceph-fuse_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:26.825 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-fuse (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:27.878 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mds. 2024-09-18T12:25:27.897 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../055-ceph-mds_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:27.936 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mds (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:28.523 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package cephadm. 2024-09-18T12:25:28.539 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../056-cephadm_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:28.581 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking cephadm (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:28.876 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-jinja2. 2024-09-18T12:25:28.895 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../057-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-18T12:25:29.033 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-18T12:25:29.320 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-18T12:25:29.336 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../058-ceph-mgr-cephadm_17.2.7-1645-g7061ea6c-1focal_all.deb ... 2024-09-18T12:25:29.369 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:29.715 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-18T12:25:29.733 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../059-python3-repoze.lru_0.7-2_all.deb ... 2024-09-18T12:25:29.773 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-18T12:25:30.067 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libjs-underscore. 2024-09-18T12:25:30.087 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../060-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-18T12:25:30.125 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-18T12:25:30.445 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-18T12:25:30.462 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../061-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-18T12:25:30.503 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-18T12:25:30.847 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-routes. 2024-09-18T12:25:30.863 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../062-python3-routes_2.4.1-2_all.deb ... 2024-09-18T12:25:30.939 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-18T12:25:31.305 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-18T12:25:31.335 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../063-ceph-mgr-dashboard_17.2.7-1645-g7061ea6c-1focal_all.deb ... 2024-09-18T12:25:31.360 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:32.774 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-decorator. 2024-09-18T12:25:32.791 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../064-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-18T12:25:32.832 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-18T12:25:33.168 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-18T12:25:33.184 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../065-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-18T12:25:33.226 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-18T12:25:33.579 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-scipy. 2024-09-18T12:25:33.597 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../066-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-18T12:25:33.637 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-18T12:25:34.971 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-18T12:25:34.987 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../067-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-18T12:25:35.029 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-18T12:25:35.604 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-joblib. 2024-09-18T12:25:35.622 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../068-python3-joblib_0.14.0-3_all.deb ... 2024-09-18T12:25:35.666 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-18T12:25:36.044 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-sklearn. 2024-09-18T12:25:36.064 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../069-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-18T12:25:36.102 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-18T12:25:36.827 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-18T12:25:36.844 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../070-ceph-mgr-diskprediction-local_17.2.7-1645-g7061ea6c-1focal_all.deb ... 2024-09-18T12:25:36.885 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:38.013 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-cachetools. 2024-09-18T12:25:38.033 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../071-python3-cachetools_4.0.0-1_all.deb ... 2024-09-18T12:25:38.096 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-18T12:25:38.474 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-18T12:25:38.491 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../072-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-18T12:25:38.532 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-18T12:25:38.886 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-18T12:25:38.903 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../073-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-18T12:25:38.945 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-18T12:25:39.289 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-rsa. 2024-09-18T12:25:39.306 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../074-python3-rsa_4.0-3_all.deb ... 2024-09-18T12:25:39.347 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-18T12:25:39.717 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-google-auth. 2024-09-18T12:25:39.735 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../075-python3-google-auth_1.5.1-2_all.deb ... 2024-09-18T12:25:39.775 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-18T12:25:40.129 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-blinker. 2024-09-18T12:25:40.147 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../076-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-18T12:25:40.220 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-18T12:25:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-18T12:25:40.569 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../077-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-18T12:25:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-18T12:25:40.952 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-18T12:25:40.968 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-18T12:25:41.010 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-18T12:25:41.350 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-websocket. 2024-09-18T12:25:41.367 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../079-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-18T12:25:41.408 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-18T12:25:41.728 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-18T12:25:41.746 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../080-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-18T12:25:41.785 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-18T12:25:42.476 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-18T12:25:42.493 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_17.2.7-1645-g7061ea6c-1focal_all.deb ... 2024-09-18T12:25:42.534 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:42.879 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-18T12:25:42.896 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../082-libonig5_6.9.4-1_amd64.deb ... 2024-09-18T12:25:42.937 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-18T12:25:43.718 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-18T12:25:43.737 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../083-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-18T12:25:43.776 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-18T12:25:44.087 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package jq. 2024-09-18T12:25:44.104 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../084-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-18T12:25:44.145 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-18T12:25:44.419 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package socat. 2024-09-18T12:25:44.438 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../085-socat_1.7.3.3-2_amd64.deb ... 2024-09-18T12:25:44.477 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-18T12:25:44.823 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package xmlstarlet. 2024-09-18T12:25:44.839 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-18T12:25:44.881 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-18T12:25:45.296 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-test. 2024-09-18T12:25:45.316 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../087-ceph-test_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:45.354 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-test (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:49.951 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-volume. 2024-09-18T12:25:49.967 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../088-ceph-volume_17.2.7-1645-g7061ea6c-1focal_all.deb ... 2024-09-18T12:25:50.008 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-volume (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:50.363 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-18T12:25:50.380 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../089-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-18T12:25:50.421 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-18T12:25:50.960 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-18T12:25:50.979 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../090-libcephfs-dev_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:25:51.025 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libcephfs-dev (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:25:51.578 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package nvme-cli. 2024-09-18T12:25:51.596 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../091-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-18T12:25:51.653 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-18T12:25:52.036 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-18T12:25:52.055 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../092-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-18T12:25:52.099 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-18T12:25:53.895 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-18T12:25:53.916 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../093-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-18T12:25:53.952 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-18T12:25:54.314 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-18T12:25:54.332 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../094-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-18T12:25:54.372 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-18T12:25:54.700 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-attr. 2024-09-18T12:25:54.717 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../095-python3-attr_19.3.0-2_all.deb ... 2024-09-18T12:25:54.758 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-18T12:25:55.145 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-webencodings. 2024-09-18T12:25:55.161 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../096-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-18T12:25:55.194 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-18T12:25:55.505 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-html5lib. 2024-09-18T12:25:55.526 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../097-python3-html5lib_1.0.1-2_all.deb ... 2024-09-18T12:25:55.563 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-18T12:25:55.925 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-18T12:25:55.942 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../098-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-18T12:25:56.016 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-18T12:25:56.503 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pastescript. 2024-09-18T12:25:56.522 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-4_all.deb ... 2024-09-18T12:25:56.561 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-18T12:25:56.915 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pluggy. 2024-09-18T12:25:56.933 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../100-python3-pluggy_0.13.0-2_all.deb ... 2024-09-18T12:25:56.973 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-18T12:25:57.309 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-psutil. 2024-09-18T12:25:57.328 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../101-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-18T12:25:57.367 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-18T12:25:57.721 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-py. 2024-09-18T12:25:57.738 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../102-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-18T12:25:57.796 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-18T12:25:58.140 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-18T12:25:58.161 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-18T12:25:58.199 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-18T12:25:58.546 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-18T12:25:58.564 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../104-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-18T12:25:58.629 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-18T12:25:58.958 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pytest. 2024-09-18T12:25:58.978 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../105-python3-pytest_4.6.9-1_all.deb ... 2024-09-18T12:25:59.015 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-18T12:25:59.394 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-simplejson. 2024-09-18T12:25:59.412 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../106-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-18T12:25:59.452 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-18T12:25:59.747 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-18T12:25:59.764 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../107-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-18T12:25:59.805 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-18T12:26:00.609 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package radosgw. 2024-09-18T12:26:00.630 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../108-radosgw_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:26:00.667 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking radosgw (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:02.582 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package rbd-fuse. 2024-09-18T12:26:02.600 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../109-rbd-fuse_17.2.7-1645-g7061ea6c-1focal_amd64.deb ... 2024-09-18T12:26:02.640 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking rbd-fuse (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:02.967 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-18T12:26:03.370 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-18T12:26:03.529 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-18T12:26:03.655 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-18T12:26:03.881 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up cephadm (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:04.478 INFO:teuthology.orchestra.run.smithi042.stdout:Adding system user cephadm....done 2024-09-18T12:26:04.664 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-18T12:26:04.790 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-18T12:26:05.142 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-18T12:26:05.435 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-18T12:26:05.561 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-18T12:26:05.704 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-18T12:26:06.038 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-18T12:26:06.448 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-18T12:26:06.750 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-18T12:26:07.068 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-18T12:26:07.344 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-18T12:26:07.653 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-ceph-argparse (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:07.946 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-18T12:26:08.088 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-18T12:26:08.382 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-18T12:26:08.699 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-18T12:26:08.859 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-18T12:26:09.235 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-18T12:26:09.537 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-18T12:26:09.812 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-18T12:26:10.164 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-18T12:26:10.465 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-18T12:26:10.841 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-18T12:26:11.159 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-18T12:26:11.502 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-18T12:26:11.670 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-18T12:26:11.795 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-18T12:26:12.088 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-18T12:26:12.482 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-18T12:26:12.841 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-18T12:26:13.193 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-18T12:26:13.319 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-ceph-common (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:13.679 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-18T12:26:13.822 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-18T12:26:14.548 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-18T12:26:14.674 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-18T12:26:14.800 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-18T12:26:15.127 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-18T12:26:15.470 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-18T12:26:15.638 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-18T12:26:15.764 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-18T12:26:16.082 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-18T12:26:16.366 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-18T12:26:16.659 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-18T12:26:16.768 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-18T12:26:17.055 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-18T12:26:17.356 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-18T12:26:17.693 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-18T12:26:18.056 INFO:teuthology.orchestra.run.smithi042.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-18T12:26:18.377 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-18T12:26:18.503 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-18T12:26:18.829 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-18T12:26:19.198 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-18T12:26:19.324 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-18T12:26:19.492 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-18T12:26:19.818 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-18T12:26:20.136 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up librados2 (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:20.262 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-18T12:26:21.793 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:21.927 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-18T12:26:22.053 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-18T12:26:22.439 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-18T12:26:22.740 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-18T12:26:23.016 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-18T12:26:23.142 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-18T12:26:23.494 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libcephfs2 (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:23.643 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-18T12:26:23.997 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libradosstriper1 (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:24.123 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-18T12:26:24.466 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-18T12:26:25.555 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up librbd1 (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:25.682 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-18T12:26:25.833 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-18T12:26:25.959 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-18T12:26:26.110 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-18T12:26:26.403 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-18T12:26:26.570 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-18T12:26:26.873 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mgr-modules-core (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:26.998 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-fuse (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:27.229 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-18T12:26:27.229 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-18T12:26:27.674 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libcephfs-dev (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:27.911 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-18T12:26:28.238 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-18T12:26:28.539 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-18T12:26:28.934 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-rados (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:29.060 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up librgw2 (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:29.186 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-rbd (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:29.346 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up rbd-fuse (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:29.471 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-18T12:26:29.748 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-18T12:26:30.050 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-rgw (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:30.176 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-cephfs (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:30.293 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-18T12:26:31.281 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-common (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:31.859 INFO:teuthology.orchestra.run.smithi042.stdout:Adding group ceph....done 2024-09-18T12:26:32.227 INFO:teuthology.orchestra.run.smithi042.stdout:Adding system user ceph....done 2024-09-18T12:26:32.387 INFO:teuthology.orchestra.run.smithi042.stdout:Setting system user ceph properties....done 2024-09-18T12:26:32.410 INFO:teuthology.orchestra.run.smithi042.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-18T12:26:32.559 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-18T12:26:32.886 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-18T12:26:33.350 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-test (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:33.468 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up radosgw (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:33.772 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:26:33.772 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-18T12:26:34.445 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-base (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:34.854 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-18T12:26:35.314 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mds (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:35.546 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-18T12:26:35.546 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-18T12:26:35.990 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mgr (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:36.225 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-18T12:26:36.225 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-18T12:26:36.709 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-osd (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:37.207 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-18T12:26:37.207 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-18T12:26:37.660 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:37.811 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:37.946 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mon (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:38.176 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-18T12:26:38.176 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-18T12:26:38.639 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mgr-cephadm (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:38.807 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:38.933 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mgr-dashboard (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:39.076 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-volume (17.2.7-1645-g7061ea6c-1focal) ... 2024-09-18T12:26:39.236 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-18T12:26:39.388 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-18T12:26:39.673 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-18T12:26:42.576 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-18T12:26:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-18T12:26:43.202 DEBUG:teuthology.parallel:result is None 2024-09-18T12:26:43.203 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T12:26:43.348 DEBUG:teuthology.orchestra.run.smithi042:> dpkg-query -W -f '${Version}' ceph 2024-09-18T12:26:43.373 INFO:teuthology.orchestra.run.smithi042.stdout:17.2.7-1645-g7061ea6c-1focal 2024-09-18T12:26:43.373 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1645-g7061ea6c-1focal 2024-09-18T12:26:43.373 INFO:teuthology.task.install:The correct ceph version 17.2.7-1645-g7061ea6c-1focal is installed. 2024-09-18T12:26:43.375 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-18T12:26:43.375 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:26:43.375 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T12:26:43.386 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-18T12:26:43.387 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:26:43.387 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T12:26:43.444 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T12:26:43.453 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-18T12:26:43.454 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:26:43.454 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T12:26:43.470 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T12:26:43.483 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-18T12:26:43.484 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:26:43.484 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T12:26:43.495 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T12:26:43.549 INFO:teuthology.run_tasks:Running task ceph... 2024-09-18T12:26:43.631 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-18T12:26:43.631 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /var/log/ceph 2024-09-18T12:26:43.647 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-18T12:26:43.647 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T12:26:43.662 INFO:tasks.ceph:Creating extra log directories... 2024-09-18T12:26:43.663 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T12:26:43.682 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-18T12:26:43.682 INFO:tasks.ceph:config {'conf': {'osd': {'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-18T12:26:43.682 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7911040', 'branch': 'wip-bharath11-testing-2024-09-18-1115-quincy', 'description': 'rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'job_id': '7911040', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-bharath11-testing-2024-09-18-1115-quincy'}, 'ceph': {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}}, 'workunit': {'branch': 'wip-bharath11-testing-2024-09-18-1115-quincy', 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}}, 'owner': 'scheduled_skanta@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'osd.8', 'osd.9', 'client.0']], 'seed': 4631, 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath11-testing-2024-09-18-1115-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_7061ea6ca50908d104e9f3979dc615e118d9e153/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153', 'targets': {'smithi042.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'log-ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'flavor': 'default', 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153', 'cluster': 'ceph'}}, {'workunit': {'clients': {'all': ['rados/test_health_warnings.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-18_09:13:00', 'tube': 'smithi', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-18T12:26:43.683 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T12:26:43.689 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T12:26:43.746 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:26:43.747 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T12:26:43.751 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T12:26:43.752 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-09-18T12:26:43.757 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T12:26:43.757 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:26:43.757 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-09-18T12:26:43.757 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:26:43.757 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-18 12:23:14.767065012 +0000 2024-09-18T12:26:43.757 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-18 12:23:14.555069898 +0000 2024-09-18T12:26:43.757 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-18 12:23:14.555069898 +0000 2024-09-18T12:26:43.757 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2024-09-18T12:26:43.758 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T12:26:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-18T12:26:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-18T12:26:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.00031627 s, 1.6 MB/s 2024-09-18T12:26:43.772 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T12:26:43.824 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-09-18T12:26:43.830 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T12:26:43.830 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:26:43.830 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 365 Links: 1 2024-09-18T12:26:43.831 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:26:43.831 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-18 12:23:15.175055608 +0000 2024-09-18T12:26:43.831 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-18 12:23:14.987059941 +0000 2024-09-18T12:26:43.831 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-18 12:23:14.987059941 +0000 2024-09-18T12:26:43.831 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2024-09-18T12:26:43.831 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T12:26:43.845 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-18T12:26:43.846 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-18T12:26:43.846 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000254002 s, 2.0 MB/s 2024-09-18T12:26:43.847 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T12:26:43.854 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-09-18T12:26:43.913 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T12:26:43.914 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:26:43.914 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 374 Links: 1 2024-09-18T12:26:43.914 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:26:43.914 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-18 12:23:15.371051090 +0000 2024-09-18T12:26:43.914 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-18 12:23:15.367051183 +0000 2024-09-18T12:26:43.914 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-18 12:23:15.367051183 +0000 2024-09-18T12:26:43.914 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2024-09-18T12:26:43.914 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T12:26:43.929 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-18T12:26:43.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-18T12:26:43.930 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000298623 s, 1.7 MB/s 2024-09-18T12:26:43.931 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T12:26:43.940 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-09-18T12:26:43.947 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T12:26:43.948 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T12:26:43.948 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 377 Links: 1 2024-09-18T12:26:43.948 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T12:26:43.948 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-18 12:23:16.035035786 +0000 2024-09-18T12:26:43.948 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-18 12:23:15.823040672 +0000 2024-09-18T12:26:43.948 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-18 12:23:15.823040672 +0000 2024-09-18T12:26:43.948 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2024-09-18T12:26:43.948 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T12:26:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-18T12:26:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-18T12:26:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000307896 s, 1.7 MB/s 2024-09-18T12:26:44.005 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T12:26:44.015 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T12:26:44.015 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-09-18T12:26:44.015 INFO:tasks.ceph:Generating config... 2024-09-18T12:26:44.017 INFO:tasks.ceph:[osd] osd max object name len = 400 2024-09-18T12:26:44.017 INFO:tasks.ceph:[osd] osd max object namespace len = 64 2024-09-18T12:26:44.017 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-18T12:26:44.017 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-18T12:26:44.017 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-18T12:26:44.017 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-18T12:26:44.017 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-18T12:26:44.017 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-18T12:26:44.017 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-18T12:26:44.017 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-18T12:26:44.018 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-18T12:26:44.018 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-09-18T12:26:44.018 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-18T12:26:44.018 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-18T12:26:44.018 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-18T12:26:44.018 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-18T12:26:44.018 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-18T12:26:44.018 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-18T12:26:44.019 INFO:tasks.ceph:Setting up mon.a... 2024-09-18T12:26:44.019 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-18T12:26:44.053 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.keyring 2024-09-18T12:26:44.056 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-18T12:26:44.131 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T12:26:44.145 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.42')] 2024-09-18T12:26:44.146 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.42', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2024-09-18T12:26:44.146 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:26:44.147 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T12:26:44.166 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.42 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:26:44.244 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:26:44.245 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: generated fsid d50b3a4e-0c54-4de8-95b7-7e9a6d6a5fb8 2024-09-18T12:26:44.245 INFO:teuthology.orchestra.run.smithi042.stdout:setting min_mon_release = octopus 2024-09-18T12:26:44.245 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 0 2024-09-18T12:26:44.245 INFO:teuthology.orchestra.run.smithi042.stdout:fsid d50b3a4e-0c54-4de8-95b7-7e9a6d6a5fb8 2024-09-18T12:26:44.245 INFO:teuthology.orchestra.run.smithi042.stdout:last_changed 2024-09-18T12:26:44.243954+0000 2024-09-18T12:26:44.245 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-09-18T12:26:44.243954+0000 2024-09-18T12:26:44.245 INFO:teuthology.orchestra.run.smithi042.stdout:min_mon_release 15 (octopus) 2024-09-18T12:26:44.245 INFO:teuthology.orchestra.run.smithi042.stdout:election_strategy: 3 2024-09-18T12:26:44.245 INFO:teuthology.orchestra.run.smithi042.stdout:0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-18T12:26:44.245 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-18T12:26:44.247 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T12:26:44.255 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d50b3a4e-0c54-4de8-95b7-7e9a6d6a5fb8... 2024-09-18T12:26:44.256 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T12:26:44.333 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-09-18T12:26:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-09-18T12:26:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T12:26:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-09-18T12:26:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-09-18T12:26:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-09-18T12:26:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-09-18T12:26:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-09-18T12:26:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-09-18T12:26:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-09-18T12:26:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.335 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T12:26:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-09-18T12:26:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T12:26:44.336 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T12:26:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-09-18T12:26:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.337 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-09-18T12:26:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-09-18T12:26:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-09-18T12:26:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-09-18T12:26:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-09-18T12:26:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-09-18T12:26:44.338 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-09-18T12:26:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T12:26:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T12:26:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-09-18T12:26:44.339 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T12:26:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-09-18T12:26:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.340 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-09-18T12:26:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-09-18T12:26:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-09-18T12:26:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-09-18T12:26:44.341 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = 172.21.15.42 2024-09-18T12:26:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: mon election default strategy = 3 2024-09-18T12:26:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = d50b3a4e-0c54-4de8-95b7-7e9a6d6a5fb8 2024-09-18T12:26:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.342 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-09-18T12:26:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-09-18T12:26:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-09-18T12:26:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-09-18T12:26:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-09-18T12:26:44.343 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-09-18T12:26:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-09-18T12:26:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-09-18T12:26:44.344 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-09-18T12:26:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-09-18T12:26:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-09-18T12:26:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-09-18T12:26:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.345 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-09-18T12:26:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-09-18T12:26:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-09-18T12:26:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.346 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-09-18T12:26:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-09-18T12:26:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-09-18T12:26:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-09-18T12:26:44.347 INFO:teuthology.orchestra.run.smithi042.stdout: osd max object name len = 400 2024-09-18T12:26:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: osd max object namespace len = 64 2024-09-18T12:26:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore zero block detection = True 2024-09-18T12:26:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-18T12:26:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-09-18T12:26:44.348 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify cached snaps = True 2024-09-18T12:26:44.349 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify missing on start = True 2024-09-18T12:26:44.349 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock override recovery settings = True 2024-09-18T12:26:44.349 INFO:teuthology.orchestra.run.smithi042.stdout: osd op queue = debug_random 2024-09-18T12:26:44.349 INFO:teuthology.orchestra.run.smithi042.stdout: osd op queue cut off = debug_random 2024-09-18T12:26:44.349 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.349 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-09-18T12:26:44.350 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-18T12:26:44.350 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-09-18T12:26:44.350 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-18T12:26:44.350 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-18T12:26:44.350 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-18T12:26:44.350 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-18T12:26:44.351 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-09-18T12:26:44.351 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.351 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-09-18T12:26:44.351 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-18T12:26:44.351 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-18T12:26:44.351 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-09-18T12:26:44.351 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-18T12:26:44.352 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-09-18T12:26:44.352 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-09-18T12:26:44.352 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-18T12:26:44.352 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-09-18T12:26:44.352 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-09-18T12:26:44.352 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-18T12:26:44.353 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.353 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T12:26:44.353 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T12:26:44.353 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T12:26:44.353 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.353 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T12:26:44.354 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T12:26:44.354 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T12:26:44.354 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.354 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-09-18T12:26:44.354 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-09-18T12:26:44.354 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.354 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-09-18T12:26:44.354 INFO:teuthology.orchestra.run.smithi042.stdout: mon scrub interval = 300 2024-09-18T12:26:44.354 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:26:44.355 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-09-18T12:26:44.355 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-09-18T12:26:44.355 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-09-18T12:26:44.355 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-09-18T12:26:44.355 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T12:26:44.355 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T12:26:44.355 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-09-18T12:26:44.357 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-18T12:26:44.357 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-18T12:26:44.410 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-18T12:26:44.410 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:26:44.410 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-18T12:26:44.417 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:26:44.417 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-18T12:26:44.423 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi042.front.sepia.ceph.com 2024-09-18T12:26:44.424 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:26:44.424 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T12:26:44.424 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T12:26:44.451 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:26:44.451 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:26:44.456 INFO:tasks.ceph:Setting up mon nodes... 2024-09-18T12:26:44.457 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-18T12:26:44.457 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T12:26:44.544 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T12:26:44.547 INFO:tasks.ceph:Setting up mds nodes... 2024-09-18T12:26:44.547 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-18T12:26:44.548 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-18T12:26:44.581 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-18T12:26:44.593 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-18T12:26:44.593 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-09-18T12:26:44.593 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-18T12:26:44.608 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T12:26:44.608 INFO:tasks.ceph:role: osd.0 2024-09-18T12:26:44.608 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-18T12:26:44.608 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T12:26:44.694 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T12:26:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T12:26:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T12:26:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 2024-09-18T12:26:44.694 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T12:26:44.694 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-18T12:26:44.694 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T12:26:44.695 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T12:26:44.695 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T12:26:44.695 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T12:26:44.696 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-18T12:26:44.696 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-18T12:26:44.717 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-18T12:26:44.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:26:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T12:26:44.728 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-18T12:26:44.782 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T12:26:44.782 INFO:tasks.ceph:role: osd.1 2024-09-18T12:26:44.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-18T12:26:44.782 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T12:26:44.822 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T12:26:44.822 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T12:26:44.822 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T12:26:44.823 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 2024-09-18T12:26:44.823 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T12:26:44.823 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-18T12:26:44.823 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T12:26:44.823 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T12:26:44.823 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T12:26:44.823 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T12:26:44.824 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-18T12:26:44.825 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-18T12:26:44.844 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-18T12:26:44.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:26:44.856 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T12:26:44.856 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-18T12:26:44.917 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T12:26:44.917 INFO:tasks.ceph:role: osd.2 2024-09-18T12:26:44.917 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-18T12:26:44.917 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-18T12:26:44.959 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T12:26:44.959 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T12:26:44.960 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T12:26:44.960 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 2024-09-18T12:26:44.960 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T12:26:44.960 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-18T12:26:44.960 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T12:26:44.960 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T12:26:44.960 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T12:26:44.960 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T12:26:44.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-18T12:26:44.961 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-18T12:26:44.981 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-18T12:26:45.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:26:45.036 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T12:26:45.036 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-18T12:26:45.049 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T12:26:45.049 INFO:tasks.ceph:role: osd.3 2024-09-18T12:26:45.049 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-18T12:26:45.049 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-18T12:26:45.090 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T12:26:45.091 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T12:26:45.091 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T12:26:45.091 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 2024-09-18T12:26:45.091 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T12:26:45.091 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-18T12:26:45.091 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T12:26:45.091 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-18T12:26:45.092 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T12:26:45.092 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T12:26:45.093 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-18T12:26:45.093 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-18T12:26:45.158 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-18T12:26:45.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:26:45.168 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: /sbin/restorecon: command not found 2024-09-18T12:26:45.168 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-18T12:26:45.180 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T12:26:45.181 INFO:tasks.ceph:role: osd.4 2024-09-18T12:26:45.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-18T12:26:45.193 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T12:26:45.193 INFO:tasks.ceph:role: osd.5 2024-09-18T12:26:45.193 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-18T12:26:45.206 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T12:26:45.206 INFO:tasks.ceph:role: osd.6 2024-09-18T12:26:45.206 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-18T12:26:45.265 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T12:26:45.265 INFO:tasks.ceph:role: osd.7 2024-09-18T12:26:45.266 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2024-09-18T12:26:45.282 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T12:26:45.282 INFO:tasks.ceph:role: osd.8 2024-09-18T12:26:45.282 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2024-09-18T12:26:45.298 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-18T12:26:45.299 INFO:tasks.ceph:role: osd.9 2024-09-18T12:26:45.299 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:26:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:45.381+0000 7f05bf247540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-18T12:26:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:45.381+0000 7f05bf247540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-18T12:26:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:45.381+0000 7f05bf247540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-18T12:26:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:45.381+0000 7f05bf247540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-18T12:26:45.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:45.381+0000 7f05bf247540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-18T12:26:45.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:45.381+0000 7f05bf247540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-18T12:26:45.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:45.932+0000 7f05bf247540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:26:46.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:46.712+0000 7f05bf247540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:26:47.564 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T12:26:47.579 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:26:47.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:47.612+0000 7f830fbc2540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-18T12:26:47.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:47.612+0000 7f830fbc2540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-18T12:26:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:47.612+0000 7f830fbc2540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-18T12:26:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:47.612+0000 7f830fbc2540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-18T12:26:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:47.612+0000 7f830fbc2540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-18T12:26:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:47.612+0000 7f830fbc2540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-18T12:26:48.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:48.168+0000 7f830fbc2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:26:48.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:48.960+0000 7f830fbc2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:26:49.808 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T12:26:49.823 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:26:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:49.856+0000 7fe874cc8540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-18T12:26:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:49.856+0000 7fe874cc8540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-18T12:26:49.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:49.856+0000 7fe874cc8540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-18T12:26:49.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:49.856+0000 7fe874cc8540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-18T12:26:49.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:49.856+0000 7fe874cc8540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-18T12:26:49.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:49.856+0000 7fe874cc8540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-18T12:26:50.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:50.404+0000 7fe874cc8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:26:51.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:51.200+0000 7fe874cc8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:26:52.039 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T12:26:52.096 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:26:52.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:52.124+0000 7f6ec2daa540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-18T12:26:52.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:52.124+0000 7f6ec2daa540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-18T12:26:52.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:52.124+0000 7f6ec2daa540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-18T12:26:52.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:52.124+0000 7f6ec2daa540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-18T12:26:52.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:52.124+0000 7f6ec2daa540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-18T12:26:52.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:52.128+0000 7f6ec2daa540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-18T12:26:52.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:52.688+0000 7f6ec2daa540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:26:53.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:53.472+0000 7f6ec2daa540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:26:54.327 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T12:26:54.344 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:26:54.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:54.424+0000 7fe7eb052540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-18T12:26:54.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:54.424+0000 7fe7eb052540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-18T12:26:54.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:54.424+0000 7fe7eb052540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-18T12:26:54.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:54.424+0000 7fe7eb052540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-18T12:26:54.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:54.424+0000 7fe7eb052540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-18T12:26:54.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:54.424+0000 7fe7eb052540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-18T12:26:54.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:54.976+0000 7fe7eb052540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:26:55.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:55.756+0000 7fe7eb052540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:26:56.611 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T12:26:56.629 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:26:56.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:56.660+0000 7f9af6acb540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-18T12:26:56.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:56.660+0000 7f9af6acb540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-18T12:26:56.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:56.660+0000 7f9af6acb540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-18T12:26:56.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:56.660+0000 7f9af6acb540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-18T12:26:56.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:56.660+0000 7f9af6acb540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-18T12:26:56.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:56.660+0000 7f9af6acb540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-18T12:26:57.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:57.208+0000 7f9af6acb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:26:58.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:57.996+0000 7f9af6acb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:26:58.839 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T12:26:58.856 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:26:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:58.936+0000 7f87b27fa540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-18T12:26:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:58.936+0000 7f87b27fa540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-18T12:26:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:58.936+0000 7f87b27fa540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-18T12:26:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:58.936+0000 7f87b27fa540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-18T12:26:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:58.936+0000 7f87b27fa540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-18T12:26:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:58.936+0000 7f87b27fa540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-18T12:26:59.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:26:59.500+0000 7f87b27fa540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:27:00.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:00.284+0000 7f87b27fa540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:27:01.131 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-18T12:27:01.144 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:27:01.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:01.176+0000 7f5d21512540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-18T12:27:01.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:01.176+0000 7f5d21512540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-18T12:27:01.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:01.176+0000 7f5d21512540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-18T12:27:01.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:01.176+0000 7f5d21512540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-18T12:27:01.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:01.176+0000 7f5d21512540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-18T12:27:01.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:01.176+0000 7f5d21512540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-18T12:27:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:01.732+0000 7f5d21512540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:27:02.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:02.520+0000 7f5d21512540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:27:03.371 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-18T12:27:03.428 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:27:03.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:03.456+0000 7f2b06132540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2024-09-18T12:27:03.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:03.456+0000 7f2b06132540 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2024-09-18T12:27:03.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:03.456+0000 7f2b06132540 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-09-18T12:27:03.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:03.456+0000 7f2b06132540 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-09-18T12:27:03.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:03.456+0000 7f2b06132540 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-09-18T12:27:03.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:03.456+0000 7f2b06132540 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2024-09-18T12:27:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:04.008+0000 7f2b06132540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:27:04.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:04.812+0000 7f2b06132540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:27:05.663 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2024-09-18T12:27:05.680 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:27:05.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:05.760+0000 7fa363e7e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2024-09-18T12:27:05.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:05.760+0000 7fa363e7e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2024-09-18T12:27:05.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:05.760+0000 7fa363e7e540 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-09-18T12:27:05.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:05.760+0000 7fa363e7e540 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-09-18T12:27:05.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:05.760+0000 7fa363e7e540 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-09-18T12:27:05.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:05.764+0000 7fa363e7e540 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2024-09-18T12:27:06.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:06.324+0000 7fa363e7e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:27:07.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-18T12:27:07.108+0000 7fa363e7e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T12:27:07.959 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2024-09-18T12:27:07.976 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-18T12:27:07.977 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:07.977 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-18T12:27:07.986 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:07.986 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-18T12:27:08.044 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:08.045 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-18T12:27:08.054 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:08.054 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-18T12:27:08.070 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:08.071 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-18T12:27:08.084 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:08.084 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-18T12:27:08.097 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:08.097 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-18T12:27:08.158 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:08.158 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-18T12:27:08.168 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:08.168 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-18T12:27:08.228 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:08.228 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2024-09-18T12:27:08.238 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:08.238 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2024-09-18T12:27:08.253 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:08.253 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-18T12:27:08.303 INFO:tasks.ceph:Adding keys to all mons... 2024-09-18T12:27:08.303 DEBUG:teuthology.orchestra.run.smithi042:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-18T12:27:08.314 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.x] 2024-09-18T12:27:08.314 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAEx+pmRFNpIBAAPxtyaZNEJAgveQmqgn95Ow== 2024-09-18T12:27:08.315 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.0] 2024-09-18T12:27:08.315 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAFx+pmdcAJFxAAvNG3ZkpO1EruGQWP+SbUsQ== 2024-09-18T12:27:08.315 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.1] 2024-09-18T12:27:08.315 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAHx+pmsWreJBAAKN2z+mmppHK3jSa6i1U+9w== 2024-09-18T12:27:08.315 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.2] 2024-09-18T12:27:08.315 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAJx+pmP4tMMxAA1FNEpWVBSaRXiewN3KQFpQ== 2024-09-18T12:27:08.315 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.3] 2024-09-18T12:27:08.315 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAMx+pmhKjZBxAAtdbS3VMybb6YP+izXenFGA== 2024-09-18T12:27:08.315 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.4] 2024-09-18T12:27:08.315 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAOx+pm9m+iGRAASreFnt7SBXVJ0PNsizuFWw== 2024-09-18T12:27:08.315 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.5] 2024-09-18T12:27:08.315 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAQx+pmeJ+eJxAA5li+WgZ34uQQXJqnyqO7iw== 2024-09-18T12:27:08.315 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.6] 2024-09-18T12:27:08.316 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQASx+pm//swOBAAbO8/Qte+9aQXcbzaL98c9g== 2024-09-18T12:27:08.316 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.7] 2024-09-18T12:27:08.316 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAVx+pm2znSChAADxy9dDg7gb/np5BmPuVUTg== 2024-09-18T12:27:08.316 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.8] 2024-09-18T12:27:08.316 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAXx+pmuxmbGxAAfMQssrkgVK16FPFIqCHJNA== 2024-09-18T12:27:08.316 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.9] 2024-09-18T12:27:08.316 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAZx+pm5XLBLRAADX3BeuD81EU0VGPjLpDxFw== 2024-09-18T12:27:08.316 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-18T12:27:08.316 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAEx+pmFjqlIhAAjhDdHFxCKH8dz1bcnHK/jQ== 2024-09-18T12:27:08.317 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T12:27:08.356 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:27:08.451 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:27:08.498 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:27:08.537 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:27:08.576 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:27:08.667 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:27:08.713 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:27:08.759 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:27:08.848 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:27:08.889 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T12:27:08.931 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T12:27:09.020 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-18T12:27:09.020 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-18T12:27:09.034 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T12:27:09.084 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-18T12:27:09.095 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-18T12:27:09.142 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-18T12:27:09.143 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-18T12:27:09.143 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-18T12:27:09.145 INFO:tasks.ceph.mon.a:Started 2024-09-18T12:27:09.145 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph config set mgr mgr_pool false --force 2024-09-18T12:27:09.377 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-18T12:27:09.381 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-18T12:27:09.382 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-18T12:27:09.384 INFO:tasks.ceph.mgr.x:Started 2024-09-18T12:27:09.384 INFO:tasks.ceph:Setting crush tunables to default 2024-09-18T12:27:09.384 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd crush tunables default 2024-09-18T12:27:09.580 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2024-09-18T12:27:09.591 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-18T12:27:09.591 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:09.592 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-18T12:27:09.607 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:09.608 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-18T12:27:09.617 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:09.617 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-18T12:27:09.631 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:09.631 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-18T12:27:09.640 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:09.640 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-18T12:27:09.649 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:09.649 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-18T12:27:09.677 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:09.672+0000 7fc085c49000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-18T12:27:09.690 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:09.690 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-18T12:27:09.745 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:09.746 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-18T12:27:09.759 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:09.759 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2024-09-18T12:27:09.773 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:27:09.773 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2024-09-18T12:27:09.781 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new ab74a47a-04f7-456a-bd16-4ed3646ff3c8 0 2024-09-18T12:27:09.977 INFO:teuthology.orchestra.run.smithi042.stdout:0 2024-09-18T12:27:09.994 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 31744fc6-ab42-428f-9714-29a1c916f55e 1 2024-09-18T12:27:10.214 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-18T12:27:10.227 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 1005aa3b-486d-454f-9902-e4e1d139cc05 2 2024-09-18T12:27:10.401 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:10.392+0000 7fc085c49000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-18T12:27:10.426 INFO:teuthology.orchestra.run.smithi042.stdout:2 2024-09-18T12:27:10.439 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 5559f79d-83fa-42b3-99d8-f117f4205741 3 2024-09-18T12:27:10.459 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:10.452+0000 7fc085c49000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-18T12:27:10.581 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:10.576+0000 7fc085c49000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-18T12:27:10.632 INFO:teuthology.orchestra.run.smithi042.stdout:3 2024-09-18T12:27:10.645 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 699f276b-ca34-41dd-a9d7-128443cb4818 4 2024-09-18T12:27:10.833 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:10.828+0000 7fc085c49000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-18T12:27:10.837 INFO:teuthology.orchestra.run.smithi042.stdout:4 2024-09-18T12:27:10.849 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 24430a9f-4b9f-4a25-8947-070fda401422 5 2024-09-18T12:27:10.888 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:10.880+0000 7fc085c49000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-18T12:27:11.051 INFO:teuthology.orchestra.run.smithi042.stdout:5 2024-09-18T12:27:11.063 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 5fb76140-ee57-491b-a2b1-510a6542f55a 6 2024-09-18T12:27:11.109 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:11.104+0000 7fc085c49000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-18T12:27:11.176 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:11.168+0000 7fc085c49000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-18T12:27:11.243 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:11.236+0000 7fc085c49000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-18T12:27:11.252 INFO:teuthology.orchestra.run.smithi042.stdout:6 2024-09-18T12:27:11.268 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 5f254cd1-26b1-4233-868a-eb987cd7ceb3 7 2024-09-18T12:27:11.461 INFO:teuthology.orchestra.run.smithi042.stdout:7 2024-09-18T12:27:11.473 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 8e21d721-414c-43bc-b09e-a5bf160bb35e 8 2024-09-18T12:27:11.652 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:11.644+0000 7fc085c49000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-18T12:27:11.672 INFO:teuthology.orchestra.run.smithi042.stdout:8 2024-09-18T12:27:11.683 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new bfa8f2a7-4738-4089-88bc-914091e7e1ad 9 2024-09-18T12:27:11.771 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:11.764+0000 7fc085c49000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-18T12:27:11.886 INFO:teuthology.orchestra.run.smithi042.stdout:9 2024-09-18T12:27:11.899 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-18T12:27:11.899 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-18T12:27:11.901 INFO:tasks.ceph.osd.0:Started 2024-09-18T12:27:11.901 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-18T12:27:11.901 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-18T12:27:11.903 INFO:tasks.ceph.osd.1:Started 2024-09-18T12:27:11.903 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-18T12:27:11.903 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-18T12:27:11.905 INFO:tasks.ceph.osd.2:Started 2024-09-18T12:27:11.905 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-18T12:27:11.905 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-18T12:27:11.907 INFO:tasks.ceph.osd.3:Started 2024-09-18T12:27:11.907 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-18T12:27:11.907 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-18T12:27:11.909 INFO:tasks.ceph.osd.4:Started 2024-09-18T12:27:11.909 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-18T12:27:11.909 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-18T12:27:11.911 INFO:tasks.ceph.osd.5:Started 2024-09-18T12:27:11.911 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-18T12:27:11.911 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-18T12:27:11.913 INFO:tasks.ceph.osd.6:Started 2024-09-18T12:27:11.913 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-18T12:27:11.914 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-18T12:27:11.915 INFO:tasks.ceph.osd.7:Started 2024-09-18T12:27:11.916 INFO:tasks.ceph.osd.8:Restarting daemon 2024-09-18T12:27:11.916 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2024-09-18T12:27:11.917 INFO:tasks.ceph.osd.8:Started 2024-09-18T12:27:11.918 INFO:tasks.ceph.osd.9:Restarting daemon 2024-09-18T12:27:11.918 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2024-09-18T12:27:11.919 INFO:tasks.ceph.osd.9:Started 2024-09-18T12:27:11.920 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T12:27:12.149 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:12.144+0000 7fc085c49000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-18T12:27:12.170 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:27:12.170 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":12,"fsid":"d50b3a4e-0c54-4de8-95b7-7e9a6d6a5fb8","created":"2024-09-18T12:27:09.261426+0000","modified":"2024-09-18T12:27:11.882420+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T12:27:11.882420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ab74a47a-04f7-456a-bd16-4ed3646ff3c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"31744fc6-ab42-428f-9714-29a1c916f55e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1005aa3b-486d-454f-9902-e4e1d139cc05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5559f79d-83fa-42b3-99d8-f117f4205741","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"699f276b-ca34-41dd-a9d7-128443cb4818","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"24430a9f-4b9f-4a25-8947-070fda401422","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5fb76140-ee57-491b-a2b1-510a6542f55a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5f254cd1-26b1-4233-868a-eb987cd7ceb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8e21d721-414c-43bc-b09e-a5bf160bb35e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"bfa8f2a7-4738-4089-88bc-914091e7e1ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:27:12.181 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-18T12:27:12.181 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-18T12:27:12.303 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-18T12:27:12.296+0000 7f048cc6d540 -1 Falling back to public interface 2024-09-18T12:27:12.310 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-09-18T12:27:12.304+0000 7f6ee9302540 -1 Falling back to public interface 2024-09-18T12:27:12.311 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-09-18T12:27:12.304+0000 7f21aaf51540 -1 Falling back to public interface 2024-09-18T12:27:12.321 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:12.316+0000 7fc085c49000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-18T12:27:12.322 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-18T12:27:12.316+0000 7fa87a68d540 -1 Falling back to public interface 2024-09-18T12:27:12.326 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-18T12:27:12.320+0000 7f28a7e56540 -1 Falling back to public interface 2024-09-18T12:27:12.326 INFO:tasks.ceph.osd.7.smithi042.stderr:2024-09-18T12:27:12.320+0000 7f9df8007540 -1 Falling back to public interface 2024-09-18T12:27:12.333 INFO:tasks.ceph.osd.6.smithi042.stderr:2024-09-18T12:27:12.328+0000 7f58da0fb540 -1 Falling back to public interface 2024-09-18T12:27:12.334 INFO:tasks.ceph.osd.8.smithi042.stderr:2024-09-18T12:27:12.328+0000 7f07ed073540 -1 Falling back to public interface 2024-09-18T12:27:12.349 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-18T12:27:12.344+0000 7f78221f9540 -1 Falling back to public interface 2024-09-18T12:27:12.396 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:12.388+0000 7fc085c49000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-18T12:27:12.447 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:12.440+0000 7fc085c49000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-18T12:27:12.506 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:12.500+0000 7fc085c49000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-18T12:27:12.598 INFO:tasks.ceph.osd.9.smithi042.stderr:2024-09-18T12:27:12.592+0000 7fdea34e8540 -1 Falling back to public interface 2024-09-18T12:27:12.681 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:12.676+0000 7fc085c49000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-18T12:27:12.848 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:12.840+0000 7fc085c49000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-18T12:27:12.917 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:12.912+0000 7fc085c49000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-18T12:27:13.084 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:13.076+0000 7fc085c49000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-18T12:27:13.157 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:13.152+0000 7fc085c49000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-18T12:27:13.186 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T12:27:13.356 INFO:teuthology.misc.health.smithi042.stdout: 2024-09-18T12:27:13.357 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":12,"fsid":"d50b3a4e-0c54-4de8-95b7-7e9a6d6a5fb8","created":"2024-09-18T12:27:09.261426+0000","modified":"2024-09-18T12:27:11.882420+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T12:27:11.882420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ab74a47a-04f7-456a-bd16-4ed3646ff3c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"31744fc6-ab42-428f-9714-29a1c916f55e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1005aa3b-486d-454f-9902-e4e1d139cc05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5559f79d-83fa-42b3-99d8-f117f4205741","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"699f276b-ca34-41dd-a9d7-128443cb4818","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"24430a9f-4b9f-4a25-8947-070fda401422","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5fb76140-ee57-491b-a2b1-510a6542f55a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5f254cd1-26b1-4233-868a-eb987cd7ceb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"8e21d721-414c-43bc-b09e-a5bf160bb35e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"bfa8f2a7-4738-4089-88bc-914091e7e1ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:27:13.366 DEBUG:teuthology.misc:0 of 10 OSDs are up 2024-09-18T12:27:13.902 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:13.896+0000 7fc085c49000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-18T12:27:14.893 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-18T12:27:14.888+0000 7f28a7e56540 -1 osd.0 0 log_to_monitors true 2024-09-18T12:27:14.895 INFO:tasks.ceph.osd.7.smithi042.stderr:2024-09-18T12:27:14.888+0000 7f9df8007540 -1 osd.7 0 log_to_monitors true 2024-09-18T12:27:14.910 INFO:tasks.ceph.osd.8.smithi042.stderr:2024-09-18T12:27:14.904+0000 7f07ed073540 -1 osd.8 0 log_to_monitors true 2024-09-18T12:27:14.934 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-09-18T12:27:14.928+0000 7fc06ecb9700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-18T12:27:15.106 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-09-18T12:27:15.096+0000 7f21aaf51540 -1 osd.5 0 log_to_monitors true 2024-09-18T12:27:15.168 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-09-18T12:27:15.160+0000 7f6ee9302540 -1 osd.4 0 log_to_monitors true 2024-09-18T12:27:15.179 INFO:tasks.ceph.osd.6.smithi042.stderr:2024-09-18T12:27:15.172+0000 7f58da0fb540 -1 osd.6 0 log_to_monitors true 2024-09-18T12:27:15.203 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-18T12:27:15.176+0000 7f78221f9540 -1 osd.2 0 log_to_monitors true 2024-09-18T12:27:15.209 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-18T12:27:15.188+0000 7fa87a68d540 -1 osd.3 0 log_to_monitors true 2024-09-18T12:27:15.354 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-18T12:27:15.344+0000 7f048cc6d540 -1 osd.1 0 log_to_monitors true 2024-09-18T12:27:15.588 INFO:tasks.ceph.osd.9.smithi042.stderr:2024-09-18T12:27:15.580+0000 7fdea34e8540 -1 osd.9 0 log_to_monitors true 2024-09-18T12:27:16.437 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-09-18T12:27:16.432+0000 7f6ee62c7700 -1 osd.4 0 waiting for initial osdmap 2024-09-18T12:27:16.437 INFO:tasks.ceph.osd.8.smithi042.stderr:2024-09-18T12:27:16.432+0000 7f07e8813700 -1 osd.8 0 waiting for initial osdmap 2024-09-18T12:27:16.440 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-18T12:27:16.432+0000 7fa877652700 -1 osd.3 0 waiting for initial osdmap 2024-09-18T12:27:16.441 INFO:tasks.ceph.osd.6.smithi042.stderr:2024-09-18T12:27:16.432+0000 7f58d589b700 -1 osd.6 0 waiting for initial osdmap 2024-09-18T12:27:16.441 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-18T12:27:16.436+0000 7f0489c32700 -1 osd.1 0 waiting for initial osdmap 2024-09-18T12:27:16.442 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-18T12:27:16.436+0000 7f28a35f6700 -1 osd.0 0 waiting for initial osdmap 2024-09-18T12:27:16.443 INFO:tasks.ceph.osd.7.smithi042.stderr:2024-09-18T12:27:16.436+0000 7f9df37a7700 -1 osd.7 0 waiting for initial osdmap 2024-09-18T12:27:16.444 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-09-18T12:27:16.436+0000 7f21a66f1700 -1 osd.5 0 waiting for initial osdmap 2024-09-18T12:27:16.444 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-18T12:27:16.436+0000 7fa86ebd0700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:27:16.446 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-18T12:27:16.440+0000 7f781d999700 -1 osd.2 0 waiting for initial osdmap 2024-09-18T12:27:16.446 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-09-18T12:27:16.440+0000 7f6edd845700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:27:16.446 INFO:tasks.ceph.osd.8.smithi042.stderr:2024-09-18T12:27:16.440+0000 7f07e15b6700 -1 osd.8 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:27:16.447 INFO:tasks.ceph.osd.6.smithi042.stderr:2024-09-18T12:27:16.440+0000 7f58ce63e700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:27:16.449 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-18T12:27:16.444+0000 7f04811b0700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:27:16.449 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-18T12:27:16.444+0000 7f289c399700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:27:16.450 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-18T12:27:16.444+0000 7f781673c700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:27:16.451 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-09-18T12:27:16.444+0000 7f219f494700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:27:16.452 INFO:tasks.ceph.osd.7.smithi042.stderr:2024-09-18T12:27:16.444+0000 7f9dec54a700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:27:17.442 INFO:tasks.ceph.osd.9.smithi042.stderr:2024-09-18T12:27:17.436+0000 7fde9ec88700 -1 osd.9 0 waiting for initial osdmap 2024-09-18T12:27:17.450 INFO:tasks.ceph.osd.9.smithi042.stderr:2024-09-18T12:27:17.440+0000 7fde97a2b700 -1 osd.9 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:27:20.373 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T12:27:20.670 INFO:teuthology.misc.health.smithi042.stdout: 2024-09-18T12:27:20.670 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":17,"fsid":"d50b3a4e-0c54-4de8-95b7-7e9a6d6a5fb8","created":"2024-09-18T12:27:09.261426+0000","modified":"2024-09-18T12:27:19.475303+0000","last_up_change":"2024-09-18T12:27:18.434967+0000","last_in_change":"2024-09-18T12:27:11.882420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ab74a47a-04f7-456a-bd16-4ed3646ff3c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6831","nonce":25560},{"type":"v1","addr":"172.21.15.42:6834","nonce":25560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":25560},{"type":"v1","addr":"172.21.15.42:6838","nonce":25560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6845","nonce":25560},{"type":"v1","addr":"172.21.15.42:6847","nonce":25560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6841","nonce":25560},{"type":"v1","addr":"172.21.15.42:6843","nonce":25560}]},"public_addr":"172.21.15.42:6834/25560","cluster_addr":"172.21.15.42:6838/25560","heartbeat_back_addr":"172.21.15.42:6847/25560","heartbeat_front_addr":"172.21.15.42:6843/25560","state":["exists","up"]},{"osd":1,"uuid":"31744fc6-ab42-428f-9714-29a1c916f55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":25553},{"type":"v1","addr":"172.21.15.42:6801","nonce":25553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":25553},{"type":"v1","addr":"172.21.15.42:6803","nonce":25553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":25553},{"type":"v1","addr":"172.21.15.42:6807","nonce":25553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":25553},{"type":"v1","addr":"172.21.15.42:6805","nonce":25553}]},"public_addr":"172.21.15.42:6801/25553","cluster_addr":"172.21.15.42:6803/25553","heartbeat_back_addr":"172.21.15.42:6807/25553","heartbeat_front_addr":"172.21.15.42:6805/25553","state":["exists","up"]},{"osd":2,"uuid":"1005aa3b-486d-454f-9902-e4e1d139cc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6864","nonce":25575},{"type":"v1","addr":"172.21.15.42:6865","nonce":25575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6866","nonce":25575},{"type":"v1","addr":"172.21.15.42:6867","nonce":25575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6870","nonce":25575},{"type":"v1","addr":"172.21.15.42:6871","nonce":25575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6868","nonce":25575},{"type":"v1","addr":"172.21.15.42:6869","nonce":25575}]},"public_addr":"172.21.15.42:6865/25575","cluster_addr":"172.21.15.42:6867/25575","heartbeat_back_addr":"172.21.15.42:6871/25575","heartbeat_front_addr":"172.21.15.42:6869/25575","state":["exists","up"]},{"osd":3,"uuid":"5559f79d-83fa-42b3-99d8-f117f4205741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":25557},{"type":"v1","addr":"172.21.15.42:6825","nonce":25557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":25557},{"type":"v1","addr":"172.21.15.42:6827","nonce":25557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":25557},{"type":"v1","addr":"172.21.15.42:6832","nonce":25557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":25557},{"type":"v1","addr":"172.21.15.42:6829","nonce":25557}]},"public_addr":"172.21.15.42:6825/25557","cluster_addr":"172.21.15.42:6827/25557","heartbeat_back_addr":"172.21.15.42:6832/25557","heartbeat_front_addr":"172.21.15.42:6829/25557","state":["exists","up"]},{"osd":4,"uuid":"699f276b-ca34-41dd-a9d7-128443cb4818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":25554},{"type":"v1","addr":"172.21.15.42:6810","nonce":25554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":25554},{"type":"v1","addr":"172.21.15.42:6814","nonce":25554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":25554},{"type":"v1","addr":"172.21.15.42:6822","nonce":25554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":25554},{"type":"v1","addr":"172.21.15.42:6818","nonce":25554}]},"public_addr":"172.21.15.42:6810/25554","cluster_addr":"172.21.15.42:6814/25554","heartbeat_back_addr":"172.21.15.42:6822/25554","heartbeat_front_addr":"172.21.15.42:6818/25554","state":["exists","up"]},{"osd":5,"uuid":"24430a9f-4b9f-4a25-8947-070fda401422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":25555},{"type":"v1","addr":"172.21.15.42:6811","nonce":25555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":25555},{"type":"v1","addr":"172.21.15.42:6815","nonce":25555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":25555},{"type":"v1","addr":"172.21.15.42:6823","nonce":25555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":25555},{"type":"v1","addr":"172.21.15.42:6819","nonce":25555}]},"public_addr":"172.21.15.42:6811/25555","cluster_addr":"172.21.15.42:6815/25555","heartbeat_back_addr":"172.21.15.42:6823/25555","heartbeat_front_addr":"172.21.15.42:6819/25555","state":["exists","up"]},{"osd":6,"uuid":"5fb76140-ee57-491b-a2b1-510a6542f55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6848","nonce":25559},{"type":"v1","addr":"172.21.15.42:6850","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6852","nonce":25559},{"type":"v1","addr":"172.21.15.42:6854","nonce":25559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6859","nonce":25559},{"type":"v1","addr":"172.21.15.42:6861","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6855","nonce":25559},{"type":"v1","addr":"172.21.15.42:6857","nonce":25559}]},"public_addr":"172.21.15.42:6850/25559","cluster_addr":"172.21.15.42:6854/25559","heartbeat_back_addr":"172.21.15.42:6861/25559","heartbeat_front_addr":"172.21.15.42:6857/25559","state":["exists","up"]},{"osd":7,"uuid":"5f254cd1-26b1-4233-868a-eb987cd7ceb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":25566},{"type":"v1","addr":"172.21.15.42:6835","nonce":25566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6837","nonce":25566},{"type":"v1","addr":"172.21.15.42:6839","nonce":25566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6844","nonce":25566},{"type":"v1","addr":"172.21.15.42:6846","nonce":25566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":25566},{"type":"v1","addr":"172.21.15.42:6842","nonce":25566}]},"public_addr":"172.21.15.42:6835/25566","cluster_addr":"172.21.15.42:6839/25566","heartbeat_back_addr":"172.21.15.42:6846/25566","heartbeat_front_addr":"172.21.15.42:6842/25566","state":["exists","up"]},{"osd":8,"uuid":"8e21d721-414c-43bc-b09e-a5bf160bb35e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6849","nonce":25578},{"type":"v1","addr":"172.21.15.42:6851","nonce":25578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6853","nonce":25578},{"type":"v1","addr":"172.21.15.42:6856","nonce":25578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6862","nonce":25578},{"type":"v1","addr":"172.21.15.42:6863","nonce":25578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6858","nonce":25578},{"type":"v1","addr":"172.21.15.42:6860","nonce":25578}]},"public_addr":"172.21.15.42:6851/25578","cluster_addr":"172.21.15.42:6856/25578","heartbeat_back_addr":"172.21.15.42:6863/25578","heartbeat_front_addr":"172.21.15.42:6860/25578","state":["exists","up"]},{"osd":9,"uuid":"bfa8f2a7-4738-4089-88bc-914091e7e1ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6872","nonce":25601},{"type":"v1","addr":"172.21.15.42:6873","nonce":25601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6874","nonce":25601},{"type":"v1","addr":"172.21.15.42:6875","nonce":25601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6878","nonce":25601},{"type":"v1","addr":"172.21.15.42:6879","nonce":25601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6876","nonce":25601},{"type":"v1","addr":"172.21.15.42:6877","nonce":25601}]},"public_addr":"172.21.15.42:6873/25601","cluster_addr":"172.21.15.42:6875/25601","heartbeat_back_addr":"172.21.15.42:6879/25601","heartbeat_front_addr":"172.21.15.42:6877/25601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.867945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.353200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.192345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.241275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.162388+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.118272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.182504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.932363+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.922300+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.546891+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:27:20.683 DEBUG:teuthology.misc:10 of 10 OSDs are up 2024-09-18T12:27:20.683 INFO:tasks.ceph:Creating RBD pool 2024-09-18T12:27:20.683 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-18T12:27:21.500 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'rbd' created 2024-09-18T12:27:21.514 DEBUG:teuthology.orchestra.run.smithi042:> rbd --cluster ceph pool init rbd 2024-09-18T12:27:24.520 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-18T12:27:24.521 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-18T12:27:24.521 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-18T12:27:24.521 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-18T12:27:24.522 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-18T12:27:24.865 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:27:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":4,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6880","nonce":25186},{"type":"v1","addr":"172.21.15.42:6881","nonce":25186}]},"active_addr":"172.21.15.42:6881/25186","active_change":"2024-09-18T12:27:13.922331+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":406766917}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":2473808456}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":2994920403}]}]} 2024-09-18T12:27:24.881 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-18T12:27:24.881 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-18T12:27:24.881 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T12:27:25.179 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:27:25.179 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"d50b3a4e-0c54-4de8-95b7-7e9a6d6a5fb8","created":"2024-09-18T12:27:09.261426+0000","modified":"2024-09-18T12:27:24.499702+0000","last_up_change":"2024-09-18T12:27:18.434967+0000","last_in_change":"2024-09-18T12:27:11.882420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-18T12:27:21.010721+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab74a47a-04f7-456a-bd16-4ed3646ff3c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6831","nonce":25560},{"type":"v1","addr":"172.21.15.42:6834","nonce":25560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":25560},{"type":"v1","addr":"172.21.15.42:6838","nonce":25560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6845","nonce":25560},{"type":"v1","addr":"172.21.15.42:6847","nonce":25560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6841","nonce":25560},{"type":"v1","addr":"172.21.15.42:6843","nonce":25560}]},"public_addr":"172.21.15.42:6834/25560","cluster_addr":"172.21.15.42:6838/25560","heartbeat_back_addr":"172.21.15.42:6847/25560","heartbeat_front_addr":"172.21.15.42:6843/25560","state":["exists","up"]},{"osd":1,"uuid":"31744fc6-ab42-428f-9714-29a1c916f55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":25553},{"type":"v1","addr":"172.21.15.42:6801","nonce":25553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":25553},{"type":"v1","addr":"172.21.15.42:6803","nonce":25553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":25553},{"type":"v1","addr":"172.21.15.42:6807","nonce":25553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":25553},{"type":"v1","addr":"172.21.15.42:6805","nonce":25553}]},"public_addr":"172.21.15.42:6801/25553","cluster_addr":"172.21.15.42:6803/25553","heartbeat_back_addr":"172.21.15.42:6807/25553","heartbeat_front_addr":"172.21.15.42:6805/25553","state":["exists","up"]},{"osd":2,"uuid":"1005aa3b-486d-454f-9902-e4e1d139cc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6864","nonce":25575},{"type":"v1","addr":"172.21.15.42:6865","nonce":25575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6866","nonce":25575},{"type":"v1","addr":"172.21.15.42:6867","nonce":25575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6870","nonce":25575},{"type":"v1","addr":"172.21.15.42:6871","nonce":25575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6868","nonce":25575},{"type":"v1","addr":"172.21.15.42:6869","nonce":25575}]},"public_addr":"172.21.15.42:6865/25575","cluster_addr":"172.21.15.42:6867/25575","heartbeat_back_addr":"172.21.15.42:6871/25575","heartbeat_front_addr":"172.21.15.42:6869/25575","state":["exists","up"]},{"osd":3,"uuid":"5559f79d-83fa-42b3-99d8-f117f4205741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":25557},{"type":"v1","addr":"172.21.15.42:6825","nonce":25557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":25557},{"type":"v1","addr":"172.21.15.42:6827","nonce":25557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":25557},{"type":"v1","addr":"172.21.15.42:6832","nonce":25557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":25557},{"type":"v1","addr":"172.21.15.42:6829","nonce":25557}]},"public_addr":"172.21.15.42:6825/25557","cluster_addr":"172.21.15.42:6827/25557","heartbeat_back_addr":"172.21.15.42:6832/25557","heartbeat_front_addr":"172.21.15.42:6829/25557","state":["exists","up"]},{"osd":4,"uuid":"699f276b-ca34-41dd-a9d7-128443cb4818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":25554},{"type":"v1","addr":"172.21.15.42:6810","nonce":25554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":25554},{"type":"v1","addr":"172.21.15.42:6814","nonce":25554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":25554},{"type":"v1","addr":"172.21.15.42:6822","nonce":25554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":25554},{"type":"v1","addr":"172.21.15.42:6818","nonce":25554}]},"public_addr":"172.21.15.42:6810/25554","cluster_addr":"172.21.15.42:6814/25554","heartbeat_back_addr":"172.21.15.42:6822/25554","heartbeat_front_addr":"172.21.15.42:6818/25554","state":["exists","up"]},{"osd":5,"uuid":"24430a9f-4b9f-4a25-8947-070fda401422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":25555},{"type":"v1","addr":"172.21.15.42:6811","nonce":25555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":25555},{"type":"v1","addr":"172.21.15.42:6815","nonce":25555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":25555},{"type":"v1","addr":"172.21.15.42:6823","nonce":25555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":25555},{"type":"v1","addr":"172.21.15.42:6819","nonce":25555}]},"public_addr":"172.21.15.42:6811/25555","cluster_addr":"172.21.15.42:6815/25555","heartbeat_back_addr":"172.21.15.42:6823/25555","heartbeat_front_addr":"172.21.15.42:6819/25555","state":["exists","up"]},{"osd":6,"uuid":"5fb76140-ee57-491b-a2b1-510a6542f55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6848","nonce":25559},{"type":"v1","addr":"172.21.15.42:6850","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6852","nonce":25559},{"type":"v1","addr":"172.21.15.42:6854","nonce":25559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6859","nonce":25559},{"type":"v1","addr":"172.21.15.42:6861","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6855","nonce":25559},{"type":"v1","addr":"172.21.15.42:6857","nonce":25559}]},"public_addr":"172.21.15.42:6850/25559","cluster_addr":"172.21.15.42:6854/25559","heartbeat_back_addr":"172.21.15.42:6861/25559","heartbeat_front_addr":"172.21.15.42:6857/25559","state":["exists","up"]},{"osd":7,"uuid":"5f254cd1-26b1-4233-868a-eb987cd7ceb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":25566},{"type":"v1","addr":"172.21.15.42:6835","nonce":25566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6837","nonce":25566},{"type":"v1","addr":"172.21.15.42:6839","nonce":25566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6844","nonce":25566},{"type":"v1","addr":"172.21.15.42:6846","nonce":25566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":25566},{"type":"v1","addr":"172.21.15.42:6842","nonce":25566}]},"public_addr":"172.21.15.42:6835/25566","cluster_addr":"172.21.15.42:6839/25566","heartbeat_back_addr":"172.21.15.42:6846/25566","heartbeat_front_addr":"172.21.15.42:6842/25566","state":["exists","up"]},{"osd":8,"uuid":"8e21d721-414c-43bc-b09e-a5bf160bb35e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6849","nonce":25578},{"type":"v1","addr":"172.21.15.42:6851","nonce":25578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6853","nonce":25578},{"type":"v1","addr":"172.21.15.42:6856","nonce":25578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6862","nonce":25578},{"type":"v1","addr":"172.21.15.42:6863","nonce":25578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6858","nonce":25578},{"type":"v1","addr":"172.21.15.42:6860","nonce":25578}]},"public_addr":"172.21.15.42:6851/25578","cluster_addr":"172.21.15.42:6856/25578","heartbeat_back_addr":"172.21.15.42:6863/25578","heartbeat_front_addr":"172.21.15.42:6860/25578","state":["exists","up"]},{"osd":9,"uuid":"bfa8f2a7-4738-4089-88bc-914091e7e1ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6872","nonce":25601},{"type":"v1","addr":"172.21.15.42:6873","nonce":25601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6874","nonce":25601},{"type":"v1","addr":"172.21.15.42:6875","nonce":25601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6878","nonce":25601},{"type":"v1","addr":"172.21.15.42:6879","nonce":25601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6876","nonce":25601},{"type":"v1","addr":"172.21.15.42:6877","nonce":25601}]},"public_addr":"172.21.15.42:6873/25601","cluster_addr":"172.21.15.42:6875/25601","heartbeat_back_addr":"172.21.15.42:6879/25601","heartbeat_front_addr":"172.21.15.42:6877/25601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.867945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.353200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.192345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.241275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.162388+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.118272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.182504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.932363+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.922300+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.546891+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:27:25.193 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-18T12:27:25.193 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T12:27:25.489 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:27:25.489 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"d50b3a4e-0c54-4de8-95b7-7e9a6d6a5fb8","created":"2024-09-18T12:27:09.261426+0000","modified":"2024-09-18T12:27:24.499702+0000","last_up_change":"2024-09-18T12:27:18.434967+0000","last_in_change":"2024-09-18T12:27:11.882420+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-18T12:27:21.010721+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab74a47a-04f7-456a-bd16-4ed3646ff3c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6831","nonce":25560},{"type":"v1","addr":"172.21.15.42:6834","nonce":25560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":25560},{"type":"v1","addr":"172.21.15.42:6838","nonce":25560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6845","nonce":25560},{"type":"v1","addr":"172.21.15.42:6847","nonce":25560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6841","nonce":25560},{"type":"v1","addr":"172.21.15.42:6843","nonce":25560}]},"public_addr":"172.21.15.42:6834/25560","cluster_addr":"172.21.15.42:6838/25560","heartbeat_back_addr":"172.21.15.42:6847/25560","heartbeat_front_addr":"172.21.15.42:6843/25560","state":["exists","up"]},{"osd":1,"uuid":"31744fc6-ab42-428f-9714-29a1c916f55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":25553},{"type":"v1","addr":"172.21.15.42:6801","nonce":25553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":25553},{"type":"v1","addr":"172.21.15.42:6803","nonce":25553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":25553},{"type":"v1","addr":"172.21.15.42:6807","nonce":25553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":25553},{"type":"v1","addr":"172.21.15.42:6805","nonce":25553}]},"public_addr":"172.21.15.42:6801/25553","cluster_addr":"172.21.15.42:6803/25553","heartbeat_back_addr":"172.21.15.42:6807/25553","heartbeat_front_addr":"172.21.15.42:6805/25553","state":["exists","up"]},{"osd":2,"uuid":"1005aa3b-486d-454f-9902-e4e1d139cc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6864","nonce":25575},{"type":"v1","addr":"172.21.15.42:6865","nonce":25575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6866","nonce":25575},{"type":"v1","addr":"172.21.15.42:6867","nonce":25575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6870","nonce":25575},{"type":"v1","addr":"172.21.15.42:6871","nonce":25575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6868","nonce":25575},{"type":"v1","addr":"172.21.15.42:6869","nonce":25575}]},"public_addr":"172.21.15.42:6865/25575","cluster_addr":"172.21.15.42:6867/25575","heartbeat_back_addr":"172.21.15.42:6871/25575","heartbeat_front_addr":"172.21.15.42:6869/25575","state":["exists","up"]},{"osd":3,"uuid":"5559f79d-83fa-42b3-99d8-f117f4205741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":25557},{"type":"v1","addr":"172.21.15.42:6825","nonce":25557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":25557},{"type":"v1","addr":"172.21.15.42:6827","nonce":25557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":25557},{"type":"v1","addr":"172.21.15.42:6832","nonce":25557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":25557},{"type":"v1","addr":"172.21.15.42:6829","nonce":25557}]},"public_addr":"172.21.15.42:6825/25557","cluster_addr":"172.21.15.42:6827/25557","heartbeat_back_addr":"172.21.15.42:6832/25557","heartbeat_front_addr":"172.21.15.42:6829/25557","state":["exists","up"]},{"osd":4,"uuid":"699f276b-ca34-41dd-a9d7-128443cb4818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":25554},{"type":"v1","addr":"172.21.15.42:6810","nonce":25554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":25554},{"type":"v1","addr":"172.21.15.42:6814","nonce":25554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":25554},{"type":"v1","addr":"172.21.15.42:6822","nonce":25554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":25554},{"type":"v1","addr":"172.21.15.42:6818","nonce":25554}]},"public_addr":"172.21.15.42:6810/25554","cluster_addr":"172.21.15.42:6814/25554","heartbeat_back_addr":"172.21.15.42:6822/25554","heartbeat_front_addr":"172.21.15.42:6818/25554","state":["exists","up"]},{"osd":5,"uuid":"24430a9f-4b9f-4a25-8947-070fda401422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":25555},{"type":"v1","addr":"172.21.15.42:6811","nonce":25555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":25555},{"type":"v1","addr":"172.21.15.42:6815","nonce":25555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":25555},{"type":"v1","addr":"172.21.15.42:6823","nonce":25555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":25555},{"type":"v1","addr":"172.21.15.42:6819","nonce":25555}]},"public_addr":"172.21.15.42:6811/25555","cluster_addr":"172.21.15.42:6815/25555","heartbeat_back_addr":"172.21.15.42:6823/25555","heartbeat_front_addr":"172.21.15.42:6819/25555","state":["exists","up"]},{"osd":6,"uuid":"5fb76140-ee57-491b-a2b1-510a6542f55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6848","nonce":25559},{"type":"v1","addr":"172.21.15.42:6850","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6852","nonce":25559},{"type":"v1","addr":"172.21.15.42:6854","nonce":25559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6859","nonce":25559},{"type":"v1","addr":"172.21.15.42:6861","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6855","nonce":25559},{"type":"v1","addr":"172.21.15.42:6857","nonce":25559}]},"public_addr":"172.21.15.42:6850/25559","cluster_addr":"172.21.15.42:6854/25559","heartbeat_back_addr":"172.21.15.42:6861/25559","heartbeat_front_addr":"172.21.15.42:6857/25559","state":["exists","up"]},{"osd":7,"uuid":"5f254cd1-26b1-4233-868a-eb987cd7ceb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":25566},{"type":"v1","addr":"172.21.15.42:6835","nonce":25566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6837","nonce":25566},{"type":"v1","addr":"172.21.15.42:6839","nonce":25566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6844","nonce":25566},{"type":"v1","addr":"172.21.15.42:6846","nonce":25566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":25566},{"type":"v1","addr":"172.21.15.42:6842","nonce":25566}]},"public_addr":"172.21.15.42:6835/25566","cluster_addr":"172.21.15.42:6839/25566","heartbeat_back_addr":"172.21.15.42:6846/25566","heartbeat_front_addr":"172.21.15.42:6842/25566","state":["exists","up"]},{"osd":8,"uuid":"8e21d721-414c-43bc-b09e-a5bf160bb35e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6849","nonce":25578},{"type":"v1","addr":"172.21.15.42:6851","nonce":25578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6853","nonce":25578},{"type":"v1","addr":"172.21.15.42:6856","nonce":25578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6862","nonce":25578},{"type":"v1","addr":"172.21.15.42:6863","nonce":25578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6858","nonce":25578},{"type":"v1","addr":"172.21.15.42:6860","nonce":25578}]},"public_addr":"172.21.15.42:6851/25578","cluster_addr":"172.21.15.42:6856/25578","heartbeat_back_addr":"172.21.15.42:6863/25578","heartbeat_front_addr":"172.21.15.42:6860/25578","state":["exists","up"]},{"osd":9,"uuid":"bfa8f2a7-4738-4089-88bc-914091e7e1ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6872","nonce":25601},{"type":"v1","addr":"172.21.15.42:6873","nonce":25601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6874","nonce":25601},{"type":"v1","addr":"172.21.15.42:6875","nonce":25601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6878","nonce":25601},{"type":"v1","addr":"172.21.15.42:6879","nonce":25601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6876","nonce":25601},{"type":"v1","addr":"172.21.15.42:6877","nonce":25601}]},"public_addr":"172.21.15.42:6873/25601","cluster_addr":"172.21.15.42:6875/25601","heartbeat_back_addr":"172.21.15.42:6879/25601","heartbeat_front_addr":"172.21.15.42:6877/25601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.867945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.353200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.192345+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.241275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.162388+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.118272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.182504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.932363+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.922300+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.546891+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:27:25.504 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-18T12:27:25.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-18T12:27:25.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-18T12:27:25.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-18T12:27:25.506 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-18T12:27:25.506 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-18T12:27:25.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-18T12:27:25.508 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-18T12:27:25.508 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-09-18T12:27:25.509 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-09-18T12:27:25.736 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:25.736 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-18T12:27:25.737 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:25.738 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T12:27:25.753 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:25.753 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T12:27:25.754 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:25.755 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T12:27:25.760 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:25.760 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-09-18T12:27:25.761 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:25.762 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-18T12:27:25.769 INFO:teuthology.orchestra.run.smithi042.stdout:68719476739 2024-09-18T12:27:25.770 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-09-18T12:27:25.775 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:25.776 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T12:27:25.786 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:25.786 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T12:27:25.804 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:25.805 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-18T12:27:26.255 INFO:teuthology.orchestra.run.smithi042.stdout:64424509442 2024-09-18T12:27:26.281 INFO:teuthology.orchestra.run.smithi042.stdout:64424509442 2024-09-18T12:27:26.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.4 2024-09-18T12:27:26.302 INFO:teuthology.orchestra.run.smithi042.stdout:64424509442 2024-09-18T12:27:26.305 INFO:teuthology.orchestra.run.smithi042.stdout:64424509442 2024-09-18T12:27:26.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.0 2024-09-18T12:27:26.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.5 2024-09-18T12:27:26.322 INFO:teuthology.orchestra.run.smithi042.stdout:68719476738 2024-09-18T12:27:26.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.1 2024-09-18T12:27:26.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476739 got 68719476738 for osd.9 2024-09-18T12:27:26.341 INFO:teuthology.orchestra.run.smithi042.stdout:64424509442 2024-09-18T12:27:26.353 INFO:teuthology.orchestra.run.smithi042.stdout:64424509442 2024-09-18T12:27:26.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.2 2024-09-18T12:27:26.358 INFO:teuthology.orchestra.run.smithi042.stdout:64424509442 2024-09-18T12:27:26.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.6 2024-09-18T12:27:26.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.8 2024-09-18T12:27:26.383 INFO:teuthology.orchestra.run.smithi042.stdout:64424509442 2024-09-18T12:27:26.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.3 2024-09-18T12:27:26.439 INFO:teuthology.orchestra.run.smithi042.stdout:64424509442 2024-09-18T12:27:26.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.7 2024-09-18T12:27:27.286 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-18T12:27:27.306 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T12:27:27.320 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T12:27:27.327 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T12:27:27.335 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-09-18T12:27:27.358 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T12:27:27.372 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-18T12:27:27.374 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-09-18T12:27:27.395 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T12:27:27.453 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-18T12:27:27.792 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:27.821 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:27.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.4 2024-09-18T12:27:27.822 DEBUG:teuthology.parallel:result is None 2024-09-18T12:27:27.829 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:27.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.5 2024-09-18T12:27:27.851 DEBUG:teuthology.parallel:result is None 2024-09-18T12:27:27.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.0 2024-09-18T12:27:27.864 DEBUG:teuthology.parallel:result is None 2024-09-18T12:27:27.871 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:27.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.1 2024-09-18T12:27:27.887 DEBUG:teuthology.parallel:result is None 2024-09-18T12:27:27.900 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:27.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.6 2024-09-18T12:27:27.912 DEBUG:teuthology.parallel:result is None 2024-09-18T12:27:27.922 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:27.926 INFO:teuthology.orchestra.run.smithi042.stdout:68719476739 2024-09-18T12:27:27.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.2 2024-09-18T12:27:27.935 DEBUG:teuthology.parallel:result is None 2024-09-18T12:27:27.938 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:27.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476739 got 68719476739 for osd.9 2024-09-18T12:27:27.942 DEBUG:teuthology.parallel:result is None 2024-09-18T12:27:27.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.3 2024-09-18T12:27:27.954 DEBUG:teuthology.parallel:result is None 2024-09-18T12:27:27.977 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:27.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.8 2024-09-18T12:27:27.989 DEBUG:teuthology.parallel:result is None 2024-09-18T12:27:28.012 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-09-18T12:27:28.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.7 2024-09-18T12:27:28.025 DEBUG:teuthology.parallel:result is None 2024-09-18T12:27:28.025 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T12:27:28.025 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:27:28.298 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:27:28.300 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-18T12:27:28.309 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-18T12:27:27.938634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":1048576000,"kb_used":2975660,"kb_used_data":2088,"kb_used_omap":16,"kb_used_meta":2973423,"kb_avail":1045600340,"statfs":{"total":1073741824000,"available":1070694748160,"internally_reserved":0,"allocated":2138112,"data_stored":713638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17040,"internal_metadata":3044785520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000392"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.507456+0000","last_change":"2024-09-18T12:27:24.507769+0000","last_active":"2024-09-18T12:27:24.507456+0000","last_peered":"2024-09-18T12:27:24.507456+0000","last_clean":"2024-09-18T12:27:24.507456+0000","last_became_active":"2024-09-18T12:27:22.935171+0000","last_became_peered":"2024-09-18T12:27:22.935171+0000","last_unstale":"2024-09-18T12:27:24.507456+0000","last_undegraded":"2024-09-18T12:27:24.507456+0000","last_fullsized":"2024-09-18T12:27:24.507456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T18:20:09.071419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050383899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.507382+0000","last_change":"2024-09-18T12:27:24.507776+0000","last_active":"2024-09-18T12:27:24.507382+0000","last_peered":"2024-09-18T12:27:24.507382+0000","last_clean":"2024-09-18T12:27:24.507382+0000","last_became_active":"2024-09-18T12:27:22.653874+0000","last_became_peered":"2024-09-18T12:27:22.653874+0000","last_unstale":"2024-09-18T12:27:24.507382+0000","last_undegraded":"2024-09-18T12:27:24.507382+0000","last_fullsized":"2024-09-18T12:27:24.507382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T19:33:35.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058294300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.697540+0000","last_change":"2024-09-18T12:27:24.697780+0000","last_active":"2024-09-18T12:27:24.697540+0000","last_peered":"2024-09-18T12:27:24.697540+0000","last_clean":"2024-09-18T12:27:24.697540+0000","last_became_active":"2024-09-18T12:27:22.504069+0000","last_became_peered":"2024-09-18T12:27:22.504069+0000","last_unstale":"2024-09-18T12:27:24.697540+0000","last_undegraded":"2024-09-18T12:27:24.697540+0000","last_fullsized":"2024-09-18T12:27:24.697540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T18:20:09.071419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059182099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.697892+0000","last_change":"2024-09-18T12:27:24.698136+0000","last_active":"2024-09-18T12:27:24.697892+0000","last_peered":"2024-09-18T12:27:24.697892+0000","last_clean":"2024-09-18T12:27:24.697892+0000","last_became_active":"2024-09-18T12:27:22.502955+0000","last_became_peered":"2024-09-18T12:27:22.502955+0000","last_unstale":"2024-09-18T12:27:24.697892+0000","last_undegraded":"2024-09-18T12:27:24.697892+0000","last_fullsized":"2024-09-18T12:27:24.697892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:50:48.123121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065089800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.697674+0000","last_change":"2024-09-18T12:27:24.698963+0000","last_active":"2024-09-18T12:27:24.697674+0000","last_peered":"2024-09-18T12:27:24.697674+0000","last_clean":"2024-09-18T12:27:24.697674+0000","last_became_active":"2024-09-18T12:27:23.325124+0000","last_became_peered":"2024-09-18T12:27:23.325124+0000","last_unstale":"2024-09-18T12:27:24.697674+0000","last_undegraded":"2024-09-18T12:27:24.697674+0000","last_fullsized":"2024-09-18T12:27:24.697674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T19:33:35.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001656458,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.514038+0000","last_change":"2024-09-18T12:27:24.514038+0000","last_active":"2024-09-18T12:27:24.514038+0000","last_peered":"2024-09-18T12:27:24.514038+0000","last_clean":"2024-09-18T12:27:24.514038+0000","last_became_active":"2024-09-18T12:27:22.935163+0000","last_became_peered":"2024-09-18T12:27:22.935163+0000","last_unstale":"2024-09-18T12:27:24.514038+0000","last_undegraded":"2024-09-18T12:27:24.514038+0000","last_fullsized":"2024-09-18T12:27:24.514038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:50:48.123121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00192884,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.697703+0000","last_change":"2024-09-18T12:27:24.698264+0000","last_active":"2024-09-18T12:27:24.697703+0000","last_peered":"2024-09-18T12:27:24.697703+0000","last_clean":"2024-09-18T12:27:24.697703+0000","last_became_active":"2024-09-18T12:27:22.504254+0000","last_became_peered":"2024-09-18T12:27:22.504254+0000","last_unstale":"2024-09-18T12:27:24.697703+0000","last_undegraded":"2024-09-18T12:27:24.697703+0000","last_fullsized":"2024-09-18T12:27:24.697703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:50:48.123121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076440299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.698944+0000","last_change":"2024-09-18T12:27:24.699430+0000","last_active":"2024-09-18T12:27:24.698944+0000","last_peered":"2024-09-18T12:27:24.698944+0000","last_clean":"2024-09-18T12:27:24.698944+0000","last_became_active":"2024-09-18T12:27:22.504798+0000","last_became_peered":"2024-09-18T12:27:22.504798+0000","last_unstale":"2024-09-18T12:27:24.698944+0000","last_undegraded":"2024-09-18T12:27:24.698944+0000","last_fullsized":"2024-09-18T12:27:24.698944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:50:48.123121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099704000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":16,"seq":68719476739,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297576,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560024,"statfs":{"total":107374182400,"available":107069464576,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.607}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1360000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.659}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.915}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]}]},{"osd":8,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560032,"statfs":{"total":107374182400,"available":107069472768,"internally_reserved":0,"allocated":217088,"data_stored":71379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7709999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9530000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.736}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0430000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7869999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5209999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6799999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.762}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.734}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.639}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.79}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]}]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560032,"statfs":{"total":107374182400,"available":107069472768,"internally_reserved":0,"allocated":217088,"data_stored":71379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:27:28.311 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:27:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:27:28.586 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-18T12:27:28.604 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-18T12:27:27.938634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":1048576000,"kb_used":2975660,"kb_used_data":2088,"kb_used_omap":16,"kb_used_meta":2973423,"kb_avail":1045600340,"statfs":{"total":1073741824000,"available":1070694748160,"internally_reserved":0,"allocated":2138112,"data_stored":713638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17040,"internal_metadata":3044785520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000392"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.507456+0000","last_change":"2024-09-18T12:27:24.507769+0000","last_active":"2024-09-18T12:27:24.507456+0000","last_peered":"2024-09-18T12:27:24.507456+0000","last_clean":"2024-09-18T12:27:24.507456+0000","last_became_active":"2024-09-18T12:27:22.935171+0000","last_became_peered":"2024-09-18T12:27:22.935171+0000","last_unstale":"2024-09-18T12:27:24.507456+0000","last_undegraded":"2024-09-18T12:27:24.507456+0000","last_fullsized":"2024-09-18T12:27:24.507456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T18:20:09.071419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050383899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.507382+0000","last_change":"2024-09-18T12:27:24.507776+0000","last_active":"2024-09-18T12:27:24.507382+0000","last_peered":"2024-09-18T12:27:24.507382+0000","last_clean":"2024-09-18T12:27:24.507382+0000","last_became_active":"2024-09-18T12:27:22.653874+0000","last_became_peered":"2024-09-18T12:27:22.653874+0000","last_unstale":"2024-09-18T12:27:24.507382+0000","last_undegraded":"2024-09-18T12:27:24.507382+0000","last_fullsized":"2024-09-18T12:27:24.507382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T19:33:35.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058294300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.697540+0000","last_change":"2024-09-18T12:27:24.697780+0000","last_active":"2024-09-18T12:27:24.697540+0000","last_peered":"2024-09-18T12:27:24.697540+0000","last_clean":"2024-09-18T12:27:24.697540+0000","last_became_active":"2024-09-18T12:27:22.504069+0000","last_became_peered":"2024-09-18T12:27:22.504069+0000","last_unstale":"2024-09-18T12:27:24.697540+0000","last_undegraded":"2024-09-18T12:27:24.697540+0000","last_fullsized":"2024-09-18T12:27:24.697540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T18:20:09.071419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059182099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.697892+0000","last_change":"2024-09-18T12:27:24.698136+0000","last_active":"2024-09-18T12:27:24.697892+0000","last_peered":"2024-09-18T12:27:24.697892+0000","last_clean":"2024-09-18T12:27:24.697892+0000","last_became_active":"2024-09-18T12:27:22.502955+0000","last_became_peered":"2024-09-18T12:27:22.502955+0000","last_unstale":"2024-09-18T12:27:24.697892+0000","last_undegraded":"2024-09-18T12:27:24.697892+0000","last_fullsized":"2024-09-18T12:27:24.697892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:50:48.123121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065089800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"19'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.697674+0000","last_change":"2024-09-18T12:27:24.698963+0000","last_active":"2024-09-18T12:27:24.697674+0000","last_peered":"2024-09-18T12:27:24.697674+0000","last_clean":"2024-09-18T12:27:24.697674+0000","last_became_active":"2024-09-18T12:27:23.325124+0000","last_became_peered":"2024-09-18T12:27:23.325124+0000","last_unstale":"2024-09-18T12:27:24.697674+0000","last_undegraded":"2024-09-18T12:27:24.697674+0000","last_fullsized":"2024-09-18T12:27:24.697674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T19:33:35.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001656458,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.514038+0000","last_change":"2024-09-18T12:27:24.514038+0000","last_active":"2024-09-18T12:27:24.514038+0000","last_peered":"2024-09-18T12:27:24.514038+0000","last_clean":"2024-09-18T12:27:24.514038+0000","last_became_active":"2024-09-18T12:27:22.935163+0000","last_became_peered":"2024-09-18T12:27:22.935163+0000","last_unstale":"2024-09-18T12:27:24.514038+0000","last_undegraded":"2024-09-18T12:27:24.514038+0000","last_fullsized":"2024-09-18T12:27:24.514038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:50:48.123121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00192884,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.697703+0000","last_change":"2024-09-18T12:27:24.698264+0000","last_active":"2024-09-18T12:27:24.697703+0000","last_peered":"2024-09-18T12:27:24.697703+0000","last_clean":"2024-09-18T12:27:24.697703+0000","last_became_active":"2024-09-18T12:27:22.504254+0000","last_became_peered":"2024-09-18T12:27:22.504254+0000","last_unstale":"2024-09-18T12:27:24.697703+0000","last_undegraded":"2024-09-18T12:27:24.697703+0000","last_fullsized":"2024-09-18T12:27:24.697703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:50:48.123121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076440299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-18T12:27:24.698944+0000","last_change":"2024-09-18T12:27:24.699430+0000","last_active":"2024-09-18T12:27:24.698944+0000","last_peered":"2024-09-18T12:27:24.698944+0000","last_clean":"2024-09-18T12:27:24.698944+0000","last_became_active":"2024-09-18T12:27:22.504798+0000","last_became_peered":"2024-09-18T12:27:22.504798+0000","last_unstale":"2024-09-18T12:27:24.698944+0000","last_undegraded":"2024-09-18T12:27:24.698944+0000","last_fullsized":"2024-09-18T12:27:24.698944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:50:48.123121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099704000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":16,"seq":68719476739,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297576,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560024,"statfs":{"total":107374182400,"available":107069464576,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.607}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1360000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.659}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.915}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]}]},{"osd":8,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560032,"statfs":{"total":107374182400,"available":107069472768,"internally_reserved":0,"allocated":217088,"data_stored":71379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7709999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9530000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.806}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.736}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0430000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7869999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5209999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6799999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.762}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.734}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560036,"statfs":{"total":107374182400,"available":107069476864,"internally_reserved":0,"allocated":212992,"data_stored":71360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.639}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.79}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]}]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104560032,"statfs":{"total":107374182400,"available":107069472768,"internally_reserved":0,"allocated":217088,"data_stored":71379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:27:28.605 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T12:27:28.605 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-18T12:27:28.605 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-18T12:27:28.606 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-18T12:27:28.915 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:27:28.915 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-18T12:27:28.931 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-18T12:27:28.932 INFO:teuthology.run_tasks:Running task workunit... 2024-09-18T12:27:28.945 INFO:tasks.workunit:Pulling workunits from ref 7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T12:27:28.946 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-18T12:27:28.946 INFO:tasks.workunit:timeout=3h 2024-09-18T12:27:28.946 INFO:tasks.workunit:cleanup=True 2024-09-18T12:27:28.946 DEBUG:teuthology.orchestra.run.smithi042:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-18T12:27:28.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:27:28.952 INFO:teuthology.orchestra.run.smithi042.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-18T12:27:28.952 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-18T12:27:28.999 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-18T12:27:28.999 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-18T12:27:29.007 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T12:27:29.015 INFO:tasks.workunit.client.0.smithi042.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-18T12:28:22.559 INFO:tasks.workunit.client.0.smithi042.stderr:Note: switching to '7061ea6ca50908d104e9f3979dc615e118d9e153'. 2024-09-18T12:28:22.559 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-18T12:28:22.559 INFO:tasks.workunit.client.0.smithi042.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-18T12:28:22.560 INFO:tasks.workunit.client.0.smithi042.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-18T12:28:22.560 INFO:tasks.workunit.client.0.smithi042.stderr:state without impacting any branches by switching back to a branch. 2024-09-18T12:28:22.560 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-18T12:28:22.560 INFO:tasks.workunit.client.0.smithi042.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-18T12:28:22.560 INFO:tasks.workunit.client.0.smithi042.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-18T12:28:22.560 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-18T12:28:22.560 INFO:tasks.workunit.client.0.smithi042.stderr: git switch -c 2024-09-18T12:28:22.560 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-18T12:28:22.560 INFO:tasks.workunit.client.0.smithi042.stderr:Or undo this operation with: 2024-09-18T12:28:22.560 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-18T12:28:22.560 INFO:tasks.workunit.client.0.smithi042.stderr: git switch - 2024-09-18T12:28:22.560 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-18T12:28:22.561 INFO:tasks.workunit.client.0.smithi042.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-18T12:28:22.561 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-09-18T12:28:22.561 INFO:tasks.workunit.client.0.smithi042.stderr:HEAD is now at 7061ea6ca50 Merge branch 'wip-65946-quincy' of https://github.com/amathuria/ceph into wip-bharath11-testing-2024-09-18-1115-quincy 2024-09-18T12:28:22.566 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-18T12:28:22.688 INFO:tasks.workunit.client.0.smithi042.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-18T12:28:22.691 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T12:28:22.691 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-18T12:28:23.573 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-18T12:28:23.713 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-18T12:28:23.768 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T12:28:23.770 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T12:28:23.771 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-18T12:28:23.828 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T12:28:23.832 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-18T12:28:23.832 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-18T12:28:23.840 INFO:tasks.workunit:Running workunits matching rados/test_health_warnings.sh on client.0... 2024-09-18T12:28:23.841 INFO:tasks.workunit:Running workunit rados/test_health_warnings.sh... 2024-09-18T12:28:23.841 DEBUG:teuthology.orchestra.run.smithi042:workunit test rados/test_health_warnings.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7061ea6ca50908d104e9f3979dc615e118d9e153 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_health_warnings.sh 2024-09-18T12:28:23.856 INFO:tasks.workunit.client.0.smithi042.stderr:+ crushtool -o crushmap --build --num_osds 10 host straw 2 rack straw 2 row straw 2 root straw 0 2024-09-18T12:28:23.875 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd setcrushmap -i crushmap 2024-09-18T12:28:26.064 INFO:tasks.workunit.client.0.smithi042.stderr:7 2024-09-18T12:28:26.075 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd tree 2024-09-18T12:28:26.456 INFO:tasks.workunit.client.0.smithi042.stdout:ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF 2024-09-18T12:28:26.456 INFO:tasks.workunit.client.0.smithi042.stdout:-11 10.00000 root root 2024-09-18T12:28:26.456 INFO:tasks.workunit.client.0.smithi042.stdout: -9 8.00000 row row0 2024-09-18T12:28:26.456 INFO:tasks.workunit.client.0.smithi042.stdout: -6 4.00000 rack rack0 2024-09-18T12:28:26.456 INFO:tasks.workunit.client.0.smithi042.stdout: -1 2.00000 host host0 2024-09-18T12:28:26.456 INFO:tasks.workunit.client.0.smithi042.stdout: 0 1.00000 osd.0 up 1.00000 1.00000 2024-09-18T12:28:26.456 INFO:tasks.workunit.client.0.smithi042.stdout: 1 1.00000 osd.1 up 1.00000 1.00000 2024-09-18T12:28:26.456 INFO:tasks.workunit.client.0.smithi042.stdout: -2 2.00000 host host1 2024-09-18T12:28:26.457 INFO:tasks.workunit.client.0.smithi042.stdout: 2 1.00000 osd.2 up 1.00000 1.00000 2024-09-18T12:28:26.457 INFO:tasks.workunit.client.0.smithi042.stdout: 3 1.00000 osd.3 up 1.00000 1.00000 2024-09-18T12:28:26.457 INFO:tasks.workunit.client.0.smithi042.stdout: -7 4.00000 rack rack1 2024-09-18T12:28:26.457 INFO:tasks.workunit.client.0.smithi042.stdout: -3 2.00000 host host2 2024-09-18T12:28:26.457 INFO:tasks.workunit.client.0.smithi042.stdout: 4 1.00000 osd.4 up 1.00000 1.00000 2024-09-18T12:28:26.457 INFO:tasks.workunit.client.0.smithi042.stdout: 5 1.00000 osd.5 up 1.00000 1.00000 2024-09-18T12:28:26.457 INFO:tasks.workunit.client.0.smithi042.stdout: -4 2.00000 host host3 2024-09-18T12:28:26.457 INFO:tasks.workunit.client.0.smithi042.stdout: 6 1.00000 osd.6 up 1.00000 1.00000 2024-09-18T12:28:26.457 INFO:tasks.workunit.client.0.smithi042.stdout: 7 1.00000 osd.7 up 1.00000 1.00000 2024-09-18T12:28:26.457 INFO:tasks.workunit.client.0.smithi042.stdout:-10 2.00000 row row1 2024-09-18T12:28:26.458 INFO:tasks.workunit.client.0.smithi042.stdout: -8 2.00000 rack rack2 2024-09-18T12:28:26.458 INFO:tasks.workunit.client.0.smithi042.stdout: -5 2.00000 host host4 2024-09-18T12:28:26.458 INFO:tasks.workunit.client.0.smithi042.stdout: 8 1.00000 osd.8 up 1.00000 1.00000 2024-09-18T12:28:26.458 INFO:tasks.workunit.client.0.smithi042.stdout: 9 1.00000 osd.9 up 1.00000 1.00000 2024-09-18T12:28:26.473 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph tell 'osd.*' injectargs --osd_max_markdown_count 1024 --osd_max_markdown_period 1 2024-09-18T12:28:26.626 INFO:tasks.workunit.client.0.smithi042.stdout:osd.0: {} 2024-09-18T12:28:26.658 INFO:tasks.workunit.client.0.smithi042.stdout:osd.1: {} 2024-09-18T12:28:26.688 INFO:tasks.workunit.client.0.smithi042.stdout:osd.2: {} 2024-09-18T12:28:26.723 INFO:tasks.workunit.client.0.smithi042.stdout:osd.3: {} 2024-09-18T12:28:26.763 INFO:tasks.workunit.client.0.smithi042.stdout:osd.4: {} 2024-09-18T12:28:26.797 INFO:tasks.workunit.client.0.smithi042.stdout:osd.5: {} 2024-09-18T12:28:26.829 INFO:tasks.workunit.client.0.smithi042.stdout:osd.6: {} 2024-09-18T12:28:26.868 INFO:tasks.workunit.client.0.smithi042.stdout:osd.7: {} 2024-09-18T12:28:26.905 INFO:tasks.workunit.client.0.smithi042.stdout:osd.8: {} 2024-09-18T12:28:26.940 INFO:tasks.workunit.client.0.smithi042.stdout:osd.9: {} 2024-09-18T12:28:26.955 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd set noout 2024-09-18T12:28:29.061 INFO:tasks.workunit.client.0.smithi042.stderr:noout is set 2024-09-18T12:28:29.076 INFO:tasks.workunit.client.0.smithi042.stderr:+ test_mark_two_osds_same_host_down 2024-09-18T12:28:29.077 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd set noup 2024-09-18T12:28:31.068 INFO:tasks.workunit.client.0.smithi042.stderr:noup is set 2024-09-18T12:28:31.080 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd down osd.0 osd.1 2024-09-18T12:28:31.382 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-18T12:28:31.379+0000 7ff2243ab700 -1 mon.a@0(leader).osd e28 definitely_dead 0 2024-09-18T12:28:32.186 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-18T12:28:32.183+0000 7ff2243ab700 -1 mon.a@0(leader).osd e29 definitely_dead 0 2024-09-18T12:28:32.189 INFO:tasks.workunit.client.0.smithi042.stderr:osd.0 is already down. osd.1 is already down. 2024-09-18T12:28:32.198 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health detail 2024-09-18T12:28:32.693 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2024-09-18T12:28:32.693 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2024-09-18T12:28:32.693 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSD_DOWN: 2 osds down 2024-09-18T12:28:32.693 INFO:tasks.workunit.client.0.smithi042.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2024-09-18T12:28:32.694 INFO:tasks.workunit.client.0.smithi042.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2024-09-18T12:28:32.694 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2024-09-18T12:28:32.694 INFO:tasks.workunit.client.0.smithi042.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2024-09-18T12:28:32.705 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep '1 host' 2024-09-18T12:28:32.705 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:33.163 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2024-09-18T12:28:33.163 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:33.163 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep '2 osds' 2024-09-18T12:28:33.617 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2024-09-18T12:28:33.617 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health detail 2024-09-18T12:28:33.618 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep osd.0 2024-09-18T12:28:33.807 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-18T12:28:33.803+0000 7f048840d700 -1 osd.1 30 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:28:34.080 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-18T12:28:34.075+0000 7f0478990700 -1 osd.1 31 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:28:34.126 INFO:tasks.workunit.client.0.smithi042.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2024-09-18T12:28:34.126 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health detail 2024-09-18T12:28:34.126 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep osd.1 2024-09-18T12:28:34.628 INFO:tasks.workunit.client.0.smithi042.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2024-09-18T12:28:34.629 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd unset noup 2024-09-18T12:28:35.088 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-18T12:28:35.083+0000 7f04811b0700 -1 osd.1 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:28:36.097 INFO:tasks.workunit.client.0.smithi042.stderr:noup is unset 2024-09-18T12:28:36.108 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait_for_healthy 2024-09-18T12:28:36.108 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:36.108 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep down 2024-09-18T12:28:36.558 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2024-09-18T12:28:36.559 INFO:tasks.workunit.client.0.smithi042.stderr:+ sleep 1 2024-09-18T12:28:37.117 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-18T12:28:37.111+0000 7f289c399700 -1 osd.0 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:28:37.560 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:37.561 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep down 2024-09-18T12:28:38.022 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2024-09-18T12:28:38.022 INFO:tasks.workunit.client.0.smithi042.stderr:+ sleep 1 2024-09-18T12:28:39.024 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:39.024 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep down 2024-09-18T12:28:39.474 INFO:tasks.workunit.client.0.smithi042.stderr:+ test_mark_two_osds_same_rack_down 2024-09-18T12:28:39.474 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd set noup 2024-09-18T12:28:41.124 INFO:tasks.workunit.client.0.smithi042.stderr:noup is set 2024-09-18T12:28:41.137 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd down osd.8 osd.9 2024-09-18T12:28:41.444 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-18T12:28:41.439+0000 7ff2243ab700 -1 mon.a@0(leader).osd e38 definitely_dead 0 2024-09-18T12:28:42.242 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-18T12:28:42.239+0000 7ff2243ab700 -1 mon.a@0(leader).osd e39 definitely_dead 0 2024-09-18T12:28:42.246 INFO:tasks.workunit.client.0.smithi042.stderr:osd.8 is already down. osd.9 is already down. 2024-09-18T12:28:42.255 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health detail 2024-09-18T12:28:42.744 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2024-09-18T12:28:42.744 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2024-09-18T12:28:42.744 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSD_DOWN: 2 osds down 2024-09-18T12:28:42.745 INFO:tasks.workunit.client.0.smithi042.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2024-09-18T12:28:42.745 INFO:tasks.workunit.client.0.smithi042.stdout: osd.9 (root=root,row=row1,rack=rack2,host=host4) is down 2024-09-18T12:28:42.745 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2024-09-18T12:28:42.745 INFO:tasks.workunit.client.0.smithi042.stdout: host host4 (root=root,row=row1,rack=rack2) (2 osds) is down 2024-09-18T12:28:42.745 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSD_RACK_DOWN: 1 rack (2 osds) down 2024-09-18T12:28:42.745 INFO:tasks.workunit.client.0.smithi042.stdout: rack rack2 (root=root,row=row1) (2 osds) is down 2024-09-18T12:28:42.745 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSD_ROW_DOWN: 1 row (2 osds) down 2024-09-18T12:28:42.745 INFO:tasks.workunit.client.0.smithi042.stdout: row row1 (root=root) (2 osds) is down 2024-09-18T12:28:42.756 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:42.756 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep '1 host' 2024-09-18T12:28:43.217 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2024-09-18T12:28:43.217 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:43.218 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep '1 rack' 2024-09-18T12:28:43.670 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2024-09-18T12:28:43.670 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:43.670 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep '1 row' 2024-09-18T12:28:44.112 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2024-09-18T12:28:44.113 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:44.113 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep '2 osds' 2024-09-18T12:28:44.553 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2024-09-18T12:28:44.554 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health detail 2024-09-18T12:28:44.554 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep osd.8 2024-09-18T12:28:45.057 INFO:tasks.workunit.client.0.smithi042.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2024-09-18T12:28:45.057 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health detail 2024-09-18T12:28:45.057 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep osd.9 2024-09-18T12:28:45.554 INFO:tasks.workunit.client.0.smithi042.stdout: osd.9 (root=root,row=row1,rack=rack2,host=host4) is down 2024-09-18T12:28:45.554 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd unset noup 2024-09-18T12:28:46.423 INFO:tasks.ceph.osd.9.smithi042.stderr:2024-09-18T12:28:46.419+0000 7fde97a2b700 -1 osd.9 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:28:47.148 INFO:tasks.workunit.client.0.smithi042.stderr:noup is unset 2024-09-18T12:28:47.161 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait_for_healthy 2024-09-18T12:28:47.161 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:47.161 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep down 2024-09-18T12:28:47.252 INFO:tasks.ceph.osd.8.smithi042.stderr:2024-09-18T12:28:47.247+0000 7f07e15b6700 -1 osd.8 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:28:47.624 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2024-09-18T12:28:47.624 INFO:tasks.workunit.client.0.smithi042.stderr:+ sleep 1 2024-09-18T12:28:48.626 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:48.626 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep down 2024-09-18T12:28:49.091 INFO:tasks.workunit.client.0.smithi042.stderr:+ test_mark_all_but_last_osds_down 2024-09-18T12:28:49.091 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd set noup 2024-09-18T12:28:51.168 INFO:tasks.workunit.client.0.smithi042.stderr:noup is set 2024-09-18T12:28:51.182 INFO:tasks.workunit.client.0.smithi042.stderr:++ ceph osd ls 2024-09-18T12:28:51.182 INFO:tasks.workunit.client.0.smithi042.stderr:++ sed '$d' 2024-09-18T12:28:51.585 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd down 0 1 2 3 4 5 6 7 8 2024-09-18T12:28:51.891 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-18T12:28:51.887+0000 7ff2243ab700 -1 mon.a@0(leader).osd e45 definitely_dead 0 2024-09-18T12:28:52.289 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-18T12:28:52.287+0000 7ff2243ab700 -1 mon.a@0(leader).osd e46 definitely_dead 0 2024-09-18T12:28:52.293 INFO:tasks.workunit.client.0.smithi042.stderr:osd.0 is already down. osd.1 is already down. osd.2 is already down. osd.3 is already down. osd.4 is already down. osd.5 is already down. osd.6 is already down. osd.7 is already down. osd.8 is already down. 2024-09-18T12:28:52.308 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health detail 2024-09-18T12:28:52.796 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2024-09-18T12:28:52.796 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2024-09-18T12:28:52.796 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSD_DOWN: 9 osds down 2024-09-18T12:28:52.796 INFO:tasks.workunit.client.0.smithi042.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout: osd.2 (root=root,row=row0,rack=rack0,host=host1) is down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout: osd.3 (root=root,row=row0,rack=rack0,host=host1) is down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout: osd.4 (root=root,row=row0,rack=rack1,host=host2) is down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout: osd.5 (root=root,row=row0,rack=rack1,host=host2) is down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout: osd.6 (root=root,row=row0,rack=rack1,host=host3) is down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout: osd.7 (root=root,row=row0,rack=rack1,host=host3) is down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSD_HOST_DOWN: 4 hosts (8 osds) down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout: host host1 (root=root,row=row0,rack=rack0) (2 osds) is down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout: host host2 (root=root,row=row0,rack=rack1) (2 osds) is down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout: host host3 (root=root,row=row0,rack=rack1) (2 osds) is down 2024-09-18T12:28:52.797 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSD_RACK_DOWN: 2 racks (8 osds) down 2024-09-18T12:28:52.798 INFO:tasks.workunit.client.0.smithi042.stdout: rack rack0 (root=root,row=row0) (4 osds) is down 2024-09-18T12:28:52.798 INFO:tasks.workunit.client.0.smithi042.stdout: rack rack1 (root=root,row=row0) (4 osds) is down 2024-09-18T12:28:52.798 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSD_ROW_DOWN: 1 row (8 osds) down 2024-09-18T12:28:52.798 INFO:tasks.workunit.client.0.smithi042.stdout: row row0 (root=root) (8 osds) is down 2024-09-18T12:28:52.809 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:52.809 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep '1 row' 2024-09-18T12:28:53.145 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-18T12:28:53.139+0000 7f28a35f6700 -1 osd.0 46 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:28:53.175 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-18T12:28:53.171+0000 7f2893b79700 -1 osd.0 47 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:28:53.275 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2024-09-18T12:28:53.275 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:53.275 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep '2 racks' 2024-09-18T12:28:53.481 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-18T12:28:53.479+0000 7fa875e2d700 -1 osd.3 47 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:28:53.737 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2024-09-18T12:28:53.737 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:53.737 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep '4 hosts' 2024-09-18T12:28:54.182 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-18T12:28:54.179+0000 7f2893b79700 -1 osd.0 48 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:28:54.183 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-18T12:28:54.179+0000 7fa8663b0700 -1 osd.3 48 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:28:54.200 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2024-09-18T12:28:54.201 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:54.201 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep '9 osds' 2024-09-18T12:28:54.281 INFO:tasks.ceph.osd.8.smithi042.stderr:2024-09-18T12:28:54.275+0000 7f07e8813700 -1 osd.8 48 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:28:54.294 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-09-18T12:28:54.291+0000 7f21a7f16700 -1 osd.5 48 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:28:54.394 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-18T12:28:54.391+0000 7f781f1be700 -1 osd.2 48 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:28:54.547 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-09-18T12:28:54.543+0000 7f6ee4aa2700 -1 osd.4 48 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:28:54.645 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2024-09-18T12:28:54.645 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd unset noup 2024-09-18T12:28:54.835 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-18T12:28:54.831+0000 7f0489c32700 -1 osd.1 48 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:28:55.190 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-18T12:28:55.187+0000 7f289c399700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:28:55.190 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-09-18T12:28:55.187+0000 7f219f494700 -1 osd.5 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:28:55.191 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-09-18T12:28:55.187+0000 7f6edd845700 -1 osd.4 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:28:55.191 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-18T12:28:55.187+0000 7fa86ebd0700 -1 osd.3 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:28:55.192 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-18T12:28:55.187+0000 7f04811b0700 -1 osd.1 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:28:55.192 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-18T12:28:55.187+0000 7f781673c700 -1 osd.2 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:28:55.193 INFO:tasks.ceph.osd.8.smithi042.stderr:2024-09-18T12:28:55.191+0000 7f07e15b6700 -1 osd.8 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:28:56.219 INFO:tasks.workunit.client.0.smithi042.stderr:noup is unset 2024-09-18T12:28:56.229 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait_for_healthy 2024-09-18T12:28:56.229 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:56.230 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep down 2024-09-18T12:28:56.662 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noout flag(s) set; 2 osds down; 1 host (2 osds) down 2024-09-18T12:28:56.663 INFO:tasks.workunit.client.0.smithi042.stderr:+ sleep 1 2024-09-18T12:28:57.042 INFO:tasks.ceph.osd.6.smithi042.stderr:2024-09-18T12:28:57.039+0000 7f58ce63e700 -1 osd.6 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:28:57.665 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:57.665 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep down 2024-09-18T12:28:58.117 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2024-09-18T12:28:58.117 INFO:tasks.workunit.client.0.smithi042.stderr:+ sleep 1 2024-09-18T12:28:58.159 INFO:tasks.ceph.osd.7.smithi042.stderr:2024-09-18T12:28:58.155+0000 7f9dec54a700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:28:59.119 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:28:59.119 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep down 2024-09-18T12:28:59.584 INFO:tasks.workunit.client.0.smithi042.stderr:+ test_mark_two_osds_same_host_down_with_classes 2024-09-18T12:28:59.584 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd set noup 2024-09-18T12:29:01.221 INFO:tasks.workunit.client.0.smithi042.stderr:noup is set 2024-09-18T12:29:01.234 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd crush set-device-class ssd osd.0 osd.2 osd.4 osd.6 osd.8 2024-09-18T12:29:03.235 INFO:tasks.workunit.client.0.smithi042.stderr:osd.0 already set to class ssd. set-device-class item id 0 name 'osd.0' device_class 'ssd': no change. osd.2 already set to class ssd. set-device-class item id 2 name 'osd.2' device_class 'ssd': no change. osd.4 already set to class ssd. set-device-class item id 4 name 'osd.4' device_class 'ssd': no change. osd.6 already set to class ssd. set-device-class item id 6 name 'osd.6' device_class 'ssd': no change. osd.8 already set to class ssd. set-device-class item id 8 name 'osd.8' device_class 'ssd': no change. set osd(s) to class 'ssd' 2024-09-18T12:29:03.247 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd crush set-device-class hdd osd.1 osd.3 osd.5 osd.7 osd.9 2024-09-18T12:29:05.246 INFO:tasks.workunit.client.0.smithi042.stderr:osd.1 already set to class hdd. set-device-class item id 1 name 'osd.1' device_class 'hdd': no change. osd.3 already set to class hdd. set-device-class item id 3 name 'osd.3' device_class 'hdd': no change. osd.5 already set to class hdd. set-device-class item id 5 name 'osd.5' device_class 'hdd': no change. osd.7 already set to class hdd. set-device-class item id 7 name 'osd.7' device_class 'hdd': no change. osd.9 already set to class hdd. set-device-class item id 9 name 'osd.9' device_class 'hdd': no change. set osd(s) to class 'hdd' 2024-09-18T12:29:05.259 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd down osd.0 osd.1 2024-09-18T12:29:05.566 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-18T12:29:05.563+0000 7ff2243ab700 -1 mon.a@0(leader).osd e59 definitely_dead 0 2024-09-18T12:29:06.367 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-18T12:29:06.363+0000 7ff2243ab700 -1 mon.a@0(leader).osd e60 definitely_dead 0 2024-09-18T12:29:06.371 INFO:tasks.workunit.client.0.smithi042.stderr:osd.0 is already down. osd.1 is already down. 2024-09-18T12:29:06.383 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health detail 2024-09-18T12:29:06.875 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2024-09-18T12:29:06.876 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2024-09-18T12:29:06.876 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSD_DOWN: 2 osds down 2024-09-18T12:29:06.876 INFO:tasks.workunit.client.0.smithi042.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2024-09-18T12:29:06.876 INFO:tasks.workunit.client.0.smithi042.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2024-09-18T12:29:06.876 INFO:tasks.workunit.client.0.smithi042.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2024-09-18T12:29:06.876 INFO:tasks.workunit.client.0.smithi042.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2024-09-18T12:29:06.887 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:29:06.887 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep '1 host' 2024-09-18T12:29:06.940 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-18T12:29:06.935+0000 7f048840d700 -1 osd.1 60 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:29:07.250 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-18T12:29:07.247+0000 7f0478990700 -1 osd.1 61 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:29:07.349 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2024-09-18T12:29:07.349 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:29:07.349 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep '2 osds' 2024-09-18T12:29:07.779 INFO:tasks.workunit.client.0.smithi042.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2024-09-18T12:29:07.779 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health detail 2024-09-18T12:29:07.779 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep osd.0 2024-09-18T12:29:08.263 INFO:tasks.workunit.client.0.smithi042.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2024-09-18T12:29:08.264 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health detail 2024-09-18T12:29:08.264 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep osd.1 2024-09-18T12:29:08.766 INFO:tasks.workunit.client.0.smithi042.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2024-09-18T12:29:08.766 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph osd unset noup 2024-09-18T12:29:08.827 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-18T12:29:08.823+0000 7f28a4e1b700 -1 osd.0 61 osdmap NOUP flag is set, waiting for it to clear 2024-09-18T12:29:09.261 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-18T12:29:09.259+0000 7f289c399700 -1 osd.0 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:29:09.264 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-18T12:29:09.255+0000 7f04811b0700 -1 osd.1 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T12:29:10.279 INFO:tasks.workunit.client.0.smithi042.stderr:noup is unset 2024-09-18T12:29:10.290 INFO:tasks.workunit.client.0.smithi042.stderr:+ wait_for_healthy 2024-09-18T12:29:10.290 INFO:tasks.workunit.client.0.smithi042.stderr:+ ceph health 2024-09-18T12:29:10.290 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep down 2024-09-18T12:29:10.751 INFO:tasks.workunit.client.0.smithi042.stderr:+ exit 0 2024-09-18T12:29:10.752 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-18T12:29:10.752 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-18T12:29:10.808 INFO:tasks.workunit:Stopping ['rados/test_health_warnings.sh'] on client.0... 2024-09-18T12:29:10.809 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-18T12:29:11.047 DEBUG:teuthology.parallel:result is None 2024-09-18T12:29:11.047 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T12:29:11.060 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T12:29:11.061 DEBUG:teuthology.orchestra.run.smithi042:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-18T12:29:11.080 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T12:29:11.080 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-18T12:29:11.090 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-09-18T12:29:11.090 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T12:29:11.419 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:29:11.419 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":64,"fsid":"d50b3a4e-0c54-4de8-95b7-7e9a6d6a5fb8","created":"2024-09-18T12:27:09.261426+0000","modified":"2024-09-18T12:29:11.270299+0000","last_up_change":"2024-09-18T12:29:10.262084+0000","last_in_change":"2024-09-18T12:27:11.882420+0000","flags":"noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800064,"flags_set":["noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":11,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-18T12:27:21.010721+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab74a47a-04f7-456a-bd16-4ed3646ff3c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":62,"up_from":63,"up_thru":39,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6831","nonce":25560},{"type":"v1","addr":"172.21.15.42:6834","nonce":25560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3025560},{"type":"v1","addr":"172.21.15.42:6814","nonce":3025560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6845","nonce":25560},{"type":"v1","addr":"172.21.15.42:6847","nonce":25560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6841","nonce":25560},{"type":"v1","addr":"172.21.15.42:6843","nonce":25560}]},"public_addr":"172.21.15.42:6834/25560","cluster_addr":"172.21.15.42:6814/3025560","heartbeat_back_addr":"172.21.15.42:6847/25560","heartbeat_front_addr":"172.21.15.42:6843/25560","state":["exists","up"]},{"osd":1,"uuid":"31744fc6-ab42-428f-9714-29a1c916f55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":62,"up_from":63,"up_thru":63,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":25553},{"type":"v1","addr":"172.21.15.42:6801","nonce":25553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6837","nonce":3025553},{"type":"v1","addr":"172.21.15.42:6839","nonce":3025553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":25553},{"type":"v1","addr":"172.21.15.42:6807","nonce":25553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":25553},{"type":"v1","addr":"172.21.15.42:6805","nonce":25553}]},"public_addr":"172.21.15.42:6801/25553","cluster_addr":"172.21.15.42:6839/3025553","heartbeat_back_addr":"172.21.15.42:6807/25553","heartbeat_front_addr":"172.21.15.42:6805/25553","state":["exists","up"]},{"osd":2,"uuid":"1005aa3b-486d-454f-9902-e4e1d139cc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":49,"up_from":50,"up_thru":0,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6864","nonce":25575},{"type":"v1","addr":"172.21.15.42:6865","nonce":25575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1025575},{"type":"v1","addr":"172.21.15.42:6827","nonce":1025575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6870","nonce":25575},{"type":"v1","addr":"172.21.15.42:6871","nonce":25575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6868","nonce":25575},{"type":"v1","addr":"172.21.15.42:6869","nonce":25575}]},"public_addr":"172.21.15.42:6865/25575","cluster_addr":"172.21.15.42:6827/1025575","heartbeat_back_addr":"172.21.15.42:6871/25575","heartbeat_front_addr":"172.21.15.42:6869/25575","state":["exists","up"]},{"osd":3,"uuid":"5559f79d-83fa-42b3-99d8-f117f4205741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":49,"up_from":50,"up_thru":63,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":25557},{"type":"v1","addr":"172.21.15.42:6825","nonce":25557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1025557},{"type":"v1","addr":"172.21.15.42:6803","nonce":1025557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":25557},{"type":"v1","addr":"172.21.15.42:6832","nonce":25557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":25557},{"type":"v1","addr":"172.21.15.42:6829","nonce":25557}]},"public_addr":"172.21.15.42:6825/25557","cluster_addr":"172.21.15.42:6803/1025557","heartbeat_back_addr":"172.21.15.42:6832/25557","heartbeat_front_addr":"172.21.15.42:6829/25557","state":["exists","up"]},{"osd":4,"uuid":"699f276b-ca34-41dd-a9d7-128443cb4818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":49,"up_from":50,"up_thru":63,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":25554},{"type":"v1","addr":"172.21.15.42:6810","nonce":25554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":1025554},{"type":"v1","addr":"172.21.15.42:6815","nonce":1025554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":25554},{"type":"v1","addr":"172.21.15.42:6822","nonce":25554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":25554},{"type":"v1","addr":"172.21.15.42:6818","nonce":25554}]},"public_addr":"172.21.15.42:6810/25554","cluster_addr":"172.21.15.42:6815/1025554","heartbeat_back_addr":"172.21.15.42:6822/25554","heartbeat_front_addr":"172.21.15.42:6818/25554","state":["exists","up"]},{"osd":5,"uuid":"24430a9f-4b9f-4a25-8947-070fda401422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":49,"up_from":50,"up_thru":50,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":25555},{"type":"v1","addr":"172.21.15.42:6811","nonce":25555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6874","nonce":1025555},{"type":"v1","addr":"172.21.15.42:6875","nonce":1025555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":25555},{"type":"v1","addr":"172.21.15.42:6823","nonce":25555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":25555},{"type":"v1","addr":"172.21.15.42:6819","nonce":25555}]},"public_addr":"172.21.15.42:6811/25555","cluster_addr":"172.21.15.42:6875/1025555","heartbeat_back_addr":"172.21.15.42:6823/25555","heartbeat_front_addr":"172.21.15.42:6819/25555","state":["exists","up"]},{"osd":6,"uuid":"5fb76140-ee57-491b-a2b1-510a6542f55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":50,"up_from":51,"up_thru":60,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6848","nonce":25559},{"type":"v1","addr":"172.21.15.42:6850","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6882","nonce":1025559},{"type":"v1","addr":"172.21.15.42:6883","nonce":1025559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6859","nonce":25559},{"type":"v1","addr":"172.21.15.42:6861","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6855","nonce":25559},{"type":"v1","addr":"172.21.15.42:6857","nonce":25559}]},"public_addr":"172.21.15.42:6850/25559","cluster_addr":"172.21.15.42:6883/1025559","heartbeat_back_addr":"172.21.15.42:6861/25559","heartbeat_front_addr":"172.21.15.42:6857/25559","state":["exists","up"]},{"osd":7,"uuid":"5f254cd1-26b1-4233-868a-eb987cd7ceb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":51,"up_from":52,"up_thru":52,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":25566},{"type":"v1","addr":"172.21.15.42:6835","nonce":25566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6852","nonce":1025566},{"type":"v1","addr":"172.21.15.42:6854","nonce":1025566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6844","nonce":25566},{"type":"v1","addr":"172.21.15.42:6846","nonce":25566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":25566},{"type":"v1","addr":"172.21.15.42:6842","nonce":25566}]},"public_addr":"172.21.15.42:6835/25566","cluster_addr":"172.21.15.42:6854/1025566","heartbeat_back_addr":"172.21.15.42:6846/25566","heartbeat_front_addr":"172.21.15.42:6842/25566","state":["exists","up"]},{"osd":8,"uuid":"8e21d721-414c-43bc-b09e-a5bf160bb35e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":49,"up_from":50,"up_thru":18,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6849","nonce":25578},{"type":"v1","addr":"172.21.15.42:6851","nonce":25578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6866","nonce":2025578},{"type":"v1","addr":"172.21.15.42:6867","nonce":2025578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6862","nonce":25578},{"type":"v1","addr":"172.21.15.42:6863","nonce":25578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6858","nonce":25578},{"type":"v1","addr":"172.21.15.42:6860","nonce":25578}]},"public_addr":"172.21.15.42:6851/25578","cluster_addr":"172.21.15.42:6867/2025578","heartbeat_back_addr":"172.21.15.42:6863/25578","heartbeat_front_addr":"172.21.15.42:6860/25578","state":["exists","up"]},{"osd":9,"uuid":"bfa8f2a7-4738-4089-88bc-914091e7e1ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":16,"last_clean_end":41,"up_from":42,"up_thru":63,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6872","nonce":25601},{"type":"v1","addr":"172.21.15.42:6873","nonce":25601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1025601},{"type":"v1","addr":"172.21.15.42:6838","nonce":1025601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6878","nonce":25601},{"type":"v1","addr":"172.21.15.42:6879","nonce":25601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6876","nonce":25601},{"type":"v1","addr":"172.21.15.42:6877","nonce":25601}]},"public_addr":"172.21.15.42:6873/25601","cluster_addr":"172.21.15.42:6838/1025601","heartbeat_back_addr":"172.21.15.42:6879/25601","heartbeat_front_addr":"172.21.15.42:6877/25601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2024-09-18T12:29:06.239346+0000","laggy_probability":0.65700000524520874,"laggy_interval":1,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.867945+0000","dead_epoch":61},{"osd":1,"down_stamp":"2024-09-18T12:29:06.239346+0000","laggy_probability":0.65700000524520874,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.353200+0000","dead_epoch":60},{"osd":2,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.192345+0000","dead_epoch":47},{"osd":3,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.241275+0000","dead_epoch":47},{"osd":4,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.162388+0000","dead_epoch":47},{"osd":5,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.118272+0000","dead_epoch":47},{"osd":6,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.182504+0000","dead_epoch":50},{"osd":7,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.932363+0000","dead_epoch":51},{"osd":8,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.50999999046325684,"laggy_interval":1,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.922300+0000","dead_epoch":47},{"osd":9,"down_stamp":"2024-09-18T12:28:42.118160+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.546891+0000","dead_epoch":40}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:29:11.433 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T12:29:11.434 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:29:11.726 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:29:11.728 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-18T12:29:11.740 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-09-18T12:29:11.271776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":2980284,"kb_used_data":6692,"kb_used_omap":16,"kb_used_meta":2973423,"kb_avail":1045595716,"statfs":{"total":1073741824000,"available":1070690013184,"internally_reserved":0,"allocated":6852608,"data_stored":3177332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17040,"internal_metadata":3044785520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.026635"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T12:29:07.145047+0000","last_change":"2024-09-18T12:28:57.205389+0000","last_active":"2024-09-18T12:29:07.145047+0000","last_peered":"2024-09-18T12:29:07.145047+0000","last_clean":"2024-09-18T12:29:07.145047+0000","last_became_active":"2024-09-18T12:28:57.205005+0000","last_became_peered":"2024-09-18T12:28:57.205005+0000","last_unstale":"2024-09-18T12:29:07.145047+0000","last_undegraded":"2024-09-18T12:29:07.145047+0000","last_fullsized":"2024-09-18T12:29:07.145047+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:41:06.141977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050383899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":65,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T12:29:07.144011+0000","last_change":"2024-09-18T12:28:58.636245+0000","last_active":"2024-09-18T12:29:07.144011+0000","last_peered":"2024-09-18T12:29:07.144011+0000","last_clean":"2024-09-18T12:29:07.144011+0000","last_became_active":"2024-09-18T12:28:58.635680+0000","last_became_peered":"2024-09-18T12:28:58.635680+0000","last_unstale":"2024-09-18T12:29:07.144011+0000","last_undegraded":"2024-09-18T12:29:07.144011+0000","last_fullsized":"2024-09-18T12:29:07.144011+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:16:32.931305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058294300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":87,"reported_epoch":61,"state":"active+undersized+wait","last_fresh":"2024-09-18T12:29:07.253556+0000","last_change":"2024-09-18T12:29:07.253308+0000","last_active":"2024-09-18T12:29:07.253556+0000","last_peered":"2024-09-18T12:29:07.253556+0000","last_clean":"2024-09-18T12:29:04.235868+0000","last_became_active":"2024-09-18T12:29:07.253308+0000","last_became_peered":"2024-09-18T12:29:07.253308+0000","last_unstale":"2024-09-18T12:29:07.253556+0000","last_undegraded":"2024-09-18T12:29:07.253556+0000","last_fullsized":"2024-09-18T12:29:07.251829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T21:23:12.554336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059182099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-18T12:29:07.253738+0000","last_change":"2024-09-18T12:29:07.253587+0000","last_active":"2024-09-18T12:29:07.253738+0000","last_peered":"2024-09-18T12:29:07.253738+0000","last_clean":"2024-09-18T12:28:51.331008+0000","last_became_active":"2024-09-18T12:29:07.253587+0000","last_became_peered":"2024-09-18T12:29:07.253587+0000","last_unstale":"2024-09-18T12:29:07.253738+0000","last_undegraded":"2024-09-18T12:29:07.253738+0000","last_fullsized":"2024-09-18T12:29:07.252315+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:51:54.090054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"19'1","reported_seq":74,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-18T12:29:07.255619+0000","last_change":"2024-09-18T12:29:07.255482+0000","last_active":"2024-09-18T12:29:07.255619+0000","last_peered":"2024-09-18T12:29:07.255619+0000","last_clean":"2024-09-18T12:29:06.904833+0000","last_became_active":"2024-09-18T12:29:07.255482+0000","last_became_peered":"2024-09-18T12:29:07.255482+0000","last_unstale":"2024-09-18T12:29:07.255619+0000","last_undegraded":"2024-09-18T12:29:07.254276+0000","last_fullsized":"2024-09-18T12:29:07.254072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T20:45:11.014769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"21'2","reported_seq":73,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-18T12:29:07.254398+0000","last_change":"2024-09-18T12:29:07.254331+0000","last_active":"2024-09-18T12:29:07.254398+0000","last_peered":"2024-09-18T12:29:07.254398+0000","last_clean":"2024-09-18T12:29:05.236987+0000","last_became_active":"2024-09-18T12:29:07.254331+0000","last_became_peered":"2024-09-18T12:29:07.254331+0000","last_unstale":"2024-09-18T12:29:07.254398+0000","last_undegraded":"2024-09-18T12:29:07.253254+0000","last_fullsized":"2024-09-18T12:29:07.252974+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:13:31.942117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00192884,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T12:29:04.242636+0000","last_change":"2024-09-18T12:28:59.609508+0000","last_active":"2024-09-18T12:29:04.242636+0000","last_peered":"2024-09-18T12:29:04.242636+0000","last_clean":"2024-09-18T12:29:04.242636+0000","last_became_active":"2024-09-18T12:28:59.608964+0000","last_became_peered":"2024-09-18T12:28:59.608964+0000","last_unstale":"2024-09-18T12:29:04.242636+0000","last_undegraded":"2024-09-18T12:29:04.242636+0000","last_fullsized":"2024-09-18T12:29:04.242636+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076440299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":63,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-18T12:29:05.445453+0000","last_change":"2024-09-18T12:28:57.204248+0000","last_active":"2024-09-18T12:29:05.445453+0000","last_peered":"2024-09-18T12:29:05.445453+0000","last_clean":"2024-09-18T12:29:05.445453+0000","last_became_active":"2024-09-18T12:28:57.203688+0000","last_became_peered":"2024-09-18T12:28:57.203688+0000","last_unstale":"2024-09-18T12:29:05.445453+0000","last_undegraded":"2024-09-18T12:29:05.445453+0000","last_fullsized":"2024-09-18T12:29:05.445453+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":42,"seq":180388626456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298048,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559552,"statfs":{"total":107374182400,"available":107068981248,"internally_reserved":0,"allocated":704512,"data_stored":330675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.73199999999999998}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.90400000000000003}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.0800000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.77200000000000002}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":1.143},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.3180000000000001}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":1.349}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.401}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.605}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.8720000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.4850000000000001}]}]},{"osd":8,"up_from":50,"seq":214748364824,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298052,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559548,"statfs":{"total":107374182400,"available":107068977152,"internally_reserved":0,"allocated":704512,"data_stored":330675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.095}]},{"osd":1,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.95799999999999996}]},{"osd":2,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":2.0089999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":1.1839999999999999}]},{"osd":3,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.1399999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.712},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.9750000000000001}]},{"osd":5,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":2.3620000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.244},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":2.4380000000000002}]},{"osd":7,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":2.069},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.819}]},{"osd":9,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":2.4889999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.77}]}]},{"osd":7,"up_from":52,"seq":223338299416,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298032,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559568,"statfs":{"total":107374182400,"available":107068997632,"internally_reserved":0,"allocated":692224,"data_stored":322969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":1.7110000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.532}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.244},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.2869999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.83299999999999996}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.014},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":1.194}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.7429999999999999,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.484}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.3700000000000001,"5min":3.3700000000000001,"15min":3.3700000000000001},"last":1.103},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.1539999999999999}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.593},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.351}]}]},{"osd":6,"up_from":51,"seq":219043332120,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298020,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559580,"statfs":{"total":107374182400,"available":107069009920,"internally_reserved":0,"allocated":679936,"data_stored":315245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.70199999999999996}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.80200000000000005}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.92000000000000004}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.427},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.0529999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.5189999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.554},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.169}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.752},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.365}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.661}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.6950000000000001}]}]},{"osd":5,"up_from":50,"seq":214748364824,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298024,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559576,"statfs":{"total":107374182400,"available":107069005824,"internally_reserved":0,"allocated":679936,"data_stored":315245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":1.5069999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.095}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.448},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.98999999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.78}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.1970000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.9610000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.6180000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.8969999999999998,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.901}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":1.734},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.296}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.651},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.228}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":2.008}]}]},{"osd":4,"up_from":50,"seq":214748364824,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298028,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559572,"statfs":{"total":107374182400,"available":107069001728,"internally_reserved":0,"allocated":684032,"data_stored":315264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.95099999999999996}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.3220000000000001}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.89400000000000002}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.45}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.526}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.3859999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.165},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.851}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.944},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.712}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.6339999999999999}]}]},{"osd":3,"up_from":50,"seq":214748364824,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298012,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559588,"statfs":{"total":107374182400,"available":107069018112,"internally_reserved":0,"allocated":667648,"data_stored":304861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.61899999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.175},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.82799999999999996}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.86299999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.6080000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.0049999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.484},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.8140000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.395},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.75}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.278},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.659}]}]},{"osd":2,"up_from":50,"seq":214748364824,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298036,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559564,"statfs":{"total":107374182400,"available":107068993536,"internally_reserved":0,"allocated":692224,"data_stored":322969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.73399999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":1.0740000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.79200000000000004}]},{"osd":4,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.774}]},{"osd":5,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.831},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.1080000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.6519999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.8720000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.8500000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.8049999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.9470000000000001}]}]},{"osd":1,"up_from":0,"seq":24,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298024,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559576,"statfs":{"total":107374182400,"available":107069005824,"internally_reserved":0,"allocated":679936,"data_stored":314568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.80400000000000005}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.363},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.82299999999999995}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.573}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.1319999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.216},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4340000000000002,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.4650000000000001}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.425}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.266},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.1930000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:22 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.3999999999999999}]}]},{"osd":0,"up_from":50,"seq":214748364824,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298008,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559592,"statfs":{"total":107374182400,"available":107069022208,"internally_reserved":0,"allocated":667648,"data_stored":304861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.93500000000000005}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.72299999999999998}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.4180000000000001,"5min":7.4180000000000001,"15min":7.4180000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":1.153}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.768}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.518},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":1.47}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":6.3280000000000003,"5min":6.3280000000000003,"15min":6.3280000000000003},"last":2.0339999999999998},{"interface":"front","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":1.845}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":1.597},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.359}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.571},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.6830000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:29:11.743 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:29:12.038 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:29:12.041 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-18T12:29:12.051 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-09-18T12:29:11.965145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":2980284,"kb_used_data":6692,"kb_used_omap":16,"kb_used_meta":2973423,"kb_avail":1045595716,"statfs":{"total":1073741824000,"available":1070690013184,"internally_reserved":0,"allocated":6852608,"data_stored":3177332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17040,"internal_metadata":3044785520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.719144"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T12:29:07.145047+0000","last_change":"2024-09-18T12:28:57.205389+0000","last_active":"2024-09-18T12:29:07.145047+0000","last_peered":"2024-09-18T12:29:07.145047+0000","last_clean":"2024-09-18T12:29:07.145047+0000","last_became_active":"2024-09-18T12:28:57.205005+0000","last_became_peered":"2024-09-18T12:28:57.205005+0000","last_unstale":"2024-09-18T12:29:07.145047+0000","last_undegraded":"2024-09-18T12:29:07.145047+0000","last_fullsized":"2024-09-18T12:29:07.145047+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:41:06.141977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050383899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":65,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T12:29:07.144011+0000","last_change":"2024-09-18T12:28:58.636245+0000","last_active":"2024-09-18T12:29:07.144011+0000","last_peered":"2024-09-18T12:29:07.144011+0000","last_clean":"2024-09-18T12:29:07.144011+0000","last_became_active":"2024-09-18T12:28:58.635680+0000","last_became_peered":"2024-09-18T12:28:58.635680+0000","last_unstale":"2024-09-18T12:29:07.144011+0000","last_undegraded":"2024-09-18T12:29:07.144011+0000","last_fullsized":"2024-09-18T12:29:07.144011+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:16:32.931305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058294300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":87,"reported_epoch":61,"state":"active+undersized+wait","last_fresh":"2024-09-18T12:29:07.253556+0000","last_change":"2024-09-18T12:29:07.253308+0000","last_active":"2024-09-18T12:29:07.253556+0000","last_peered":"2024-09-18T12:29:07.253556+0000","last_clean":"2024-09-18T12:29:04.235868+0000","last_became_active":"2024-09-18T12:29:07.253308+0000","last_became_peered":"2024-09-18T12:29:07.253308+0000","last_unstale":"2024-09-18T12:29:07.253556+0000","last_undegraded":"2024-09-18T12:29:07.253556+0000","last_fullsized":"2024-09-18T12:29:07.251829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T21:23:12.554336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059182099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-18T12:29:07.253738+0000","last_change":"2024-09-18T12:29:07.253587+0000","last_active":"2024-09-18T12:29:07.253738+0000","last_peered":"2024-09-18T12:29:07.253738+0000","last_clean":"2024-09-18T12:28:51.331008+0000","last_became_active":"2024-09-18T12:29:07.253587+0000","last_became_peered":"2024-09-18T12:29:07.253587+0000","last_unstale":"2024-09-18T12:29:07.253738+0000","last_undegraded":"2024-09-18T12:29:07.253738+0000","last_fullsized":"2024-09-18T12:29:07.252315+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:51:54.090054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"19'1","reported_seq":74,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-18T12:29:07.255619+0000","last_change":"2024-09-18T12:29:07.255482+0000","last_active":"2024-09-18T12:29:07.255619+0000","last_peered":"2024-09-18T12:29:07.255619+0000","last_clean":"2024-09-18T12:29:06.904833+0000","last_became_active":"2024-09-18T12:29:07.255482+0000","last_became_peered":"2024-09-18T12:29:07.255482+0000","last_unstale":"2024-09-18T12:29:07.255619+0000","last_undegraded":"2024-09-18T12:29:07.254276+0000","last_fullsized":"2024-09-18T12:29:07.254072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T20:45:11.014769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"21'2","reported_seq":73,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-18T12:29:07.254398+0000","last_change":"2024-09-18T12:29:07.254331+0000","last_active":"2024-09-18T12:29:07.254398+0000","last_peered":"2024-09-18T12:29:07.254398+0000","last_clean":"2024-09-18T12:29:05.236987+0000","last_became_active":"2024-09-18T12:29:07.254331+0000","last_became_peered":"2024-09-18T12:29:07.254331+0000","last_unstale":"2024-09-18T12:29:07.254398+0000","last_undegraded":"2024-09-18T12:29:07.253254+0000","last_fullsized":"2024-09-18T12:29:07.252974+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:13:31.942117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00192884,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T12:29:04.242636+0000","last_change":"2024-09-18T12:28:59.609508+0000","last_active":"2024-09-18T12:29:04.242636+0000","last_peered":"2024-09-18T12:29:04.242636+0000","last_clean":"2024-09-18T12:29:04.242636+0000","last_became_active":"2024-09-18T12:28:59.608964+0000","last_became_peered":"2024-09-18T12:28:59.608964+0000","last_unstale":"2024-09-18T12:29:04.242636+0000","last_undegraded":"2024-09-18T12:29:04.242636+0000","last_fullsized":"2024-09-18T12:29:04.242636+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076440299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":63,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-18T12:29:05.445453+0000","last_change":"2024-09-18T12:28:57.204248+0000","last_active":"2024-09-18T12:29:05.445453+0000","last_peered":"2024-09-18T12:29:05.445453+0000","last_clean":"2024-09-18T12:29:05.445453+0000","last_became_active":"2024-09-18T12:28:57.203688+0000","last_became_peered":"2024-09-18T12:28:57.203688+0000","last_unstale":"2024-09-18T12:29:05.445453+0000","last_undegraded":"2024-09-18T12:29:05.445453+0000","last_fullsized":"2024-09-18T12:29:05.445453+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":42,"seq":180388626456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298048,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559552,"statfs":{"total":107374182400,"available":107068981248,"internally_reserved":0,"allocated":704512,"data_stored":330675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.73199999999999998}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.90400000000000003}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.0800000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.77200000000000002}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":1.143},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.3180000000000001}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":1.349}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.401}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.605}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.8720000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.4850000000000001}]}]},{"osd":8,"up_from":50,"seq":214748364824,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298052,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559548,"statfs":{"total":107374182400,"available":107068977152,"internally_reserved":0,"allocated":704512,"data_stored":330675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.095}]},{"osd":1,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.95799999999999996}]},{"osd":2,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":2.0089999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":1.1839999999999999}]},{"osd":3,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.1399999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.712},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.9750000000000001}]},{"osd":5,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":2.3620000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.244},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":2.4380000000000002}]},{"osd":7,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":2.069},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.819}]},{"osd":9,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":2.4889999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.77}]}]},{"osd":7,"up_from":52,"seq":223338299416,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298032,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559568,"statfs":{"total":107374182400,"available":107068997632,"internally_reserved":0,"allocated":692224,"data_stored":322969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":1.7110000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.532}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.244},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.2869999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.83299999999999996}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.014},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":1.194}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.7429999999999999,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.484}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.3700000000000001,"5min":3.3700000000000001,"15min":3.3700000000000001},"last":1.103},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.1539999999999999}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.593},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.351}]}]},{"osd":6,"up_from":51,"seq":219043332120,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298020,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559580,"statfs":{"total":107374182400,"available":107069009920,"internally_reserved":0,"allocated":679936,"data_stored":315245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.70199999999999996}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.80200000000000005}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.92000000000000004}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.427},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.0529999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.5189999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.554},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.169}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.752},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.365}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.661}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.6950000000000001}]}]},{"osd":5,"up_from":50,"seq":214748364824,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298024,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559576,"statfs":{"total":107374182400,"available":107069005824,"internally_reserved":0,"allocated":679936,"data_stored":315245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":1.5069999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.095}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.448},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.98999999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.78}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.1970000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.9610000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.6180000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.8969999999999998,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.901}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":1.734},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.296}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.651},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.228}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":2.008}]}]},{"osd":4,"up_from":50,"seq":214748364824,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298028,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559572,"statfs":{"total":107374182400,"available":107069001728,"internally_reserved":0,"allocated":684032,"data_stored":315264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.95099999999999996}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.3220000000000001}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.89400000000000002}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.45}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.526}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.3859999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.165},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.851}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.944},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.712}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.6339999999999999}]}]},{"osd":3,"up_from":50,"seq":214748364824,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298012,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559588,"statfs":{"total":107374182400,"available":107069018112,"internally_reserved":0,"allocated":667648,"data_stored":304861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.61899999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.175},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.82799999999999996}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.86299999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.6080000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.0049999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.484},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.8140000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.395},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.75}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.278},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.659}]}]},{"osd":2,"up_from":50,"seq":214748364824,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298036,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559564,"statfs":{"total":107374182400,"available":107068993536,"internally_reserved":0,"allocated":692224,"data_stored":322969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.73399999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":1.0740000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.79200000000000004}]},{"osd":4,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.774}]},{"osd":5,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.831},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.1080000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.6519999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.8720000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.8500000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.8049999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.9470000000000001}]}]},{"osd":1,"up_from":0,"seq":24,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298024,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559576,"statfs":{"total":107374182400,"available":107069005824,"internally_reserved":0,"allocated":679936,"data_stored":314568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.80400000000000005}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.363},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.82299999999999995}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.573}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.1319999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.216},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4340000000000002,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.4650000000000001}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.425}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.266},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.1930000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:22 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.3999999999999999}]}]},{"osd":0,"up_from":50,"seq":214748364824,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298008,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559592,"statfs":{"total":107374182400,"available":107069022208,"internally_reserved":0,"allocated":667648,"data_stored":304861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.93500000000000005}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.72299999999999998}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.4180000000000001,"5min":7.4180000000000001,"15min":7.4180000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":1.153}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.768}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.518},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":1.47}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":6.3280000000000003,"5min":6.3280000000000003,"15min":6.3280000000000003},"last":2.0339999999999998},{"interface":"front","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":1.845}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":1.597},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.359}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.571},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.6830000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:29:12.054 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:29:12.333 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:29:12.336 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-18T12:29:12.346 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-09-18T12:29:11.965145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":2980284,"kb_used_data":6692,"kb_used_omap":16,"kb_used_meta":2973423,"kb_avail":1045595716,"statfs":{"total":1073741824000,"available":1070690013184,"internally_reserved":0,"allocated":6852608,"data_stored":3177332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17040,"internal_metadata":3044785520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.719144"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T12:29:07.145047+0000","last_change":"2024-09-18T12:28:57.205389+0000","last_active":"2024-09-18T12:29:07.145047+0000","last_peered":"2024-09-18T12:29:07.145047+0000","last_clean":"2024-09-18T12:29:07.145047+0000","last_became_active":"2024-09-18T12:28:57.205005+0000","last_became_peered":"2024-09-18T12:28:57.205005+0000","last_unstale":"2024-09-18T12:29:07.145047+0000","last_undegraded":"2024-09-18T12:29:07.145047+0000","last_fullsized":"2024-09-18T12:29:07.145047+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:41:06.141977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050383899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":65,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T12:29:07.144011+0000","last_change":"2024-09-18T12:28:58.636245+0000","last_active":"2024-09-18T12:29:07.144011+0000","last_peered":"2024-09-18T12:29:07.144011+0000","last_clean":"2024-09-18T12:29:07.144011+0000","last_became_active":"2024-09-18T12:28:58.635680+0000","last_became_peered":"2024-09-18T12:28:58.635680+0000","last_unstale":"2024-09-18T12:29:07.144011+0000","last_undegraded":"2024-09-18T12:29:07.144011+0000","last_fullsized":"2024-09-18T12:29:07.144011+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:16:32.931305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058294300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":87,"reported_epoch":61,"state":"active+undersized+wait","last_fresh":"2024-09-18T12:29:07.253556+0000","last_change":"2024-09-18T12:29:07.253308+0000","last_active":"2024-09-18T12:29:07.253556+0000","last_peered":"2024-09-18T12:29:07.253556+0000","last_clean":"2024-09-18T12:29:04.235868+0000","last_became_active":"2024-09-18T12:29:07.253308+0000","last_became_peered":"2024-09-18T12:29:07.253308+0000","last_unstale":"2024-09-18T12:29:07.253556+0000","last_undegraded":"2024-09-18T12:29:07.253556+0000","last_fullsized":"2024-09-18T12:29:07.251829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T21:23:12.554336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059182099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-18T12:29:07.253738+0000","last_change":"2024-09-18T12:29:07.253587+0000","last_active":"2024-09-18T12:29:07.253738+0000","last_peered":"2024-09-18T12:29:07.253738+0000","last_clean":"2024-09-18T12:28:51.331008+0000","last_became_active":"2024-09-18T12:29:07.253587+0000","last_became_peered":"2024-09-18T12:29:07.253587+0000","last_unstale":"2024-09-18T12:29:07.253738+0000","last_undegraded":"2024-09-18T12:29:07.253738+0000","last_fullsized":"2024-09-18T12:29:07.252315+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:51:54.090054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"19'1","reported_seq":74,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-18T12:29:07.255619+0000","last_change":"2024-09-18T12:29:07.255482+0000","last_active":"2024-09-18T12:29:07.255619+0000","last_peered":"2024-09-18T12:29:07.255619+0000","last_clean":"2024-09-18T12:29:06.904833+0000","last_became_active":"2024-09-18T12:29:07.255482+0000","last_became_peered":"2024-09-18T12:29:07.255482+0000","last_unstale":"2024-09-18T12:29:07.255619+0000","last_undegraded":"2024-09-18T12:29:07.254276+0000","last_fullsized":"2024-09-18T12:29:07.254072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T20:45:11.014769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"21'2","reported_seq":73,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-18T12:29:07.254398+0000","last_change":"2024-09-18T12:29:07.254331+0000","last_active":"2024-09-18T12:29:07.254398+0000","last_peered":"2024-09-18T12:29:07.254398+0000","last_clean":"2024-09-18T12:29:05.236987+0000","last_became_active":"2024-09-18T12:29:07.254331+0000","last_became_peered":"2024-09-18T12:29:07.254331+0000","last_unstale":"2024-09-18T12:29:07.254398+0000","last_undegraded":"2024-09-18T12:29:07.253254+0000","last_fullsized":"2024-09-18T12:29:07.252974+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:13:31.942117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00192884,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T12:29:04.242636+0000","last_change":"2024-09-18T12:28:59.609508+0000","last_active":"2024-09-18T12:29:04.242636+0000","last_peered":"2024-09-18T12:29:04.242636+0000","last_clean":"2024-09-18T12:29:04.242636+0000","last_became_active":"2024-09-18T12:28:59.608964+0000","last_became_peered":"2024-09-18T12:28:59.608964+0000","last_unstale":"2024-09-18T12:29:04.242636+0000","last_undegraded":"2024-09-18T12:29:04.242636+0000","last_fullsized":"2024-09-18T12:29:04.242636+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076440299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":63,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-18T12:29:05.445453+0000","last_change":"2024-09-18T12:28:57.204248+0000","last_active":"2024-09-18T12:29:05.445453+0000","last_peered":"2024-09-18T12:29:05.445453+0000","last_clean":"2024-09-18T12:29:05.445453+0000","last_became_active":"2024-09-18T12:28:57.203688+0000","last_became_peered":"2024-09-18T12:28:57.203688+0000","last_unstale":"2024-09-18T12:29:05.445453+0000","last_undegraded":"2024-09-18T12:29:05.445453+0000","last_fullsized":"2024-09-18T12:29:05.445453+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":42,"seq":180388626456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298048,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559552,"statfs":{"total":107374182400,"available":107068981248,"internally_reserved":0,"allocated":704512,"data_stored":330675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.73199999999999998}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.90400000000000003}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.0800000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.77200000000000002}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":1.143},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.3180000000000001}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":1.349}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.401}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.605}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.8720000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.4850000000000001}]}]},{"osd":8,"up_from":50,"seq":214748364824,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298052,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559548,"statfs":{"total":107374182400,"available":107068977152,"internally_reserved":0,"allocated":704512,"data_stored":330675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.095}]},{"osd":1,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.95799999999999996}]},{"osd":2,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":2.0089999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":1.1839999999999999}]},{"osd":3,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.1399999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.712},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.9750000000000001}]},{"osd":5,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":2.3620000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.244},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":2.4380000000000002}]},{"osd":7,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":2.069},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.819}]},{"osd":9,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":2.4889999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.77}]}]},{"osd":7,"up_from":52,"seq":223338299416,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298032,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559568,"statfs":{"total":107374182400,"available":107068997632,"internally_reserved":0,"allocated":692224,"data_stored":322969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":1.7110000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.532}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.244},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.2869999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.83299999999999996}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.014},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":1.194}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.7429999999999999,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.484}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.3700000000000001,"5min":3.3700000000000001,"15min":3.3700000000000001},"last":1.103},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.1539999999999999}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.593},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.351}]}]},{"osd":6,"up_from":51,"seq":219043332120,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298020,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559580,"statfs":{"total":107374182400,"available":107069009920,"internally_reserved":0,"allocated":679936,"data_stored":315245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.70199999999999996}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.80200000000000005}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.92000000000000004}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.427},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.0529999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.5189999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.554},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.169}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.752},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.365}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.661}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.6950000000000001}]}]},{"osd":5,"up_from":50,"seq":214748364824,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298024,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559576,"statfs":{"total":107374182400,"available":107069005824,"internally_reserved":0,"allocated":679936,"data_stored":315245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":1.5069999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.095}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.448},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.98999999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.78}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.1970000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.9610000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.6180000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.8969999999999998,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.901}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":1.734},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.296}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.651},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.228}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":2.008}]}]},{"osd":4,"up_from":50,"seq":214748364824,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298028,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559572,"statfs":{"total":107374182400,"available":107069001728,"internally_reserved":0,"allocated":684032,"data_stored":315264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.95099999999999996}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.3220000000000001}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.89400000000000002}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.45}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.526}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.3859999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.165},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.851}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.944},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.712}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.6339999999999999}]}]},{"osd":3,"up_from":50,"seq":214748364824,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298012,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559588,"statfs":{"total":107374182400,"available":107069018112,"internally_reserved":0,"allocated":667648,"data_stored":304861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.61899999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.175},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.82799999999999996}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.86299999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.6080000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.0049999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.484},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.8140000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.395},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.75}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.278},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.659}]}]},{"osd":2,"up_from":50,"seq":214748364824,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298036,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559564,"statfs":{"total":107374182400,"available":107068993536,"internally_reserved":0,"allocated":692224,"data_stored":322969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.73399999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":1.0740000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.79200000000000004}]},{"osd":4,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.774}]},{"osd":5,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.831},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.1080000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.6519999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.8720000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.8500000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.8049999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.9470000000000001}]}]},{"osd":1,"up_from":0,"seq":24,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298024,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559576,"statfs":{"total":107374182400,"available":107069005824,"internally_reserved":0,"allocated":679936,"data_stored":314568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.80400000000000005}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.363},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.82299999999999995}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.573}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.1319999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.216},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4340000000000002,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.4650000000000001}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.425}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.266},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.1930000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:22 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.3999999999999999}]}]},{"osd":0,"up_from":50,"seq":214748364824,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298008,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559592,"statfs":{"total":107374182400,"available":107069022208,"internally_reserved":0,"allocated":667648,"data_stored":304861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.93500000000000005}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.72299999999999998}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.4180000000000001,"5min":7.4180000000000001,"15min":7.4180000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":1.153}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.768}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.518},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":1.47}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":6.3280000000000003,"5min":6.3280000000000003,"15min":6.3280000000000003},"last":2.0339999999999998},{"interface":"front","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":1.845}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":1.597},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.359}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.571},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.6830000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:29:12.349 INFO:tasks.ceph.ceph_manager.ceph:PG 1.5 is not active+clean 2024-09-18T12:29:12.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.5', 'version': "0'0", 'reported_seq': 87, 'reported_epoch': 61, 'state': 'active+undersized+wait', 'last_fresh': '2024-09-18T12:29:07.253556+0000', 'last_change': '2024-09-18T12:29:07.253308+0000', 'last_active': '2024-09-18T12:29:07.253556+0000', 'last_peered': '2024-09-18T12:29:07.253556+0000', 'last_clean': '2024-09-18T12:29:04.235868+0000', 'last_became_active': '2024-09-18T12:29:07.253308+0000', 'last_became_peered': '2024-09-18T12:29:07.253308+0000', 'last_unstale': '2024-09-18T12:29:07.253556+0000', 'last_undegraded': '2024-09-18T12:29:07.253556+0000', 'last_fullsized': '2024-09-18T12:29:07.251829+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 51, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-18T12:27:21.480189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-18T12:27:21.480189+0000', 'last_clean_scrub_stamp': '2024-09-18T12:27:21.480189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-19T21:23:12.554336+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.000591821, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9], 'acting': [9], 'avail_no_missing': ['9'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2024-09-18T12:29:12.349 INFO:tasks.ceph.ceph_manager.ceph:PG 1.4 is not active+clean 2024-09-18T12:29:12.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.4', 'version': "0'0", 'reported_seq': 49, 'reported_epoch': 61, 'state': 'active+undersized', 'last_fresh': '2024-09-18T12:29:07.253738+0000', 'last_change': '2024-09-18T12:29:07.253587+0000', 'last_active': '2024-09-18T12:29:07.253738+0000', 'last_peered': '2024-09-18T12:29:07.253738+0000', 'last_clean': '2024-09-18T12:28:51.331008+0000', 'last_became_active': '2024-09-18T12:29:07.253587+0000', 'last_became_peered': '2024-09-18T12:29:07.253587+0000', 'last_unstale': '2024-09-18T12:29:07.253738+0000', 'last_undegraded': '2024-09-18T12:29:07.253738+0000', 'last_fullsized': '2024-09-18T12:29:07.252315+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 52, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-18T12:27:21.480189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-18T12:27:21.480189+0000', 'last_clean_scrub_stamp': '2024-09-18T12:27:21.480189+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-19T13:51:54.090054+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6], 'acting': [6], 'avail_no_missing': ['6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-18T12:29:12.349 INFO:tasks.ceph.ceph_manager.ceph:PG 1.3 is not active+clean 2024-09-18T12:29:12.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.3', 'version': "19'1", 'reported_seq': 74, 'reported_epoch': 61, 'state': 'active+undersized+degraded', 'last_fresh': '2024-09-18T12:29:07.255619+0000', 'last_change': '2024-09-18T12:29:07.255482+0000', 'last_active': '2024-09-18T12:29:07.255619+0000', 'last_peered': '2024-09-18T12:29:07.255619+0000', 'last_clean': '2024-09-18T12:29:06.904833+0000', 'last_became_active': '2024-09-18T12:29:07.255482+0000', 'last_became_peered': '2024-09-18T12:29:07.255482+0000', 'last_unstale': '2024-09-18T12:29:07.255619+0000', 'last_undegraded': '2024-09-18T12:29:07.254276+0000', 'last_fullsized': '2024-09-18T12:29:07.254072+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 51, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-18T12:27:21.480189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-18T12:27:21.480189+0000', 'last_clean_scrub_stamp': '2024-09-18T12:27:21.480189+0000', 'objects_scrubbed': 0, 'log_size': 1, 'log_dups_size': 0, 'ondisk_log_size': 1, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-19T20:45:11.014769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 2, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 1, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3], 'acting': [3], 'avail_no_missing': ['3'], 'object_location_counts': [{'shards': '3', 'objects': 1}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-18T12:29:12.349 INFO:tasks.ceph.ceph_manager.ceph:PG 1.2 is not active+clean 2024-09-18T12:29:12.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.2', 'version': "21'2", 'reported_seq': 73, 'reported_epoch': 61, 'state': 'active+undersized+degraded', 'last_fresh': '2024-09-18T12:29:07.254398+0000', 'last_change': '2024-09-18T12:29:07.254331+0000', 'last_active': '2024-09-18T12:29:07.254398+0000', 'last_peered': '2024-09-18T12:29:07.254398+0000', 'last_clean': '2024-09-18T12:29:05.236987+0000', 'last_became_active': '2024-09-18T12:29:07.254331+0000', 'last_became_peered': '2024-09-18T12:29:07.254331+0000', 'last_unstale': '2024-09-18T12:29:07.254398+0000', 'last_undegraded': '2024-09-18T12:29:07.253254+0000', 'last_fullsized': '2024-09-18T12:29:07.252974+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 51, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-18T12:27:21.480189+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-18T12:27:21.480189+0000', 'last_clean_scrub_stamp': '2024-09-18T12:27:21.480189+0000', 'objects_scrubbed': 0, 'log_size': 2, 'log_dups_size': 0, 'ondisk_log_size': 2, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-19T14:13:31.942117+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.00192884, 'stat_sum': {'num_bytes': 19, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 2, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 2, 'num_write_kb': 2, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 1, 'num_bytes_recovered': 19, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4], 'acting': [4], 'avail_no_missing': ['4'], 'object_location_counts': [{'shards': '4', 'objects': 1}], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-18T12:29:12.350 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-18T12:29:12.693 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:29:12.693 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"d50b3a4e-0c54-4de8-95b7-7e9a6d6a5fb8","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noout flag(s) set","count":5},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded","count":2},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":123,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":64,"num_osds":10,"num_up_osds":10,"osd_up_since":1726662550,"num_in_osds":10,"osd_in_since":1726662431,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":4},{"state_name":"active+undersized+degraded","count":2},{"state_name":"active+undersized+wait","count":1},{"state_name":"active+undersized","count":1}],"num_pgs":8,"num_pools":1,"num_objects":2,"data_bytes":19,"bytes_used":3051810816,"bytes_avail":1070690013184,"bytes_total":1073741824000,"degraded_objects":2,"degraded_total":4,"degraded_ratio":0.5},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-18T12:28:19.951607+0000","services":{}},"progress_events":{}} 2024-09-18T12:29:12.706 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-18T12:29:12.706 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:29:13.004 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:29:13.007 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-18T12:29:13.019 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-09-18T12:29:11.965145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":2980284,"kb_used_data":6692,"kb_used_omap":16,"kb_used_meta":2973423,"kb_avail":1045595716,"statfs":{"total":1073741824000,"available":1070690013184,"internally_reserved":0,"allocated":6852608,"data_stored":3177332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17040,"internal_metadata":3044785520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.719144"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T12:29:07.145047+0000","last_change":"2024-09-18T12:28:57.205389+0000","last_active":"2024-09-18T12:29:07.145047+0000","last_peered":"2024-09-18T12:29:07.145047+0000","last_clean":"2024-09-18T12:29:07.145047+0000","last_became_active":"2024-09-18T12:28:57.205005+0000","last_became_peered":"2024-09-18T12:28:57.205005+0000","last_unstale":"2024-09-18T12:29:07.145047+0000","last_undegraded":"2024-09-18T12:29:07.145047+0000","last_fullsized":"2024-09-18T12:29:07.145047+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:41:06.141977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050383899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":65,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T12:29:07.144011+0000","last_change":"2024-09-18T12:28:58.636245+0000","last_active":"2024-09-18T12:29:07.144011+0000","last_peered":"2024-09-18T12:29:07.144011+0000","last_clean":"2024-09-18T12:29:07.144011+0000","last_became_active":"2024-09-18T12:28:58.635680+0000","last_became_peered":"2024-09-18T12:28:58.635680+0000","last_unstale":"2024-09-18T12:29:07.144011+0000","last_undegraded":"2024-09-18T12:29:07.144011+0000","last_fullsized":"2024-09-18T12:29:07.144011+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:16:32.931305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058294300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":87,"reported_epoch":61,"state":"active+undersized+wait","last_fresh":"2024-09-18T12:29:07.253556+0000","last_change":"2024-09-18T12:29:07.253308+0000","last_active":"2024-09-18T12:29:07.253556+0000","last_peered":"2024-09-18T12:29:07.253556+0000","last_clean":"2024-09-18T12:29:04.235868+0000","last_became_active":"2024-09-18T12:29:07.253308+0000","last_became_peered":"2024-09-18T12:29:07.253308+0000","last_unstale":"2024-09-18T12:29:07.253556+0000","last_undegraded":"2024-09-18T12:29:07.253556+0000","last_fullsized":"2024-09-18T12:29:07.251829+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T21:23:12.554336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059182099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":61,"state":"active+undersized","last_fresh":"2024-09-18T12:29:07.253738+0000","last_change":"2024-09-18T12:29:07.253587+0000","last_active":"2024-09-18T12:29:07.253738+0000","last_peered":"2024-09-18T12:29:07.253738+0000","last_clean":"2024-09-18T12:28:51.331008+0000","last_became_active":"2024-09-18T12:29:07.253587+0000","last_became_peered":"2024-09-18T12:29:07.253587+0000","last_unstale":"2024-09-18T12:29:07.253738+0000","last_undegraded":"2024-09-18T12:29:07.253738+0000","last_fullsized":"2024-09-18T12:29:07.252315+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:51:54.090054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"19'1","reported_seq":74,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-18T12:29:07.255619+0000","last_change":"2024-09-18T12:29:07.255482+0000","last_active":"2024-09-18T12:29:07.255619+0000","last_peered":"2024-09-18T12:29:07.255619+0000","last_clean":"2024-09-18T12:29:06.904833+0000","last_became_active":"2024-09-18T12:29:07.255482+0000","last_became_peered":"2024-09-18T12:29:07.255482+0000","last_unstale":"2024-09-18T12:29:07.255619+0000","last_undegraded":"2024-09-18T12:29:07.254276+0000","last_fullsized":"2024-09-18T12:29:07.254072+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T20:45:11.014769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"21'2","reported_seq":73,"reported_epoch":61,"state":"active+undersized+degraded","last_fresh":"2024-09-18T12:29:07.254398+0000","last_change":"2024-09-18T12:29:07.254331+0000","last_active":"2024-09-18T12:29:07.254398+0000","last_peered":"2024-09-18T12:29:07.254398+0000","last_clean":"2024-09-18T12:29:05.236987+0000","last_became_active":"2024-09-18T12:29:07.254331+0000","last_became_peered":"2024-09-18T12:29:07.254331+0000","last_unstale":"2024-09-18T12:29:07.254398+0000","last_undegraded":"2024-09-18T12:29:07.253254+0000","last_fullsized":"2024-09-18T12:29:07.252974+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:13:31.942117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00192884,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-18T12:29:04.242636+0000","last_change":"2024-09-18T12:28:59.609508+0000","last_active":"2024-09-18T12:29:04.242636+0000","last_peered":"2024-09-18T12:29:04.242636+0000","last_clean":"2024-09-18T12:29:04.242636+0000","last_became_active":"2024-09-18T12:28:59.608964+0000","last_became_peered":"2024-09-18T12:28:59.608964+0000","last_unstale":"2024-09-18T12:29:04.242636+0000","last_undegraded":"2024-09-18T12:29:04.242636+0000","last_fullsized":"2024-09-18T12:29:04.242636+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076440299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":63,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-18T12:29:05.445453+0000","last_change":"2024-09-18T12:28:57.204248+0000","last_active":"2024-09-18T12:29:05.445453+0000","last_peered":"2024-09-18T12:29:05.445453+0000","last_clean":"2024-09-18T12:29:05.445453+0000","last_became_active":"2024-09-18T12:28:57.203688+0000","last_became_peered":"2024-09-18T12:28:57.203688+0000","last_unstale":"2024-09-18T12:29:05.445453+0000","last_undegraded":"2024-09-18T12:29:05.445453+0000","last_fullsized":"2024-09-18T12:29:05.445453+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":42,"seq":180388626456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298048,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559552,"statfs":{"total":107374182400,"available":107068981248,"internally_reserved":0,"allocated":704512,"data_stored":330675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.73199999999999998}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.90400000000000003}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.0800000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.77200000000000002}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":1.143},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.3180000000000001}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":1.349}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.401}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.605}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.8720000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.4850000000000001}]}]},{"osd":8,"up_from":50,"seq":214748364824,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298052,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559548,"statfs":{"total":107374182400,"available":107068977152,"internally_reserved":0,"allocated":704512,"data_stored":330675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.095}]},{"osd":1,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.95799999999999996}]},{"osd":2,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":2.0089999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":1.1839999999999999}]},{"osd":3,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.1399999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.712},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.9750000000000001}]},{"osd":5,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":2.3620000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.244},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":2.4380000000000002}]},{"osd":7,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":2.069},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.819}]},{"osd":9,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":2.4889999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.77}]}]},{"osd":7,"up_from":52,"seq":223338299416,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298032,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559568,"statfs":{"total":107374182400,"available":107068997632,"internally_reserved":0,"allocated":692224,"data_stored":322969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":1.7110000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.532}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.244},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.2869999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.83299999999999996}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.014},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":1.194}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.7429999999999999,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.484}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.3700000000000001,"5min":3.3700000000000001,"15min":3.3700000000000001},"last":1.103},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.1539999999999999}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.593},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.351}]}]},{"osd":6,"up_from":51,"seq":219043332120,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298020,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559580,"statfs":{"total":107374182400,"available":107069009920,"internally_reserved":0,"allocated":679936,"data_stored":315245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.70199999999999996}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.80200000000000005}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.92000000000000004}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.427},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.0529999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.5189999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.554},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.169}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.752},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.365}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.661}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.6950000000000001}]}]},{"osd":5,"up_from":50,"seq":214748364824,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298024,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559576,"statfs":{"total":107374182400,"available":107069005824,"internally_reserved":0,"allocated":679936,"data_stored":315245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":1.5069999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.095}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.448},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.98999999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.78}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.1970000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.9610000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.6180000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.8969999999999998,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.901}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":1.734},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.296}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.651},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.228}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":2.008}]}]},{"osd":4,"up_from":50,"seq":214748364824,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298028,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559572,"statfs":{"total":107374182400,"available":107069001728,"internally_reserved":0,"allocated":684032,"data_stored":315264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.95099999999999996}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.3220000000000001}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.89400000000000002}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.45}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.526}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.3859999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.165},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.851}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.944},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.712}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.6339999999999999}]}]},{"osd":3,"up_from":50,"seq":214748364824,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298012,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559588,"statfs":{"total":107374182400,"available":107069018112,"internally_reserved":0,"allocated":667648,"data_stored":304861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.61899999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.175},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.82799999999999996}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.86299999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.6080000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.0049999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.484},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.8140000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.395},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.75}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.278},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.659}]}]},{"osd":2,"up_from":50,"seq":214748364824,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298036,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559564,"statfs":{"total":107374182400,"available":107068993536,"internally_reserved":0,"allocated":692224,"data_stored":322969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.73399999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":1.0740000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.79200000000000004}]},{"osd":4,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.774}]},{"osd":5,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.831},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.1080000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.6519999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.8720000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.8500000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.8049999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.9470000000000001}]}]},{"osd":1,"up_from":0,"seq":24,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298024,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559576,"statfs":{"total":107374182400,"available":107069005824,"internally_reserved":0,"allocated":679936,"data_stored":314568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.80400000000000005}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.363},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.82299999999999995}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.573}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.1319999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.216},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4340000000000002,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.4650000000000001}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.425}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.266},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.1930000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:22 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.3999999999999999}]}]},{"osd":0,"up_from":50,"seq":214748364824,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298008,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559592,"statfs":{"total":107374182400,"available":107069022208,"internally_reserved":0,"allocated":667648,"data_stored":304861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.93500000000000005}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.89100000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.72299999999999998}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.4180000000000001,"5min":7.4180000000000001,"15min":7.4180000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":1.153}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.768}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.518},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":1.47}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":6.3280000000000003,"5min":6.3280000000000003,"15min":6.3280000000000003},"last":2.0339999999999998},{"interface":"front","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":1.845}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":1.597},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.359}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.571},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.6830000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:29:16.024 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:29:16.329 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:29:16.331 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-18T12:29:16.344 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-18T12:29:15.966178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":2980848,"kb_used_data":7244,"kb_used_omap":16,"kb_used_meta":2973423,"kb_avail":1045595152,"statfs":{"total":1073741824000,"available":1070689435648,"internally_reserved":0,"allocated":7417856,"data_stored":3544032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17040,"internal_metadata":3044785520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.709872"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":51,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-18T12:29:10.589376+0000","last_change":"2024-09-18T12:28:57.205389+0000","last_active":"2024-09-18T12:29:10.589376+0000","last_peered":"2024-09-18T12:29:10.589376+0000","last_clean":"2024-09-18T12:29:10.589376+0000","last_became_active":"2024-09-18T12:28:57.205005+0000","last_became_peered":"2024-09-18T12:28:57.205005+0000","last_unstale":"2024-09-18T12:29:10.589376+0000","last_undegraded":"2024-09-18T12:29:10.589376+0000","last_fullsized":"2024-09-18T12:29:10.589376+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:41:06.141977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050383899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":67,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-18T12:29:10.750966+0000","last_change":"2024-09-18T12:28:58.636245+0000","last_active":"2024-09-18T12:29:10.750966+0000","last_peered":"2024-09-18T12:29:10.750966+0000","last_clean":"2024-09-18T12:29:10.750966+0000","last_became_active":"2024-09-18T12:28:58.635680+0000","last_became_peered":"2024-09-18T12:28:58.635680+0000","last_unstale":"2024-09-18T12:29:10.750966+0000","last_undegraded":"2024-09-18T12:29:10.750966+0000","last_fullsized":"2024-09-18T12:29:10.750966+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:16:32.931305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058294300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:11.280442+0000","last_change":"2024-09-18T12:29:11.280442+0000","last_active":"2024-09-18T12:29:11.280442+0000","last_peered":"2024-09-18T12:29:11.280442+0000","last_clean":"2024-09-18T12:29:11.280442+0000","last_became_active":"2024-09-18T12:29:11.280008+0000","last_became_peered":"2024-09-18T12:29:11.280008+0000","last_unstale":"2024-09-18T12:29:11.280442+0000","last_undegraded":"2024-09-18T12:29:11.280442+0000","last_fullsized":"2024-09-18T12:29:11.280442+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:37:41.136648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059182099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":66,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:11.323342+0000","last_change":"2024-09-18T12:29:11.323342+0000","last_active":"2024-09-18T12:29:11.323342+0000","last_peered":"2024-09-18T12:29:11.323342+0000","last_clean":"2024-09-18T12:29:11.323342+0000","last_became_active":"2024-09-18T12:29:11.322881+0000","last_became_peered":"2024-09-18T12:29:11.322881+0000","last_unstale":"2024-09-18T12:29:11.323342+0000","last_undegraded":"2024-09-18T12:29:11.323342+0000","last_fullsized":"2024-09-18T12:29:11.323342+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:14:45.841440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"19'1","reported_seq":85,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:11.280482+0000","last_change":"2024-09-18T12:29:11.280482+0000","last_active":"2024-09-18T12:29:11.280482+0000","last_peered":"2024-09-18T12:29:11.280482+0000","last_clean":"2024-09-18T12:29:11.280482+0000","last_became_active":"2024-09-18T12:29:11.280164+0000","last_became_peered":"2024-09-18T12:29:11.280164+0000","last_unstale":"2024-09-18T12:29:11.280482+0000","last_undegraded":"2024-09-18T12:29:11.280482+0000","last_fullsized":"2024-09-18T12:29:11.280482+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T20:24:39.185622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"21'2","reported_seq":85,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:11.279163+0000","last_change":"2024-09-18T12:29:11.279163+0000","last_active":"2024-09-18T12:29:11.279163+0000","last_peered":"2024-09-18T12:29:11.279163+0000","last_clean":"2024-09-18T12:29:11.279163+0000","last_became_active":"2024-09-18T12:29:11.278800+0000","last_became_peered":"2024-09-18T12:29:11.278800+0000","last_unstale":"2024-09-18T12:29:11.279163+0000","last_undegraded":"2024-09-18T12:29:11.279163+0000","last_fullsized":"2024-09-18T12:29:11.279163+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:45:16.479131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00192884,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-18T12:29:10.748701+0000","last_change":"2024-09-18T12:28:59.609508+0000","last_active":"2024-09-18T12:29:10.748701+0000","last_peered":"2024-09-18T12:29:10.748701+0000","last_clean":"2024-09-18T12:29:10.748701+0000","last_became_active":"2024-09-18T12:28:59.608964+0000","last_became_peered":"2024-09-18T12:28:59.608964+0000","last_unstale":"2024-09-18T12:29:10.748701+0000","last_undegraded":"2024-09-18T12:29:10.748701+0000","last_fullsized":"2024-09-18T12:29:10.748701+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076440299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":66,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-18T12:29:10.267930+0000","last_change":"2024-09-18T12:28:57.204248+0000","last_active":"2024-09-18T12:29:10.267930+0000","last_peered":"2024-09-18T12:29:10.267930+0000","last_clean":"2024-09-18T12:29:10.267930+0000","last_became_active":"2024-09-18T12:28:57.203688+0000","last_became_peered":"2024-09-18T12:28:57.203688+0000","last_unstale":"2024-09-18T12:29:10.267930+0000","last_undegraded":"2024-09-18T12:29:10.267930+0000","last_fullsized":"2024-09-18T12:29:10.267930+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":42,"seq":180388626457,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.94699999999999995}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.2749999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.2010000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.556},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.3160000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":1.171},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.6679999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":1.7410000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.254},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.3819999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.349}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.6950000000000001}]}]},{"osd":8,"up_from":50,"seq":214748364825,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.095}]},{"osd":1,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.95799999999999996}]},{"osd":2,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2909999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.56100000000000005}]},{"osd":3,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.47099999999999997}]},{"osd":4,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.272}]},{"osd":5,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.65800000000000003}]},{"osd":6,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.482}]},{"osd":7,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.498},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.1240000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.71899999999999997}]}]},{"osd":7,"up_from":52,"seq":223338299417,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.95199999999999996}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.91500000000000004}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":1.6839999999999999}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.5900000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":1.377},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":1.55}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":1.4219999999999999}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.7429999999999999,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":1.7669999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.544}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.3700000000000001,"5min":3.3700000000000001,"15min":3.3700000000000001},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":2.0150000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.522},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.712}]}]},{"osd":6,"up_from":51,"seq":219043332121,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.46300000000000002}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.0149999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.81499999999999995}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.755},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.89800000000000002}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.24}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.409}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.597},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.532}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.3640000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.1599999999999999}]}]},{"osd":5,"up_from":50,"seq":214748364825,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.78100000000000003}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.85799999999999998}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.68300000000000005}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.143},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.1719999999999999}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.8969999999999998,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.276}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":1.248},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.92800000000000005}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.875}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.3680000000000001}]}]},{"osd":4,"up_from":50,"seq":214748364825,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298088,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559512,"statfs":{"total":107374182400,"available":107068940288,"internally_reserved":0,"allocated":745472,"data_stored":354488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.85199999999999998}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.095}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.94499999999999995}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.3839999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.4339999999999999}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.579},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.7789999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.8180000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.9410000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":2.0150000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.2330000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.335},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.863}]}]},{"osd":3,"up_from":50,"seq":214748364825,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.61899999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.58899999999999997}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.89700000000000002}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.88400000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.151}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.286},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.097}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.357}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.224}]}]},{"osd":2,"up_from":50,"seq":214748364825,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.73399999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":1.0740000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.52000000000000002},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.68700000000000006}]},{"osd":4,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.621}]},{"osd":5,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.252},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.96299999999999997}]},{"osd":7,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.1200000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.222}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.087},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.157}]}]},{"osd":1,"up_from":63,"seq":270582939673,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":353792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.89400000000000002}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.68500000000000005}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.1180000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":2.1589999999999998},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.635}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.95599999999999996}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4340000000000002,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.958}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":2.2389999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.4179999999999999}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.284},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.831}]},{"osd":9,"last update":"Wed Sep 18 12:28:22 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.76},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.575}]}]},{"osd":0,"up_from":63,"seq":270582939673,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298088,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559512,"statfs":{"total":107374182400,"available":107068940288,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.878}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":4.7510000000000003},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":4.6399999999999997}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":4.0330000000000004},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":4.6909999999999998}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.4180000000000001,"5min":7.4180000000000001,"15min":7.4180000000000001},"last":2.9209999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":1.3160000000000001}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":4.7720000000000002},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":4.4189999999999996}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":4.7279999999999998},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":3.0059999999999998}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":6.3280000000000003,"5min":6.3280000000000003,"15min":6.3280000000000003},"last":3.7610000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":4.9870000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":2.4129999999999998},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":5.1509999999999998}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":4.5709999999999997},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":5.2249999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:29:16.346 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T12:29:16.346 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:29:16.634 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:29:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-18T12:29:16.647 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-18T12:29:15.966178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":2980848,"kb_used_data":7244,"kb_used_omap":16,"kb_used_meta":2973423,"kb_avail":1045595152,"statfs":{"total":1073741824000,"available":1070689435648,"internally_reserved":0,"allocated":7417856,"data_stored":3544032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17040,"internal_metadata":3044785520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.709872"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":51,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-18T12:29:10.589376+0000","last_change":"2024-09-18T12:28:57.205389+0000","last_active":"2024-09-18T12:29:10.589376+0000","last_peered":"2024-09-18T12:29:10.589376+0000","last_clean":"2024-09-18T12:29:10.589376+0000","last_became_active":"2024-09-18T12:28:57.205005+0000","last_became_peered":"2024-09-18T12:28:57.205005+0000","last_unstale":"2024-09-18T12:29:10.589376+0000","last_undegraded":"2024-09-18T12:29:10.589376+0000","last_fullsized":"2024-09-18T12:29:10.589376+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:41:06.141977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050383899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":67,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-18T12:29:10.750966+0000","last_change":"2024-09-18T12:28:58.636245+0000","last_active":"2024-09-18T12:29:10.750966+0000","last_peered":"2024-09-18T12:29:10.750966+0000","last_clean":"2024-09-18T12:29:10.750966+0000","last_became_active":"2024-09-18T12:28:58.635680+0000","last_became_peered":"2024-09-18T12:28:58.635680+0000","last_unstale":"2024-09-18T12:29:10.750966+0000","last_undegraded":"2024-09-18T12:29:10.750966+0000","last_fullsized":"2024-09-18T12:29:10.750966+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:16:32.931305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058294300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:11.280442+0000","last_change":"2024-09-18T12:29:11.280442+0000","last_active":"2024-09-18T12:29:11.280442+0000","last_peered":"2024-09-18T12:29:11.280442+0000","last_clean":"2024-09-18T12:29:11.280442+0000","last_became_active":"2024-09-18T12:29:11.280008+0000","last_became_peered":"2024-09-18T12:29:11.280008+0000","last_unstale":"2024-09-18T12:29:11.280442+0000","last_undegraded":"2024-09-18T12:29:11.280442+0000","last_fullsized":"2024-09-18T12:29:11.280442+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:37:41.136648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059182099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":66,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:11.323342+0000","last_change":"2024-09-18T12:29:11.323342+0000","last_active":"2024-09-18T12:29:11.323342+0000","last_peered":"2024-09-18T12:29:11.323342+0000","last_clean":"2024-09-18T12:29:11.323342+0000","last_became_active":"2024-09-18T12:29:11.322881+0000","last_became_peered":"2024-09-18T12:29:11.322881+0000","last_unstale":"2024-09-18T12:29:11.323342+0000","last_undegraded":"2024-09-18T12:29:11.323342+0000","last_fullsized":"2024-09-18T12:29:11.323342+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:14:45.841440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"19'1","reported_seq":85,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:11.280482+0000","last_change":"2024-09-18T12:29:11.280482+0000","last_active":"2024-09-18T12:29:11.280482+0000","last_peered":"2024-09-18T12:29:11.280482+0000","last_clean":"2024-09-18T12:29:11.280482+0000","last_became_active":"2024-09-18T12:29:11.280164+0000","last_became_peered":"2024-09-18T12:29:11.280164+0000","last_unstale":"2024-09-18T12:29:11.280482+0000","last_undegraded":"2024-09-18T12:29:11.280482+0000","last_fullsized":"2024-09-18T12:29:11.280482+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T20:24:39.185622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"21'2","reported_seq":85,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:11.279163+0000","last_change":"2024-09-18T12:29:11.279163+0000","last_active":"2024-09-18T12:29:11.279163+0000","last_peered":"2024-09-18T12:29:11.279163+0000","last_clean":"2024-09-18T12:29:11.279163+0000","last_became_active":"2024-09-18T12:29:11.278800+0000","last_became_peered":"2024-09-18T12:29:11.278800+0000","last_unstale":"2024-09-18T12:29:11.279163+0000","last_undegraded":"2024-09-18T12:29:11.279163+0000","last_fullsized":"2024-09-18T12:29:11.279163+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:45:16.479131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00192884,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-18T12:29:10.748701+0000","last_change":"2024-09-18T12:28:59.609508+0000","last_active":"2024-09-18T12:29:10.748701+0000","last_peered":"2024-09-18T12:29:10.748701+0000","last_clean":"2024-09-18T12:29:10.748701+0000","last_became_active":"2024-09-18T12:28:59.608964+0000","last_became_peered":"2024-09-18T12:28:59.608964+0000","last_unstale":"2024-09-18T12:29:10.748701+0000","last_undegraded":"2024-09-18T12:29:10.748701+0000","last_fullsized":"2024-09-18T12:29:10.748701+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076440299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":66,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-18T12:29:10.267930+0000","last_change":"2024-09-18T12:28:57.204248+0000","last_active":"2024-09-18T12:29:10.267930+0000","last_peered":"2024-09-18T12:29:10.267930+0000","last_clean":"2024-09-18T12:29:10.267930+0000","last_became_active":"2024-09-18T12:28:57.203688+0000","last_became_peered":"2024-09-18T12:28:57.203688+0000","last_unstale":"2024-09-18T12:29:10.267930+0000","last_undegraded":"2024-09-18T12:29:10.267930+0000","last_fullsized":"2024-09-18T12:29:10.267930+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":42,"seq":180388626457,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.94699999999999995}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.2749999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.2010000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.556},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.3160000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":1.171},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.6679999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":1.7410000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.254},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.3819999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.349}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.6950000000000001}]}]},{"osd":8,"up_from":50,"seq":214748364825,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.095}]},{"osd":1,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.95799999999999996}]},{"osd":2,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2909999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.56100000000000005}]},{"osd":3,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.47099999999999997}]},{"osd":4,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.272}]},{"osd":5,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.65800000000000003}]},{"osd":6,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.482}]},{"osd":7,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.498},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.1240000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.71899999999999997}]}]},{"osd":7,"up_from":52,"seq":223338299417,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.95199999999999996}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.91500000000000004}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":1.6839999999999999}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.5900000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":1.377},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":1.55}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":1.4219999999999999}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.7429999999999999,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":1.7669999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.544}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.3700000000000001,"5min":3.3700000000000001,"15min":3.3700000000000001},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":2.0150000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.522},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.712}]}]},{"osd":6,"up_from":51,"seq":219043332121,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.46300000000000002}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.0149999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.81499999999999995}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.755},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.89800000000000002}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.24}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.409}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.597},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.532}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.3640000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.1599999999999999}]}]},{"osd":5,"up_from":50,"seq":214748364825,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.51200000000000001}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.78100000000000003}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.85799999999999998}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.68300000000000005}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.143},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.1719999999999999}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.8969999999999998,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.276}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":1.248},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.92800000000000005}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.875}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.3680000000000001}]}]},{"osd":4,"up_from":50,"seq":214748364825,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298088,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559512,"statfs":{"total":107374182400,"available":107068940288,"internally_reserved":0,"allocated":745472,"data_stored":354488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.997},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.85199999999999998}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.095}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.94499999999999995}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.3839999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.4339999999999999}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.579},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.7789999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.8180000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.9410000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":2.0150000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.2330000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.335},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.863}]}]},{"osd":3,"up_from":50,"seq":214748364825,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.61899999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.58899999999999997}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.89700000000000002}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.88400000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.151}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.286},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.097}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.357}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.224}]}]},{"osd":2,"up_from":50,"seq":214748364825,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.73399999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":1.0740000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.52000000000000002},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.68700000000000006}]},{"osd":4,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.621}]},{"osd":5,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.252},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.96299999999999997}]},{"osd":7,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.1200000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.222}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.087},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.157}]}]},{"osd":1,"up_from":63,"seq":270582939673,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":353792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.89400000000000002}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.68500000000000005}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.1180000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":2.1589999999999998},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.635}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.95599999999999996}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4340000000000002,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.958}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":2.2389999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.4179999999999999}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.284},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.831}]},{"osd":9,"last update":"Wed Sep 18 12:28:22 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.76},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.575}]}]},{"osd":0,"up_from":63,"seq":270582939673,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298088,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559512,"statfs":{"total":107374182400,"available":107068940288,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.878}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":4.7510000000000003},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":4.6399999999999997}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":4.0330000000000004},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":4.6909999999999998}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.4180000000000001,"5min":7.4180000000000001,"15min":7.4180000000000001},"last":2.9209999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":1.3160000000000001}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":4.7720000000000002},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":4.4189999999999996}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":4.7279999999999998},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":3.0059999999999998}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":6.3280000000000003,"5min":6.3280000000000003,"15min":6.3280000000000003},"last":3.7610000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":4.9870000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":2.4129999999999998},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":5.1509999999999998}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":4.5709999999999997},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":5.2249999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:29:16.650 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T12:29:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:29:16.943 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":64,"fsid":"d50b3a4e-0c54-4de8-95b7-7e9a6d6a5fb8","created":"2024-09-18T12:27:09.261426+0000","modified":"2024-09-18T12:29:11.270299+0000","last_up_change":"2024-09-18T12:29:10.262084+0000","last_in_change":"2024-09-18T12:27:11.882420+0000","flags":"noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800064,"flags_set":["noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":11,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-18T12:27:21.010721+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ab74a47a-04f7-456a-bd16-4ed3646ff3c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":62,"up_from":63,"up_thru":39,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6831","nonce":25560},{"type":"v1","addr":"172.21.15.42:6834","nonce":25560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3025560},{"type":"v1","addr":"172.21.15.42:6814","nonce":3025560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6845","nonce":25560},{"type":"v1","addr":"172.21.15.42:6847","nonce":25560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6841","nonce":25560},{"type":"v1","addr":"172.21.15.42:6843","nonce":25560}]},"public_addr":"172.21.15.42:6834/25560","cluster_addr":"172.21.15.42:6814/3025560","heartbeat_back_addr":"172.21.15.42:6847/25560","heartbeat_front_addr":"172.21.15.42:6843/25560","state":["exists","up"]},{"osd":1,"uuid":"31744fc6-ab42-428f-9714-29a1c916f55e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":62,"up_from":63,"up_thru":63,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":25553},{"type":"v1","addr":"172.21.15.42:6801","nonce":25553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6837","nonce":3025553},{"type":"v1","addr":"172.21.15.42:6839","nonce":3025553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":25553},{"type":"v1","addr":"172.21.15.42:6807","nonce":25553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":25553},{"type":"v1","addr":"172.21.15.42:6805","nonce":25553}]},"public_addr":"172.21.15.42:6801/25553","cluster_addr":"172.21.15.42:6839/3025553","heartbeat_back_addr":"172.21.15.42:6807/25553","heartbeat_front_addr":"172.21.15.42:6805/25553","state":["exists","up"]},{"osd":2,"uuid":"1005aa3b-486d-454f-9902-e4e1d139cc05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":49,"up_from":50,"up_thru":0,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6864","nonce":25575},{"type":"v1","addr":"172.21.15.42:6865","nonce":25575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":1025575},{"type":"v1","addr":"172.21.15.42:6827","nonce":1025575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6870","nonce":25575},{"type":"v1","addr":"172.21.15.42:6871","nonce":25575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6868","nonce":25575},{"type":"v1","addr":"172.21.15.42:6869","nonce":25575}]},"public_addr":"172.21.15.42:6865/25575","cluster_addr":"172.21.15.42:6827/1025575","heartbeat_back_addr":"172.21.15.42:6871/25575","heartbeat_front_addr":"172.21.15.42:6869/25575","state":["exists","up"]},{"osd":3,"uuid":"5559f79d-83fa-42b3-99d8-f117f4205741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":49,"up_from":50,"up_thru":63,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":25557},{"type":"v1","addr":"172.21.15.42:6825","nonce":25557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1025557},{"type":"v1","addr":"172.21.15.42:6803","nonce":1025557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":25557},{"type":"v1","addr":"172.21.15.42:6832","nonce":25557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":25557},{"type":"v1","addr":"172.21.15.42:6829","nonce":25557}]},"public_addr":"172.21.15.42:6825/25557","cluster_addr":"172.21.15.42:6803/1025557","heartbeat_back_addr":"172.21.15.42:6832/25557","heartbeat_front_addr":"172.21.15.42:6829/25557","state":["exists","up"]},{"osd":4,"uuid":"699f276b-ca34-41dd-a9d7-128443cb4818","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":49,"up_from":50,"up_thru":63,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":25554},{"type":"v1","addr":"172.21.15.42:6810","nonce":25554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":1025554},{"type":"v1","addr":"172.21.15.42:6815","nonce":1025554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":25554},{"type":"v1","addr":"172.21.15.42:6822","nonce":25554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":25554},{"type":"v1","addr":"172.21.15.42:6818","nonce":25554}]},"public_addr":"172.21.15.42:6810/25554","cluster_addr":"172.21.15.42:6815/1025554","heartbeat_back_addr":"172.21.15.42:6822/25554","heartbeat_front_addr":"172.21.15.42:6818/25554","state":["exists","up"]},{"osd":5,"uuid":"24430a9f-4b9f-4a25-8947-070fda401422","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":49,"up_from":50,"up_thru":50,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":25555},{"type":"v1","addr":"172.21.15.42:6811","nonce":25555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6874","nonce":1025555},{"type":"v1","addr":"172.21.15.42:6875","nonce":1025555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":25555},{"type":"v1","addr":"172.21.15.42:6823","nonce":25555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":25555},{"type":"v1","addr":"172.21.15.42:6819","nonce":25555}]},"public_addr":"172.21.15.42:6811/25555","cluster_addr":"172.21.15.42:6875/1025555","heartbeat_back_addr":"172.21.15.42:6823/25555","heartbeat_front_addr":"172.21.15.42:6819/25555","state":["exists","up"]},{"osd":6,"uuid":"5fb76140-ee57-491b-a2b1-510a6542f55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":50,"up_from":51,"up_thru":60,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6848","nonce":25559},{"type":"v1","addr":"172.21.15.42:6850","nonce":25559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6882","nonce":1025559},{"type":"v1","addr":"172.21.15.42:6883","nonce":1025559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6859","nonce":25559},{"type":"v1","addr":"172.21.15.42:6861","nonce":25559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6855","nonce":25559},{"type":"v1","addr":"172.21.15.42:6857","nonce":25559}]},"public_addr":"172.21.15.42:6850/25559","cluster_addr":"172.21.15.42:6883/1025559","heartbeat_back_addr":"172.21.15.42:6861/25559","heartbeat_front_addr":"172.21.15.42:6857/25559","state":["exists","up"]},{"osd":7,"uuid":"5f254cd1-26b1-4233-868a-eb987cd7ceb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":51,"up_from":52,"up_thru":52,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":25566},{"type":"v1","addr":"172.21.15.42:6835","nonce":25566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6852","nonce":1025566},{"type":"v1","addr":"172.21.15.42:6854","nonce":1025566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6844","nonce":25566},{"type":"v1","addr":"172.21.15.42:6846","nonce":25566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6840","nonce":25566},{"type":"v1","addr":"172.21.15.42:6842","nonce":25566}]},"public_addr":"172.21.15.42:6835/25566","cluster_addr":"172.21.15.42:6854/1025566","heartbeat_back_addr":"172.21.15.42:6846/25566","heartbeat_front_addr":"172.21.15.42:6842/25566","state":["exists","up"]},{"osd":8,"uuid":"8e21d721-414c-43bc-b09e-a5bf160bb35e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":49,"up_from":50,"up_thru":18,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6849","nonce":25578},{"type":"v1","addr":"172.21.15.42:6851","nonce":25578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6866","nonce":2025578},{"type":"v1","addr":"172.21.15.42:6867","nonce":2025578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6862","nonce":25578},{"type":"v1","addr":"172.21.15.42:6863","nonce":25578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6858","nonce":25578},{"type":"v1","addr":"172.21.15.42:6860","nonce":25578}]},"public_addr":"172.21.15.42:6851/25578","cluster_addr":"172.21.15.42:6867/2025578","heartbeat_back_addr":"172.21.15.42:6863/25578","heartbeat_front_addr":"172.21.15.42:6860/25578","state":["exists","up"]},{"osd":9,"uuid":"bfa8f2a7-4738-4089-88bc-914091e7e1ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":16,"last_clean_end":41,"up_from":42,"up_thru":63,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6872","nonce":25601},{"type":"v1","addr":"172.21.15.42:6873","nonce":25601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1025601},{"type":"v1","addr":"172.21.15.42:6838","nonce":1025601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6878","nonce":25601},{"type":"v1","addr":"172.21.15.42:6879","nonce":25601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6876","nonce":25601},{"type":"v1","addr":"172.21.15.42:6877","nonce":25601}]},"public_addr":"172.21.15.42:6873/25601","cluster_addr":"172.21.15.42:6838/1025601","heartbeat_back_addr":"172.21.15.42:6879/25601","heartbeat_front_addr":"172.21.15.42:6877/25601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2024-09-18T12:29:06.239346+0000","laggy_probability":0.65700000524520874,"laggy_interval":1,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.867945+0000","dead_epoch":61},{"osd":1,"down_stamp":"2024-09-18T12:29:06.239346+0000","laggy_probability":0.65700000524520874,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.353200+0000","dead_epoch":60},{"osd":2,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.192345+0000","dead_epoch":47},{"osd":3,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.241275+0000","dead_epoch":47},{"osd":4,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.162388+0000","dead_epoch":47},{"osd":5,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.118272+0000","dead_epoch":47},{"osd":6,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.182504+0000","dead_epoch":50},{"osd":7,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.932363+0000","dead_epoch":51},{"osd":8,"down_stamp":"2024-09-18T12:28:52.160931+0000","laggy_probability":0.50999999046325684,"laggy_interval":1,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:15.922300+0000","dead_epoch":47},{"osd":9,"down_stamp":"2024-09-18T12:28:42.118160+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T12:27:16.546891+0000","dead_epoch":40}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T12:29:17.958 INFO:tasks.ceph:Scrubbing osd.0 2024-09-18T12:29:17.958 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-18T12:29:18.112 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-18T12:29:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T12:29:18.113 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-18T12:29:18.126 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-18T12:29:18.429 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 0 to deep-scrub 2024-09-18T12:29:18.439 INFO:tasks.ceph:Scrubbing osd.1 2024-09-18T12:29:18.439 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-18T12:29:18.582 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-18T12:29:18.582 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T12:29:18.582 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-18T12:29:18.594 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-18T12:29:18.895 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 1 to deep-scrub 2024-09-18T12:29:18.908 INFO:tasks.ceph:Scrubbing osd.2 2024-09-18T12:29:18.908 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-18T12:29:19.052 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-18T12:29:19.052 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T12:29:19.052 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-18T12:29:19.065 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-18T12:29:19.365 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 2 to deep-scrub 2024-09-18T12:29:19.376 INFO:tasks.ceph:Scrubbing osd.3 2024-09-18T12:29:19.376 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-18T12:29:19.520 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-18T12:29:19.520 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T12:29:19.520 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-18T12:29:19.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-18T12:29:19.848 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 3 to deep-scrub 2024-09-18T12:29:19.863 INFO:tasks.ceph:Scrubbing osd.4 2024-09-18T12:29:19.863 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-18T12:29:20.009 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-18T12:29:20.009 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T12:29:20.009 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-18T12:29:20.021 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-18T12:29:20.313 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 4 to deep-scrub 2024-09-18T12:29:20.328 INFO:tasks.ceph:Scrubbing osd.5 2024-09-18T12:29:20.328 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-18T12:29:20.474 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-18T12:29:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T12:29:20.474 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-18T12:29:20.487 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-18T12:29:20.791 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 5 to deep-scrub 2024-09-18T12:29:20.807 INFO:tasks.ceph:Scrubbing osd.6 2024-09-18T12:29:20.807 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-18T12:29:20.955 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-18T12:29:20.955 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T12:29:20.955 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-18T12:29:20.968 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-18T12:29:21.264 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 6 to deep-scrub 2024-09-18T12:29:21.277 INFO:tasks.ceph:Scrubbing osd.7 2024-09-18T12:29:21.277 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-18T12:29:21.413 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-18T12:29:21.413 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T12:29:21.413 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-18T12:29:21.426 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-18T12:29:21.725 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 7 to deep-scrub 2024-09-18T12:29:21.735 INFO:tasks.ceph:Scrubbing osd.8 2024-09-18T12:29:21.735 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2024-09-18T12:29:21.878 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-18T12:29:21.878 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T12:29:21.878 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-18T12:29:21.891 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2024-09-18T12:29:22.198 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 8 to deep-scrub 2024-09-18T12:29:22.209 INFO:tasks.ceph:Scrubbing osd.9 2024-09-18T12:29:22.209 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2024-09-18T12:29:22.359 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-18T12:29:22.359 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T12:29:22.359 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-18T12:29:22.372 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2024-09-18T12:29:22.670 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 9 to deep-scrub 2024-09-18T12:29:22.685 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:29:22.986 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:29:22.989 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-18T12:29:23.000 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2024-09-18T12:29:21.967869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":2980848,"kb_used_data":7244,"kb_used_omap":16,"kb_used_meta":2973423,"kb_avail":1045595152,"statfs":{"total":1073741824000,"available":1070689435648,"internally_reserved":0,"allocated":7417856,"data_stored":3544032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17040,"internal_metadata":3044785520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.696093"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":51,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-18T12:29:10.589376+0000","last_change":"2024-09-18T12:28:57.205389+0000","last_active":"2024-09-18T12:29:10.589376+0000","last_peered":"2024-09-18T12:29:10.589376+0000","last_clean":"2024-09-18T12:29:10.589376+0000","last_became_active":"2024-09-18T12:28:57.205005+0000","last_became_peered":"2024-09-18T12:28:57.205005+0000","last_unstale":"2024-09-18T12:29:10.589376+0000","last_undegraded":"2024-09-18T12:29:10.589376+0000","last_fullsized":"2024-09-18T12:29:10.589376+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T14:41:06.141977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050383899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":67,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-18T12:29:10.750966+0000","last_change":"2024-09-18T12:28:58.636245+0000","last_active":"2024-09-18T12:29:10.750966+0000","last_peered":"2024-09-18T12:29:10.750966+0000","last_clean":"2024-09-18T12:29:10.750966+0000","last_became_active":"2024-09-18T12:28:58.635680+0000","last_became_peered":"2024-09-18T12:28:58.635680+0000","last_unstale":"2024-09-18T12:29:10.750966+0000","last_undegraded":"2024-09-18T12:29:10.750966+0000","last_fullsized":"2024-09-18T12:29:10.750966+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:16:32.931305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058294300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:11.280442+0000","last_change":"2024-09-18T12:29:11.280442+0000","last_active":"2024-09-18T12:29:11.280442+0000","last_peered":"2024-09-18T12:29:11.280442+0000","last_clean":"2024-09-18T12:29:11.280442+0000","last_became_active":"2024-09-18T12:29:11.280008+0000","last_became_peered":"2024-09-18T12:29:11.280008+0000","last_unstale":"2024-09-18T12:29:11.280442+0000","last_undegraded":"2024-09-18T12:29:11.280442+0000","last_fullsized":"2024-09-18T12:29:11.280442+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:37:41.136648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059182099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":66,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:11.323342+0000","last_change":"2024-09-18T12:29:11.323342+0000","last_active":"2024-09-18T12:29:11.323342+0000","last_peered":"2024-09-18T12:29:11.323342+0000","last_clean":"2024-09-18T12:29:11.323342+0000","last_became_active":"2024-09-18T12:29:11.322881+0000","last_became_peered":"2024-09-18T12:29:11.322881+0000","last_unstale":"2024-09-18T12:29:11.323342+0000","last_undegraded":"2024-09-18T12:29:11.323342+0000","last_fullsized":"2024-09-18T12:29:11.323342+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T17:14:45.841440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"19'1","reported_seq":85,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:11.280482+0000","last_change":"2024-09-18T12:29:11.280482+0000","last_active":"2024-09-18T12:29:11.280482+0000","last_peered":"2024-09-18T12:29:11.280482+0000","last_clean":"2024-09-18T12:29:11.280482+0000","last_became_active":"2024-09-18T12:29:11.280164+0000","last_became_peered":"2024-09-18T12:29:11.280164+0000","last_unstale":"2024-09-18T12:29:11.280482+0000","last_undegraded":"2024-09-18T12:29:11.280482+0000","last_fullsized":"2024-09-18T12:29:11.280482+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T20:24:39.185622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"21'2","reported_seq":85,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:11.279163+0000","last_change":"2024-09-18T12:29:11.279163+0000","last_active":"2024-09-18T12:29:11.279163+0000","last_peered":"2024-09-18T12:29:11.279163+0000","last_clean":"2024-09-18T12:29:11.279163+0000","last_became_active":"2024-09-18T12:29:11.278800+0000","last_became_peered":"2024-09-18T12:29:11.278800+0000","last_unstale":"2024-09-18T12:29:11.279163+0000","last_undegraded":"2024-09-18T12:29:11.279163+0000","last_fullsized":"2024-09-18T12:29:11.279163+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T15:45:16.479131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00192884,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-18T12:29:10.748701+0000","last_change":"2024-09-18T12:28:59.609508+0000","last_active":"2024-09-18T12:29:10.748701+0000","last_peered":"2024-09-18T12:29:10.748701+0000","last_clean":"2024-09-18T12:29:10.748701+0000","last_became_active":"2024-09-18T12:28:59.608964+0000","last_became_peered":"2024-09-18T12:28:59.608964+0000","last_unstale":"2024-09-18T12:29:10.748701+0000","last_undegraded":"2024-09-18T12:29:10.748701+0000","last_fullsized":"2024-09-18T12:29:10.748701+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076440299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":66,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-18T12:29:10.267930+0000","last_change":"2024-09-18T12:28:57.204248+0000","last_active":"2024-09-18T12:29:10.267930+0000","last_peered":"2024-09-18T12:29:10.267930+0000","last_clean":"2024-09-18T12:29:10.267930+0000","last_became_active":"2024-09-18T12:28:57.203688+0000","last_became_peered":"2024-09-18T12:28:57.203688+0000","last_unstale":"2024-09-18T12:29:10.267930+0000","last_undegraded":"2024-09-18T12:29:10.267930+0000","last_fullsized":"2024-09-18T12:29:10.267930+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:27:21.480189+0000","last_clean_scrub_stamp":"2024-09-18T12:27:21.480189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T22:42:09.518124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":42,"seq":180388626458,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.107},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.67100000000000004}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":1.5209999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.621}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.302},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.6759999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.4359999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.232},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":0.93899999999999995}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.732}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.7829999999999999}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.8300000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.3839999999999999}]}]},{"osd":8,"up_from":50,"seq":214748364826,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.5},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.468}]},{"osd":1,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.0780000000000001}]},{"osd":2,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":1.3129999999999999}]},{"osd":3,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":1.712}]},{"osd":4,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.046},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.8009999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.94599999999999995}]},{"osd":6,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.413},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.2649999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.575}]},{"osd":9,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.633},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.603}]}]},{"osd":7,"up_from":52,"seq":223338299418,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.59699999999999998}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":1.113},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.57699999999999996}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":0.81799999999999995}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":0.90700000000000003}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.97999999999999998}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":0.875},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":1.1759999999999999}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.7429999999999999,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":1.319},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.2450000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.3700000000000001,"5min":3.3700000000000001,"15min":3.3700000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.1599999999999999}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.268}]}]},{"osd":6,"up_from":51,"seq":219043332122,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.86099999999999999}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.91800000000000004}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.96299999999999997}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.456},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.5940000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.55}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.671},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.0800000000000001}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.738},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.2230000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.7909999999999999}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.712}]}]},{"osd":5,"up_from":50,"seq":214748364826,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.26}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.5489999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.2110000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.331},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.486}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.502}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.8969999999999998,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":1.385},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.0720000000000001}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":1.6890000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.4419999999999999}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.615},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.1859999999999999}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.746},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.355}]}]},{"osd":4,"up_from":50,"seq":214748364826,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298088,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559512,"statfs":{"total":107374182400,"available":107068940288,"internally_reserved":0,"allocated":745472,"data_stored":354488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.6970000000000001}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.571}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":1.7829999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.96699999999999997}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.462}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.3140000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.663}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.423},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.8420000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.9279999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.6240000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.8859999999999999}]}]},{"osd":3,"up_from":50,"seq":214748364826,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.70999999999999996}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.67200000000000004}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.4099999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.111},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.85399999999999998}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.5129999999999999}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.633},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.262}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.3440000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.454}]}]},{"osd":2,"up_from":50,"seq":214748364826,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.6180000000000001}]},{"osd":1,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":1.0109999999999999}]},{"osd":3,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.373}]},{"osd":4,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.099}]},{"osd":5,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.76000000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.262},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.722}]},{"osd":7,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.488},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.321}]},{"osd":8,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.78},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.5600000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.845},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.5189999999999999}]}]},{"osd":1,"up_from":63,"seq":270582939674,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":353792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.81100000000000005}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.74199999999999999}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.3200000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.88700000000000001}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.175},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.93200000000000005}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4340000000000002,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.615}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.671},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.3899999999999999}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.7130000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:22 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.7529999999999999}]}]},{"osd":0,"up_from":63,"seq":270582939674,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298088,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559512,"statfs":{"total":107374182400,"available":107068940288,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.85599999999999998}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.093}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.181}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.4180000000000001,"5min":7.4180000000000001,"15min":7.4180000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":0.96599999999999997}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.6379999999999999}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":1.7430000000000001}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":6.3280000000000003,"5min":6.3280000000000003,"15min":6.3280000000000003},"last":1.238},{"interface":"front","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":1.8029999999999999}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":1.306},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.9079999999999999}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.843},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.4710000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:29:23.005 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-09-18T12:27:21.480189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=27, tm_sec=21, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=29, tm_sec=16, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T12:29:23.005 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-09-18T12:27:21.480189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=27, tm_sec=21, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=29, tm_sec=16, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T12:29:23.006 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-09-18T12:27:21.480189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=27, tm_sec=21, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=29, tm_sec=16, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T12:29:23.006 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-09-18T12:27:21.480189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=27, tm_sec=21, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=29, tm_sec=16, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T12:29:23.006 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-09-18T12:27:21.480189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=27, tm_sec=21, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=29, tm_sec=16, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T12:29:23.006 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-09-18T12:27:21.480189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=27, tm_sec=21, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=29, tm_sec=16, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T12:29:23.006 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-09-18T12:27:21.480189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=27, tm_sec=21, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=29, tm_sec=16, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T12:29:23.006 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T12:27:21.480189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=27, tm_sec=21, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=12, tm_min=29, tm_sec=16, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T12:29:23.006 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T12:29:43.007 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T12:29:43.321 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-18T12:29:43.323 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-18T12:29:43.335 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-09-18T12:29:41.973386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":2980792,"kb_used_data":7244,"kb_used_omap":16,"kb_used_meta":2973423,"kb_avail":1045595208,"statfs":{"total":1073741824000,"available":1070689492992,"internally_reserved":0,"allocated":7417856,"data_stored":3544032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17040,"internal_metadata":3044785520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003290"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":62,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:22.559017+0000","last_change":"2024-09-18T12:29:22.558948+0000","last_active":"2024-09-18T12:29:22.559017+0000","last_peered":"2024-09-18T12:29:22.559017+0000","last_clean":"2024-09-18T12:29:22.559017+0000","last_became_active":"2024-09-18T12:28:57.205005+0000","last_became_peered":"2024-09-18T12:28:57.205005+0000","last_unstale":"2024-09-18T12:29:22.559017+0000","last_undegraded":"2024-09-18T12:29:22.559017+0000","last_fullsized":"2024-09-18T12:29:22.559017+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:29:22.558792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:29:22.558792+0000","last_clean_scrub_stamp":"2024-09-18T12:29:22.558792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T18:10:56.007250+0000","scrub_duration":0.003031569,"objects_trimmed":0,"snaptrim_duration":0.00050383899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":78,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:24.060917+0000","last_change":"2024-09-18T12:29:24.060847+0000","last_active":"2024-09-18T12:29:24.060917+0000","last_peered":"2024-09-18T12:29:24.060917+0000","last_clean":"2024-09-18T12:29:24.060917+0000","last_became_active":"2024-09-18T12:28:58.635680+0000","last_became_peered":"2024-09-18T12:28:58.635680+0000","last_unstale":"2024-09-18T12:29:24.060917+0000","last_undegraded":"2024-09-18T12:29:24.060917+0000","last_fullsized":"2024-09-18T12:29:24.060917+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:29:24.060686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:29:24.060686+0000","last_clean_scrub_stamp":"2024-09-18T12:29:24.060686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T19:52:15.865575+0000","scrub_duration":0.0031768859999999999,"objects_trimmed":0,"snaptrim_duration":0.00058294300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":111,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:26.758729+0000","last_change":"2024-09-18T12:29:26.758660+0000","last_active":"2024-09-18T12:29:26.758729+0000","last_peered":"2024-09-18T12:29:26.758729+0000","last_clean":"2024-09-18T12:29:26.758729+0000","last_became_active":"2024-09-18T12:29:11.280008+0000","last_became_peered":"2024-09-18T12:29:11.280008+0000","last_unstale":"2024-09-18T12:29:26.758729+0000","last_undegraded":"2024-09-18T12:29:26.758729+0000","last_fullsized":"2024-09-18T12:29:26.758729+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:29:26.758491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:29:26.758491+0000","last_clean_scrub_stamp":"2024-09-18T12:29:26.758491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:34:19.586141+0000","scrub_duration":0.002975307,"objects_trimmed":0,"snaptrim_duration":0.00059182099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":77,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:24.402402+0000","last_change":"2024-09-18T12:29:24.402333+0000","last_active":"2024-09-18T12:29:24.402402+0000","last_peered":"2024-09-18T12:29:24.402402+0000","last_clean":"2024-09-18T12:29:24.402402+0000","last_became_active":"2024-09-18T12:29:11.322881+0000","last_became_peered":"2024-09-18T12:29:11.322881+0000","last_unstale":"2024-09-18T12:29:24.402402+0000","last_undegraded":"2024-09-18T12:29:24.402402+0000","last_fullsized":"2024-09-18T12:29:24.402402+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:29:24.402168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:29:24.402168+0000","last_clean_scrub_stamp":"2024-09-18T12:29:24.402168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T16:39:44.058627+0000","scrub_duration":0.0031102539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"64'2","reported_seq":97,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:24.596740+0000","last_change":"2024-09-18T12:29:24.596674+0000","last_active":"2024-09-18T12:29:24.596740+0000","last_peered":"2024-09-18T12:29:24.596740+0000","last_clean":"2024-09-18T12:29:24.596740+0000","last_became_active":"2024-09-18T12:29:11.280164+0000","last_became_peered":"2024-09-18T12:29:11.280164+0000","last_unstale":"2024-09-18T12:29:24.596740+0000","last_undegraded":"2024-09-18T12:29:24.596740+0000","last_fullsized":"2024-09-18T12:29:24.596740+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'2","last_scrub_stamp":"2024-09-18T12:29:24.596491+0000","last_deep_scrub":"64'2","last_deep_scrub_stamp":"2024-09-18T12:29:24.596491+0000","last_clean_scrub_stamp":"2024-09-18T12:29:24.596491+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T00:18:22.920679+0000","scrub_duration":0.0055090169999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"64'3","reported_seq":97,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:20.872272+0000","last_change":"2024-09-18T12:29:20.872231+0000","last_active":"2024-09-18T12:29:20.872272+0000","last_peered":"2024-09-18T12:29:20.872272+0000","last_clean":"2024-09-18T12:29:20.872272+0000","last_became_active":"2024-09-18T12:29:11.278800+0000","last_became_peered":"2024-09-18T12:29:11.278800+0000","last_unstale":"2024-09-18T12:29:20.872272+0000","last_undegraded":"2024-09-18T12:29:20.872272+0000","last_fullsized":"2024-09-18T12:29:20.872272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'3","last_scrub_stamp":"2024-09-18T12:29:20.872103+0000","last_deep_scrub":"64'3","last_deep_scrub_stamp":"2024-09-18T12:29:20.872103+0000","last_clean_scrub_stamp":"2024-09-18T12:29:20.872103+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T18:05:22.693331+0000","scrub_duration":0.0047425540000000004,"objects_trimmed":0,"snaptrim_duration":0.00192884,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":58,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:21.972218+0000","last_change":"2024-09-18T12:29:21.972194+0000","last_active":"2024-09-18T12:29:21.972218+0000","last_peered":"2024-09-18T12:29:21.972218+0000","last_clean":"2024-09-18T12:29:21.972218+0000","last_became_active":"2024-09-18T12:28:59.608964+0000","last_became_peered":"2024-09-18T12:28:59.608964+0000","last_unstale":"2024-09-18T12:29:21.972218+0000","last_undegraded":"2024-09-18T12:29:21.972218+0000","last_fullsized":"2024-09-18T12:29:21.972218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:29:21.972116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:29:21.972116+0000","last_clean_scrub_stamp":"2024-09-18T12:29:21.972116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T13:36:28.422155+0000","scrub_duration":0.0016409930000000001,"objects_trimmed":0,"snaptrim_duration":0.00076440299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":77,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-18T12:29:23.865289+0000","last_change":"2024-09-18T12:29:23.865219+0000","last_active":"2024-09-18T12:29:23.865289+0000","last_peered":"2024-09-18T12:29:23.865289+0000","last_clean":"2024-09-18T12:29:23.865289+0000","last_became_active":"2024-09-18T12:28:57.203688+0000","last_became_peered":"2024-09-18T12:28:57.203688+0000","last_unstale":"2024-09-18T12:29:23.865289+0000","last_undegraded":"2024-09-18T12:29:23.865289+0000","last_fullsized":"2024-09-18T12:29:23.865289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T12:29:23.865046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T12:29:23.865046+0000","last_clean_scrub_stamp":"2024-09-18T12:29:23.865046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T19:52:15.669936+0000","scrub_duration":0.0032539660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":42,"seq":180388626462,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298076,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559524,"statfs":{"total":107374182400,"available":107068952576,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.4059999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.1549999999999998,"5min":2.1549999999999998,"15min":2.1549999999999998},"last":0.72799999999999998}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.083}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.254},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.165}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.546}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.304},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.0139999999999998,"5min":3.0139999999999998,"15min":3.0139999999999998},"last":1.327}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.48}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":1.5780000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.367},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.669}]}]},{"osd":8,"up_from":50,"seq":214748364830,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.488},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.89600000000000002}]},{"osd":2,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":1.4319999999999999}]},{"osd":3,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.999}]},{"osd":4,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.629},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.151}]},{"osd":5,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.599},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.756}]},{"osd":6,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.833}]},{"osd":7,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.6990000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.8879999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":1.375}]}]},{"osd":7,"up_from":52,"seq":223338299422,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298076,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559524,"statfs":{"total":107374182400,"available":107068952576,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.6669999999999998,"5min":3.6669999999999998,"15min":3.6669999999999998},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.79900000000000004}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.532,"5min":3.532,"15min":3.532},"last":1.018}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.3180000000000001,"5min":2.3180000000000001,"15min":2.3180000000000001},"last":0.995},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.0980000000000001}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":1.6259999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":1.514}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.7429999999999999,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.4690000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.3700000000000001,"5min":3.3700000000000001,"15min":3.3700000000000001},"last":1.6659999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":1.327}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.54},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.5820000000000001}]}]},{"osd":6,"up_from":51,"seq":219043332126,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298076,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559524,"statfs":{"total":107374182400,"available":107068952576,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.81999999999999995}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.2809999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.085}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.794},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.452}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.327},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.5489999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.202},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.377}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.494}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.6679999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.5269999999999999}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.714},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.7280000000000002,"5min":2.7280000000000002,"15min":2.7280000000000002},"last":1.7430000000000001}]}]},{"osd":5,"up_from":50,"seq":214748364830,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298076,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559524,"statfs":{"total":107374182400,"available":107068952576,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.78800000000000003}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.5780000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.89900000000000002}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.3120000000000001}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.123}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":1.47}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.8969999999999998,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":1.786},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.6990000000000001}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.782,"5min":2.782,"15min":2.782},"last":1.885},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.651}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.8560000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.8240000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:21 2024","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.9319999999999999}]}]},{"osd":4,"up_from":50,"seq":214748364830,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298080,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559520,"statfs":{"total":107374182400,"available":107068948480,"internally_reserved":0,"allocated":745472,"data_stored":354488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.628}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.0369999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.177}]},{"osd":3,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.369},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.5369999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.2549999999999999}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.569},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.6240000000000001}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.6870000000000001}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.3220000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.518},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.78}]}]},{"osd":3,"up_from":50,"seq":214748364830,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298076,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559524,"statfs":{"total":107374182400,"available":107068952576,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.72699999999999998}]},{"osd":1,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.204},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.61799999999999999}]},{"osd":2,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.93000000000000005}]},{"osd":4,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.016},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0960000000000001}]},{"osd":5,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.3600000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.522}]},{"osd":7,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":1.427},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.2969999999999999}]},{"osd":8,"last update":"Wed Sep 18 12:28:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.585},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.407}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":1.4810000000000001}]}]},{"osd":2,"up_from":50,"seq":214748364830,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":298084,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559516,"statfs":{"total":107374182400,"available":107068944384,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.85599999999999998}]},{"osd":1,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":1.389}]},{"osd":3,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.1779999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.052},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.6899999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.0880000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.26}]},{"osd":7,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.329},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.792}]},{"osd":8,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.482},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.4430000000000001}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.8900000000000001,"5min":2.8900000000000001,"15min":2.8900000000000001},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.7430000000000001}]}]},{"osd":1,"up_from":63,"seq":270582939678,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298076,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559524,"statfs":{"total":107374182400,"available":107068952576,"internally_reserved":0,"allocated":741376,"data_stored":353792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.754},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.323}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.613}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.839},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.85299999999999998}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.706}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.482},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.4530000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.4340000000000002,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":1.3740000000000001}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":1.784}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.659}]},{"osd":9,"last update":"Wed Sep 18 12:28:22 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.879},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":1.9399999999999999}]}]},{"osd":0,"up_from":63,"seq":270582939678,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":298088,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":104559512,"statfs":{"total":107374182400,"available":107068940288,"internally_reserved":0,"allocated":741376,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.3120000000000001}]},{"osd":2,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.86199999999999999}]},{"osd":3,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.754},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.0429999999999999}]},{"osd":4,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.4180000000000001,"5min":7.4180000000000001,"15min":7.4180000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":0.99199999999999999}]},{"osd":5,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.4530000000000001}]},{"osd":6,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.161},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":1.5840000000000001}]},{"osd":7,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":6.3280000000000003,"5min":6.3280000000000003,"15min":6.3280000000000003},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":1.415}]},{"osd":8,"last update":"Wed Sep 18 12:28:18 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.5329999999999999}]},{"osd":9,"last update":"Wed Sep 18 12:28:19 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.2789999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T12:29:43.338 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-18T12:29:43.648 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-18T12:29:43.648 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-18T12:29:43.648 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-18T12:29:43.649 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T12:29:43.716 INFO:tasks.ceph.osd.0:Stopped 2024-09-18T12:29:43.716 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-18T12:29:43.716 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T12:29:43.811 INFO:tasks.ceph.osd.1:Stopped 2024-09-18T12:29:43.811 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-18T12:29:43.811 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T12:29:43.893 INFO:tasks.ceph.osd.2:Stopped 2024-09-18T12:29:43.893 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-18T12:29:43.893 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T12:29:43.975 INFO:tasks.ceph.osd.3:Stopped 2024-09-18T12:29:43.976 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-18T12:29:43.976 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T12:29:44.064 INFO:tasks.ceph.osd.4:Stopped 2024-09-18T12:29:44.065 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-18T12:29:44.065 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T12:29:44.157 INFO:tasks.ceph.osd.5:Stopped 2024-09-18T12:29:44.157 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-18T12:29:44.157 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T12:29:44.218 INFO:tasks.ceph.osd.6:Stopped 2024-09-18T12:29:44.219 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-18T12:29:44.219 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T12:29:44.298 INFO:tasks.ceph.osd.7:Stopped 2024-09-18T12:29:44.298 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2024-09-18T12:29:44.298 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T12:29:44.370 INFO:tasks.ceph.osd.8:Stopped 2024-09-18T12:29:44.370 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2024-09-18T12:29:44.370 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T12:29:44.437 INFO:tasks.ceph.osd.9:Stopped 2024-09-18T12:29:44.437 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-18T12:29:44.437 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-18T12:29:44.438 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T12:29:44.467 INFO:tasks.ceph.mgr.x:Stopped 2024-09-18T12:29:44.467 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-18T12:29:44.467 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-18T12:29:44.467 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T12:29:44.487 INFO:tasks.ceph.mon.a:Stopped 2024-09-18T12:29:44.487 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-18T12:29:44.487 DEBUG:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-09-18T12:29:44.506 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-18T12:29:44.507 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-18T12:29:44.805 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-18T12:29:44.806 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-18T12:29:45.109 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-18T12:29:45.109 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-18T12:29:45.302 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-18T12:29:45.302 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-18T12:29:45.453 INFO:tasks.ceph:Archiving mon data... 2024-09-18T12:29:45.454 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7911040/data/mon.a.tgz 2024-09-18T12:29:45.454 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-09-18T12:29:45.459 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.cKkLZ0rhXv 2024-09-18T12:29:45.459 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.cKkLZ0rhXv 2024-09-18T12:29:45.567 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.cKkLZ0rhXv 2024-09-18T12:29:45.591 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.cKkLZ0rhXv is 201KB 2024-09-18T12:29:45.613 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.cKkLZ0rhXv 2024-09-18T12:29:45.620 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-18T12:29:45.620 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T12:29:45.678 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-18T12:29:45.679 DEBUG:teuthology.orchestra.run.smithi042:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-18T12:29:45.703 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-18T12:29:45.710 INFO:tasks.ceph:Archiving crash dumps... 2024-09-18T12:29:45.711 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7911040/remote/smithi042/crash 2024-09-18T12:29:45.712 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T12:29:45.767 INFO:tasks.ceph:Compressing logs... 2024-09-18T12:29:45.768 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T12:29:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30783.log 2024-09-18T12:29:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32012.log 2024-09-18T12:29:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32479.log 2024-09-18T12:29:45.792 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30783.log.gz 2024-09-18T12:29:45.794 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32246.log 2024-09-18T12:29:45.794 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32012.log.gz 2024-09-18T12:29:45.794 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32348.log 2024-09-18T12:29:45.794 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32479.log.gz 2024-09-18T12:29:45.794 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32246.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-18T12:29:45.794 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32246.log.gz 2024-09-18T12:29:45.795 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30771.log 2024-09-18T12:29:45.795 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32348.log.gz 2024-09-18T12:29:45.795 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25334.log 2024-09-18T12:29:45.796 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.30771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30771.log.gz 2024-09-18T12:29:45.796 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33092.log 2024-09-18T12:29:45.796 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25387.log 2024-09-18T12:29:45.798 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25334.log.gz 2024-09-18T12:29:45.798 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31468.log 2024-09-18T12:29:45.798 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33092.log.gz 2024-09-18T12:29:45.798 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33281.log 2024-09-18T12:29:45.798 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25387.log.gz 2024-09-18T12:29:45.799 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30519.log 2024-09-18T12:29:45.799 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31468.log.gz 2024-09-18T12:29:45.800 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31728.log 2024-09-18T12:29:45.800 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33281.log.gz 2024-09-18T12:29:45.800 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25118.log 2024-09-18T12:29:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30519.log.gz 2024-09-18T12:29:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30433.log 2024-09-18T12:29:45.801 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31728.log.gz 2024-09-18T12:29:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30406.log 2024-09-18T12:29:45.802 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25118.log: /var/log/ceph/ceph-client.admin.30433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33227.log 2024-09-18T12:29:45.802 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30433.log.gz 2024-09-18T12:29:45.802 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25118.log.gz 2024-09-18T12:29:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30514.log 2024-09-18T12:29:45.803 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30406.log.gz 2024-09-18T12:29:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32630.log 2024-09-18T12:29:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33227.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.33227.log.gz--verbose -- 2024-09-18T12:29:45.803 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33605.log 2024-09-18T12:29:45.804 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30514.log.gz 2024-09-18T12:29:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31702.log 2024-09-18T12:29:45.805 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32630.log.gz 2024-09-18T12:29:45.805 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32957.log 2024-09-18T12:29:45.805 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33605.log.gz 2024-09-18T12:29:45.807 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25442.log 2024-09-18T12:29:45.807 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31702.log.gz 2024-09-18T12:29:45.807 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25282.log 2024-09-18T12:29:45.807 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32957.log.gz 2024-09-18T12:29:45.807 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30460.log 2024-09-18T12:29:45.807 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25442.log.gz 2024-09-18T12:29:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25282.log.gz 2024-09-18T12:29:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33038.log 2024-09-18T12:29:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30460.log.gz 2024-09-18T12:29:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30512.log 2024-09-18T12:29:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33038.log.gz 2024-09-18T12:29:45.808 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25558.log 2024-09-18T12:29:45.810 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30752.log 2024-09-18T12:29:45.810 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30512.log.gz 2024-09-18T12:29:45.810 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.25558.log: -- /var/log/ceph/ceph-client.admin.32580.log 2024-09-18T12:29:45.810 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25558.log.gz 2024-09-18T12:29:45.810 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30752.log.gz 2024-09-18T12:29:45.810 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32822.log 2024-09-18T12:29:45.811 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33200.log 2024-09-18T12:29:45.811 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32580.log.gz 2024-09-18T12:29:45.811 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32822.log.gz 2024-09-18T12:29:45.811 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32984.log 2024-09-18T12:29:45.812 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33200.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.33200.log.gz 2024-09-18T12:29:45.812 INFO:teuthology.orchestra.run.smithi042.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.32090.log 2024-09-18T12:29:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32505.log 2024-09-18T12:29:45.813 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32984.log.gz 2024-09-18T12:29:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32090.log.gz 2024-09-18T12:29:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-18T12:29:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32505.log.gz 2024-09-18T12:29:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32452.log 2024-09-18T12:29:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32555.log 2024-09-18T12:29:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.32452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31497.log 2024-09-18T12:29:45.815 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32452.log.gz 2024-09-18T12:29:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.17153.log 2024-09-18T12:29:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32555.log.gz 2024-09-18T12:29:45.815 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33389.log 2024-09-18T12:29:45.816 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31497.log.gz 2024-09-18T12:29:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.tmp-client.admin.17153.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.17153.log.gz 2024-09-18T12:29:45.816 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31832.log 2024-09-18T12:29:45.817 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33389.log.gz 2024-09-18T12:29:45.817 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32759.log 2024-09-18T12:29:45.817 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31832.log.gz 2024-09-18T12:29:45.817 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33497.log 2024-09-18T12:29:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32605.log 2024-09-18T12:29:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32759.log.gz 2024-09-18T12:29:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32220.log 2024-09-18T12:29:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33497.log.gz 2024-09-18T12:29:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-18T12:29:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32605.log.gz 2024-09-18T12:29:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32220.log.gz 2024-09-18T12:29:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30756.log 2024-09-18T12:29:45.821 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31600.log 2024-09-18T12:29:45.822 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31960.log 2024-09-18T12:29:45.822 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30756.log.gz 2024-09-18T12:29:45.822 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31676.log 2024-09-18T12:29:45.822 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31600.log.gz 2024-09-18T12:29:45.822 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31960.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.31960.log.gz--verbose 2024-09-18T12:29:45.822 INFO:teuthology.orchestra.run.smithi042.stderr:-- /var/log/ceph/ceph-client.admin.33065.log 2024-09-18T12:29:45.824 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-18T12:29:45.824 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31676.log.gz 2024-09-18T12:29:45.824 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30507.log 2024-09-18T12:29:45.824 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33065.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.33065.log.gz--verbose 2024-09-18T12:29:45.824 INFO:teuthology.orchestra.run.smithi042.stderr:-- /var/log/ceph/ceph-client.admin.31035.log 2024-09-18T12:29:45.824 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.30507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33416.log 2024-09-18T12:29:45.824 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30507.log.gz 2024-09-18T12:29:45.826 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31138.log 2024-09-18T12:29:45.826 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31035.log.gz 2024-09-18T12:29:45.826 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25185.log 2024-09-18T12:29:45.827 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33416.log: /var/log/ceph/ceph-client.admin.31138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30802.log 2024-09-18T12:29:45.827 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33416.log.gz 2024-09-18T12:29:45.827 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31138.log.gz 2024-09-18T12:29:45.827 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25185.log: gzip -5 --verbose -- 88.7%/var/log/ceph/ceph-client.admin.32322.log 2024-09-18T12:29:45.827 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-18T12:29:45.827 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25185.log.gz 2024-09-18T12:29:45.827 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30776.log 2024-09-18T12:29:45.827 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30802.log.gz 2024-09-18T12:29:45.827 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30523.log 2024-09-18T12:29:45.827 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32322.log.gz 2024-09-18T12:29:45.828 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-18T12:29:45.828 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30776.log.gz 2024-09-18T12:29:45.828 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30523.log.gz 2024-09-18T12:29:45.829 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31754.log 2024-09-18T12:29:45.829 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32141.log 2024-09-18T12:29:45.830 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32064.log 2024-09-18T12:29:45.830 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31754.log.gz 2024-09-18T12:29:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33578.log 2024-09-18T12:29:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32141.log.gz 2024-09-18T12:29:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25882.log 2024-09-18T12:29:45.831 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32064.log.gz 2024-09-18T12:29:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32296.log 2024-09-18T12:29:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33578.log.gz 2024-09-18T12:29:45.833 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31027.log 2024-09-18T12:29:45.833 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25882.log.gz 2024-09-18T12:29:45.833 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32296.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2024-09-18T12:29:45.833 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32296.log.gz 2024-09-18T12:29:45.833 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31651.log 2024-09-18T12:29:45.833 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31027.log.gz 2024-09-18T12:29:45.833 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30789.log 2024-09-18T12:29:45.833 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.9.log: /var/log/ceph/ceph-client.admin.31651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31651.log.gz 2024-09-18T12:29:45.834 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32116.log 2024-09-18T12:29:45.834 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33551.log 2024-09-18T12:29:45.834 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30789.log.gz 2024-09-18T12:29:45.834 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32116.log.gz 2024-09-18T12:29:45.837 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31780.log 2024-09-18T12:29:45.837 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33551.log.gz 2024-09-18T12:29:45.841 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33362.log 2024-09-18T12:29:45.842 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-18T12:29:45.842 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31780.log: /var/log/ceph/ceph-client.admin.33362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31780.log.gz 2024-09-18T12:29:45.842 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33362.log.gz 2024-09-18T12:29:45.845 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32708.log 2024-09-18T12:29:45.846 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31055.log 2024-09-18T12:29:45.846 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32708.log.gz 2024-09-18T12:29:45.849 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32734.log 2024-09-18T12:29:45.849 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31055.log.gz 2024-09-18T12:29:45.854 INFO:teuthology.orchestra.run.smithi042.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-18T12:29:45.857 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30788.log 2024-09-18T12:29:45.859 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31859.log 2024-09-18T12:29:45.859 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0%/var/log/ceph/ceph-client.admin.30788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32930.log 2024-09-18T12:29:45.859 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30788.log.gz 2024-09-18T12:29:45.859 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31859.log: -- replaced with /var/log/ceph/ceph-client.admin.32734.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32400.log 2024-09-18T12:29:45.859 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% 2024-09-18T12:29:45.859 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31859.log.gz 2024-09-18T12:29:45.859 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33011.log 2024-09-18T12:29:45.860 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32930.log.gz 2024-09-18T12:29:45.860 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31626.log 2024-09-18T12:29:45.860 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32400.log.gz 2024-09-18T12:29:45.872 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 /var/log/ceph/ceph-client.admin.33011.log: --verbose -- /var/log/ceph/ceph-client.admin.31046.log 2024-09-18T12:29:45.872 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33011.log.gz 2024-09-18T12:29:45.872 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31626.log.gz 2024-09-18T12:29:45.872 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31910.log 2024-09-18T12:29:45.872 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 /var/log/ceph/ceph-client.admin.31046.log: --verbose -- /var/log/ceph/ceph-client.admin.32849.log 2024-09-18T12:29:45.872 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31046.log.gz 2024-09-18T12:29:45.873 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31910.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33630.log 2024-09-18T12:29:45.873 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31910.log.gz 2024-09-18T12:29:45.873 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32849.log.gz 2024-09-18T12:29:45.873 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31324.log 2024-09-18T12:29:45.873 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25495.log 2024-09-18T12:29:45.873 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33630.log.gz 2024-09-18T12:29:45.873 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.31324.log: -- /var/log/ceph/ceph-client.admin.33173.log 2024-09-18T12:29:45.873 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31324.log.gz 2024-09-18T12:29:45.873 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33146.log 2024-09-18T12:29:45.873 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30513.log 2024-09-18T12:29:45.873 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25495.log.gz/var/log/ceph/ceph-client.admin.33173.log: 2024-09-18T12:29:45.873 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33173.log.gz 2024-09-18T12:29:45.874 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33146.log.gz 2024-09-18T12:29:45.874 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31032.log 2024-09-18T12:29:45.874 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30509.log 2024-09-18T12:29:45.874 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30513.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32038.log 2024-09-18T12:29:45.874 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31032.log: 2024-09-18T12:29:45.874 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31032.log.gz 2024-09-18T12:29:45.874 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25468.log 2024-09-18T12:29:45.874 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30509.log.gz 2024-09-18T12:29:45.874 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25415.log 2024-09-18T12:29:45.874 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32038.log.gz 2024-09-18T12:29:45.874 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32903.log 2024-09-18T12:29:45.874 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25468.log.gz 2024-09-18T12:29:45.875 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30360.log 2024-09-18T12:29:45.875 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30515.log 2024-09-18T12:29:45.875 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25415.log.gz 2024-09-18T12:29:45.875 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32903.log.gz 2024-09-18T12:29:45.875 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31522.log 2024-09-18T12:29:45.875 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30360.log.gz 2024-09-18T12:29:45.875 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32425.log 2024-09-18T12:29:45.875 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30515.log.gz 2024-09-18T12:29:45.875 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32271.log 2024-09-18T12:29:45.875 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31522.log.gz 2024-09-18T12:29:45.875 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31048.log 2024-09-18T12:29:45.875 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32425.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-18T12:29:45.875 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-18T12:29:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32271.log.gz 2024-09-18T12:29:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31048.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31048.log.gz-5 2024-09-18T12:29:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:--verbose -- /var/log/ceph/ceph-client.admin.31986.log 2024-09-18T12:29:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25257.log 2024-09-18T12:29:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32656.log 2024-09-18T12:29:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31986.log.gz 2024-09-18T12:29:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25257.log.gz 2024-09-18T12:29:45.876 INFO:teuthology.orchestra.run.smithi042.stderr: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-18T12:29:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-18T12:29:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32682.log 2024-09-18T12:29:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32656.log.gz 2024-09-18T12:29:45.877 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31056.log 2024-09-18T12:29:45.877 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32682.log.gz 2024-09-18T12:29:45.881 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30516.log 2024-09-18T12:29:45.881 INFO:teuthology.orchestra.run.smithi042.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-18T12:29:45.881 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31056.log.gz 2024-09-18T12:29:45.884 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31051.log 2024-09-18T12:29:45.884 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31935.log 2024-09-18T12:29:45.884 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30516.log.gz 2024-09-18T12:29:45.884 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31051.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-18T12:29:45.884 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31051.log.gz 2024-09-18T12:29:45.884 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30386.log 2024-09-18T12:29:45.884 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31935.log.gz 2024-09-18T12:29:45.884 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30784.log 2024-09-18T12:29:45.885 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33308.log 2024-09-18T12:29:45.885 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30386.log.gz 2024-09-18T12:29:45.885 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30784.log.gz 2024-09-18T12:29:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33470.log 2024-09-18T12:29:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33119.log 2024-09-18T12:29:45.887 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33308.log.gz 2024-09-18T12:29:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33470.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30769.log 2024-09-18T12:29:45.887 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33470.log.gz 2024-09-18T12:29:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31351.log 2024-09-18T12:29:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33119.log.gz 2024-09-18T12:29:45.887 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30769.log.gz 2024-09-18T12:29:45.893 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25307.log 2024-09-18T12:29:45.896 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32168.log /var/log/ceph/ceph-client.admin.31351.log: 2024-09-18T12:29:45.896 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31351.log.gz 2024-09-18T12:29:45.896 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31074.log 2024-09-18T12:29:45.896 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25307.log.gz 2024-09-18T12:29:45.896 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32168.log.gz 2024-09-18T12:29:45.896 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31297.log 2024-09-18T12:29:45.896 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33524.log 2024-09-18T12:29:45.897 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31074.log.gz 2024-09-18T12:29:45.897 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31297.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31805.log 2024-09-18T12:29:45.897 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31297.log.gz 2024-09-18T12:29:45.897 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33524.log.gz 2024-09-18T12:29:45.898 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-18T12:29:45.899 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32876.log 2024-09-18T12:29:45.899 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31805.log.gz 2024-09-18T12:29:45.899 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33254.log 2024-09-18T12:29:45.899 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32876.log.gz 2024-09-18T12:29:45.901 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31575.log 2024-09-18T12:29:45.902 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33254.log.gz 2024-09-18T12:29:45.906 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25360.log 2024-09-18T12:29:45.907 INFO:teuthology.orchestra.run.smithi042.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-18T12:29:45.907 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31575.log.gz 2024-09-18T12:29:45.907 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2024-09-18T12:29:45.907 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30522.log 2024-09-18T12:29:45.907 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25360.log.gz 2024-09-18T12:29:45.907 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31885.log 2024-09-18T12:29:45.907 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30522.log.gz 2024-09-18T12:29:45.908 INFO:teuthology.orchestra.run.smithi042.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2024-09-18T12:29:45.908 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32374.log 2024-09-18T12:29:45.909 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30334.log 2024-09-18T12:29:45.909 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31885.log.gz 2024-09-18T12:29:45.909 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32374.log.gz 2024-09-18T12:29:45.910 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32795.log 2024-09-18T12:29:45.910 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30334.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-18T12:29:45.911 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30334.log.gz 2024-09-18T12:29:45.911 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32194.log 2024-09-18T12:29:45.911 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32795.log.gz 2024-09-18T12:29:45.913 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32530.log 2024-09-18T12:29:45.914 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32194.log.gz 2024-09-18T12:29:45.917 INFO:teuthology.orchestra.run.smithi042.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-18T12:29:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-18T12:29:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33335.log 2024-09-18T12:29:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32530.log.gz 2024-09-18T12:29:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33443.log 2024-09-18T12:29:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33335.log.gz 2024-09-18T12:29:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33443.log.gz 2024-09-18T12:29:45.936 INFO:teuthology.orchestra.run.smithi042.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-18T12:29:45.940 INFO:teuthology.orchestra.run.smithi042.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-18T12:29:45.956 INFO:teuthology.orchestra.run.smithi042.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2024-09-18T12:29:45.965 INFO:teuthology.orchestra.run.smithi042.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-18T12:29:45.967 INFO:teuthology.orchestra.run.smithi042.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-18T12:29:45.973 INFO:teuthology.orchestra.run.smithi042.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-18T12:29:45.975 INFO:teuthology.orchestra.run.smithi042.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-18T12:29:45.977 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-18T12:29:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m0.203s 2024-09-18T12:29:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:user 0m0.956s 2024-09-18T12:29:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m0.087s 2024-09-18T12:29:45.977 INFO:tasks.ceph:Archiving logs... 2024-09-18T12:29:45.978 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7911040/remote/smithi042/log 2024-09-18T12:29:45.978 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T12:29:46.205 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-18T12:29:46.225 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-18T12:29:46.226 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T12:29:46.268 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-18T12:29:46.277 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-18T12:29:46.277 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T12:29:46.297 INFO:teuthology.orchestra.run.smithi042.stdout: remote refid st t when poll reach delay offset jitter 2024-09-18T12:29:46.297 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================== 2024-09-18T12:29:46.297 INFO:teuthology.orchestra.run.smithi042.stdout:+hv01.front.sepi 67.205.162.81 3 u 35 64 37 0.066 0.801 0.860 2024-09-18T12:29:46.297 INFO:teuthology.orchestra.run.smithi042.stdout:+hv02.front.sepi 63.231.80.2 3 u 35 64 37 0.097 2.690 0.897 2024-09-18T12:29:46.297 INFO:teuthology.orchestra.run.smithi042.stdout:*hv03.front.sepi 74.6.168.72 3 u 35 64 37 0.139 -0.494 0.922 2024-09-18T12:29:46.297 INFO:teuthology.orchestra.run.smithi042.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-18T12:29:46.298 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-18T12:29:46.309 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-18T12:29:46.309 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-18T12:29:46.337 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-18T12:29:46.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-18T12:29:46.420 INFO:teuthology.task.internal:Duration was 644.912694 seconds 2024-09-18T12:29:46.421 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-18T12:29:46.471 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-18T12:29:46.471 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T12:29:46.524 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-18T12:29:46.524 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-09-18T12:29:46.525 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T12:29:46.538 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-18T12:29:46.538 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T12:29:46.619 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-18T12:29:46.620 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T12:29:46.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-18T12:29:46.694 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-18T12:29:46.694 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T12:29:46.705 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-18T12:29:46.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T12:29:46.762 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-09-18T12:29:46.779 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T12:29:46.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T12:29:46.785 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-18T12:29:46.796 INFO:teuthology.task.internal:Transferring archived files... 2024-09-18T12:29:46.797 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7911040/remote/smithi042 2024-09-18T12:29:46.797 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T12:29:46.824 INFO:teuthology.task.internal:Removing archive directory... 2024-09-18T12:29:46.824 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T12:29:46.870 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-18T12:29:46.881 INFO:teuthology.task.internal:Not uploading archives. 2024-09-18T12:29:46.881 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-18T12:29:46.889 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-18T12:29:46.890 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T12:29:46.897 INFO:teuthology.orchestra.run.smithi042.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 12:29 /home/ubuntu/cephtest 2024-09-18T12:29:46.900 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-18T12:29:46.910 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-18T12:29:46.942 INFO:teuthology.run:Summary data: description: rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} duration: 644.9126944541931 flavor: default owner: scheduled_skanta@teuthology success: true 2024-09-18T12:29:46.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T12:29:47.024 INFO:teuthology.run:pass