2026-02-12T18:03:19.828 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T18:03:19.844 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:03:19.921 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46509 branch: wip-yuri4-testing-2026-02-11-2126 description: rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '46509' kernel: branch: distro kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri4-testing-2026-02-11-2126 ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 30 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd debug verify cached snaps: true osd debug verify missing on start: true osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd op queue: debug_random osd op queue cut off: debug_random flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 workunit: branch: wip-yuri4-testing-2026-02-11-2126 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - osd.4 - osd.5 - osd.6 - osd.7 - osd.8 - osd.9 - client.0 seed: 7172 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri4-testing-2026-02-11-2126 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 targets: trial060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhLA6B0D/hbdHtzPN2DFKKKTfH+TRh9EXzpd6xQ/875VX4ICZcKRtkGVvOS+rw4kMxlctZOzGrLHGWWVOKBvCY= tasks: - install: null - ceph: conf: osd: osd max object name len: 400 osd max object namespace len: 64 log-ignorelist: - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - workunit: clients: all: - rados/test_health_warnings.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-12_15:38:14 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T18:03:19.921 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa; will attempt to use it 2026-02-12T18:03:19.921 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks 2026-02-12T18:03:19.921 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T18:03:19.923 INFO:teuthology.task.internal:Checking packages... 2026-02-12T18:03:19.923 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'afefaa40503a4bf024e96f97dd7f852b75f00ad6' 2026-02-12T18:03:19.923 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T18:03:19.923 INFO:teuthology.packaging:ref: None 2026-02-12T18:03:19.923 INFO:teuthology.packaging:tag: None 2026-02-12T18:03:19.923 INFO:teuthology.packaging:branch: wip-yuri4-testing-2026-02-11-2126 2026-02-12T18:03:19.923 INFO:teuthology.packaging:sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T18:03:19.923 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri4-testing-2026-02-11-2126 2026-02-12T18:03:20.038 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5230-gafefaa40-1jammy 2026-02-12T18:03:20.039 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T18:03:20.050 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T18:03:20.050 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T18:03:20.064 INFO:teuthology.task.internal:Saving configuration 2026-02-12T18:03:20.073 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T18:03:20.089 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T18:03:20.169 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial060.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46509', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 18:00:07.495945', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEJmFEYLYYgw2/kDGNB103Qa1wes++YU2nQyheo1lV20'} 2026-02-12T18:03:20.169 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T18:03:20.179 INFO:teuthology.task.internal:roles: ubuntu@trial060.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'osd.8', 'osd.9', 'client.0'] 2026-02-12T18:03:20.179 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T18:03:20.257 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7744fc9bd440>, signals=[15]) 2026-02-12T18:03:20.258 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T18:03:20.268 INFO:teuthology.task.internal:Opening connections... 2026-02-12T18:03:20.268 DEBUG:teuthology.task.internal:connecting to ubuntu@trial060.front.sepia.ceph.com 2026-02-12T18:03:20.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T18:03:20.332 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T18:03:20.343 DEBUG:teuthology.orchestra.run.trial060:> uname -m 2026-02-12T18:03:20.408 INFO:teuthology.orchestra.run.trial060.stdout:x86_64 2026-02-12T18:03:20.408 DEBUG:teuthology.orchestra.run.trial060:> cat /etc/os-release 2026-02-12T18:03:20.451 INFO:teuthology.orchestra.run.trial060.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-12T18:03:20.451 INFO:teuthology.orchestra.run.trial060.stdout:NAME="Ubuntu" 2026-02-12T18:03:20.452 INFO:teuthology.orchestra.run.trial060.stdout:VERSION_ID="22.04" 2026-02-12T18:03:20.452 INFO:teuthology.orchestra.run.trial060.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-12T18:03:20.452 INFO:teuthology.orchestra.run.trial060.stdout:VERSION_CODENAME=jammy 2026-02-12T18:03:20.452 INFO:teuthology.orchestra.run.trial060.stdout:ID=ubuntu 2026-02-12T18:03:20.452 INFO:teuthology.orchestra.run.trial060.stdout:ID_LIKE=debian 2026-02-12T18:03:20.452 INFO:teuthology.orchestra.run.trial060.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-12T18:03:20.452 INFO:teuthology.orchestra.run.trial060.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-12T18:03:20.452 INFO:teuthology.orchestra.run.trial060.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-12T18:03:20.452 INFO:teuthology.orchestra.run.trial060.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-12T18:03:20.452 INFO:teuthology.orchestra.run.trial060.stdout:UBUNTU_CODENAME=jammy 2026-02-12T18:03:20.453 INFO:teuthology.lock.ops:Updating trial060.front.sepia.ceph.com on lock server 2026-02-12T18:03:20.538 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T18:03:20.551 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T18:03:20.563 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T18:03:20.564 DEBUG:teuthology.orchestra.run.trial060:> test '!' -e /home/ubuntu/cephtest 2026-02-12T18:03:20.566 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T18:03:20.580 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T18:03:20.580 DEBUG:teuthology.orchestra.run.trial060:> test -z $(ls -A /var/lib/ceph) 2026-02-12T18:03:20.612 INFO:teuthology.orchestra.run.trial060.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T18:03:20.612 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T18:03:20.687 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T18:03:20.711 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-12T18:03:20.712 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-12T18:03:20.712 DEBUG:teuthology.orchestra.run.trial060:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T18:03:20.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T18:03:20.715 DEBUG:teuthology.orchestra.run.trial060:> uname -r 2026-02-12T18:03:20.759 INFO:teuthology.orchestra.run.trial060.stdout:5.15.0-164-generic 2026-02-12T18:03:20.759 INFO:teuthology.task.kernel:Running kernel on trial060: 5.15.0-164-generic 2026-02-12T18:03:20.759 DEBUG:teuthology.orchestra.run.trial060:> sudo apt-get clean 2026-02-12T18:03:20.817 DEBUG:teuthology.orchestra.run.trial060:> sudo apt-get update 2026-02-12T18:03:21.246 INFO:teuthology.orchestra.run.trial060.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-12T18:03:21.322 INFO:teuthology.orchestra.run.trial060.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-12T18:03:21.602 INFO:teuthology.orchestra.run.trial060.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-12T18:03:21.726 INFO:teuthology.orchestra.run.trial060.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-12T18:03:21.842 INFO:teuthology.orchestra.run.trial060.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3220 kB] 2026-02-12T18:03:22.171 INFO:teuthology.orchestra.run.trial060.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-12T18:03:22.171 INFO:teuthology.orchestra.run.trial060.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1254 kB] 2026-02-12T18:03:22.199 INFO:teuthology.orchestra.run.trial060.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-12T18:03:22.205 INFO:teuthology.orchestra.run.trial060.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.2 kB] 2026-02-12T18:03:22.206 INFO:teuthology.orchestra.run.trial060.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2959 kB] 2026-02-12T18:03:22.276 INFO:teuthology.orchestra.run.trial060.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [425 kB] 2026-02-12T18:03:22.284 INFO:teuthology.orchestra.run.trial060.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-12T18:03:22.285 INFO:teuthology.orchestra.run.trial060.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1016 kB] 2026-02-12T18:03:22.302 INFO:teuthology.orchestra.run.trial060.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-12T18:03:22.312 INFO:teuthology.orchestra.run.trial060.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-12T18:03:22.317 INFO:teuthology.orchestra.run.trial060.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5089 kB] 2026-02-12T18:03:22.433 INFO:teuthology.orchestra.run.trial060.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [963 kB] 2026-02-12T18:03:25.531 INFO:teuthology.orchestra.run.trial060.stdout:Fetched 15.9 MB in 2s (7226 kB/s) 2026-02-12T18:03:26.059 INFO:teuthology.orchestra.run.trial060.stdout:Reading package lists... 2026-02-12T18:03:26.072 DEBUG:teuthology.orchestra.run.trial060:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-12T18:03:26.105 INFO:teuthology.orchestra.run.trial060.stdout:Reading package lists... 2026-02-12T18:03:26.210 INFO:teuthology.orchestra.run.trial060.stdout:Building dependency tree... 2026-02-12T18:03:26.211 INFO:teuthology.orchestra.run.trial060.stdout:Reading state information... 2026-02-12T18:03:26.296 INFO:teuthology.orchestra.run.trial060.stdout:The following packages were automatically installed and are no longer required: 2026-02-12T18:03:26.296 INFO:teuthology.orchestra.run.trial060.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-12T18:03:26.296 INFO:teuthology.orchestra.run.trial060.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-12T18:03:26.296 INFO:teuthology.orchestra.run.trial060.stdout: sg3-utils-udev 2026-02-12T18:03:26.296 INFO:teuthology.orchestra.run.trial060.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-12T18:03:26.296 INFO:teuthology.orchestra.run.trial060.stdout:The following additional packages will be installed: 2026-02-12T18:03:26.296 INFO:teuthology.orchestra.run.trial060.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-12T18:03:26.297 INFO:teuthology.orchestra.run.trial060.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-12T18:03:26.297 INFO:teuthology.orchestra.run.trial060.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-12T18:03:26.297 INFO:teuthology.orchestra.run.trial060.stdout:Suggested packages: 2026-02-12T18:03:26.297 INFO:teuthology.orchestra.run.trial060.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-12T18:03:26.310 INFO:teuthology.orchestra.run.trial060.stdout:The following NEW packages will be installed: 2026-02-12T18:03:26.310 INFO:teuthology.orchestra.run.trial060.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-12T18:03:26.310 INFO:teuthology.orchestra.run.trial060.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-12T18:03:26.311 INFO:teuthology.orchestra.run.trial060.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-12T18:03:26.311 INFO:teuthology.orchestra.run.trial060.stdout:The following packages will be upgraded: 2026-02-12T18:03:26.311 INFO:teuthology.orchestra.run.trial060.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-12T18:03:26.406 INFO:teuthology.orchestra.run.trial060.stdout:3 upgraded, 5 newly installed, 0 to remove and 37 not upgraded. 2026-02-12T18:03:26.406 INFO:teuthology.orchestra.run.trial060.stdout:Need to get 113 MB of archives. 2026-02-12T18:03:26.407 INFO:teuthology.orchestra.run.trial060.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-12T18:03:26.407 INFO:teuthology.orchestra.run.trial060.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-12T18:03:26.574 INFO:teuthology.orchestra.run.trial060.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-12T18:03:26.617 INFO:teuthology.orchestra.run.trial060.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-12T18:03:26.854 INFO:teuthology.orchestra.run.trial060.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-12T18:03:26.855 INFO:teuthology.orchestra.run.trial060.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-12T18:03:26.855 INFO:teuthology.orchestra.run.trial060.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-12T18:03:26.903 INFO:teuthology.orchestra.run.trial060.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-12T18:03:26.914 INFO:teuthology.orchestra.run.trial060.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-12T18:03:27.109 INFO:teuthology.orchestra.run.trial060.stdout:Fetched 113 MB in 1s (189 MB/s) 2026-02-12T18:03:27.130 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-12T18:03:27.293 INFO:teuthology.orchestra.run.trial060.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-12T18:03:27.295 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-12T18:03:27.296 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-12T18:03:27.648 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-12T18:03:27.654 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-12T18:03:27.670 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-12T18:03:27.710 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-12T18:03:27.717 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-12T18:03:27.717 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-12T18:03:28.812 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-12T18:03:28.813 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-12T18:03:28.835 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-12T18:03:28.835 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-12T18:03:28.851 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-12T18:03:28.858 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-12T18:03:28.858 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-12T18:03:30.199 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-12T18:03:30.210 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-12T18:03:30.211 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-12T18:03:30.795 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-12T18:03:30.796 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-12T18:03:30.821 INFO:teuthology.orchestra.run.trial060.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-12T18:03:30.822 INFO:teuthology.orchestra.run.trial060.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-12T18:03:30.823 INFO:teuthology.orchestra.run.trial060.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-12T18:03:30.824 INFO:teuthology.orchestra.run.trial060.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-12T18:03:31.609 INFO:teuthology.orchestra.run.trial060.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-12T18:03:32.445 INFO:teuthology.orchestra.run.trial060.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-12T18:03:32.445 INFO:teuthology.orchestra.run.trial060.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-12T18:03:32.451 INFO:teuthology.orchestra.run.trial060.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-12T18:03:33.256 INFO:teuthology.orchestra.run.trial060.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-12T18:03:33.258 INFO:teuthology.orchestra.run.trial060.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-12T18:03:33.259 INFO:teuthology.orchestra.run.trial060.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-12T18:03:33.264 INFO:teuthology.orchestra.run.trial060.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-12T18:03:33.264 INFO:teuthology.orchestra.run.trial060.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-12T18:03:40.320 INFO:teuthology.orchestra.run.trial060.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-12T18:03:46.868 INFO:teuthology.orchestra.run.trial060.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-12T18:03:46.868 INFO:teuthology.orchestra.run.trial060.stdout:Sourcing file `/etc/default/grub' 2026-02-12T18:03:46.886 INFO:teuthology.orchestra.run.trial060.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-12T18:03:46.887 INFO:teuthology.orchestra.run.trial060.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-12T18:03:46.889 INFO:teuthology.orchestra.run.trial060.stdout:Generating grub configuration file ... 2026-02-12T18:03:46.969 INFO:teuthology.orchestra.run.trial060.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-12T18:03:46.976 INFO:teuthology.orchestra.run.trial060.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-12T18:03:47.151 INFO:teuthology.orchestra.run.trial060.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-12T18:03:47.156 INFO:teuthology.orchestra.run.trial060.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-12T18:03:47.228 INFO:teuthology.orchestra.run.trial060.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-12T18:03:47.229 INFO:teuthology.orchestra.run.trial060.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-12T18:03:47.229 INFO:teuthology.orchestra.run.trial060.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-12T18:03:47.230 INFO:teuthology.orchestra.run.trial060.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T18:03:47.240 INFO:teuthology.orchestra.run.trial060.stdout:done 2026-02-12T18:03:47.682 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:03:47.682 INFO:teuthology.orchestra.run.trial060.stdout:Pending kernel upgrade! 2026-02-12T18:03:47.682 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:03:47.682 INFO:teuthology.orchestra.run.trial060.stdout:Running kernel version: 2026-02-12T18:03:47.682 INFO:teuthology.orchestra.run.trial060.stdout: 5.15.0-164-generic 2026-02-12T18:03:47.682 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:03:47.682 INFO:teuthology.orchestra.run.trial060.stdout:Diagnostics: 2026-02-12T18:03:47.682 INFO:teuthology.orchestra.run.trial060.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-12T18:03:47.683 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:03:47.683 INFO:teuthology.orchestra.run.trial060.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-12T18:03:47.683 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:03:47.683 INFO:teuthology.orchestra.run.trial060.stdout:The processor microcode seems to be up-to-date. 2026-02-12T18:03:47.683 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:03:47.683 INFO:teuthology.orchestra.run.trial060.stdout:No services need to be restarted. 2026-02-12T18:03:47.683 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:03:47.683 INFO:teuthology.orchestra.run.trial060.stdout:No containers need to be restarted. 2026-02-12T18:03:47.683 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:03:47.683 INFO:teuthology.orchestra.run.trial060.stdout:No user sessions are running outdated binaries. 2026-02-12T18:03:47.683 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:03:47.683 INFO:teuthology.orchestra.run.trial060.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-12T18:03:48.340 DEBUG:teuthology.orchestra.run.trial060:> dpkg -s linux-image-generic 2026-02-12T18:03:48.390 INFO:teuthology.orchestra.run.trial060.stdout:Package: linux-image-generic 2026-02-12T18:03:48.390 INFO:teuthology.orchestra.run.trial060.stdout:Status: install ok installed 2026-02-12T18:03:48.390 INFO:teuthology.orchestra.run.trial060.stdout:Priority: optional 2026-02-12T18:03:48.390 INFO:teuthology.orchestra.run.trial060.stdout:Section: kernel 2026-02-12T18:03:48.391 INFO:teuthology.orchestra.run.trial060.stdout:Installed-Size: 21 2026-02-12T18:03:48.391 INFO:teuthology.orchestra.run.trial060.stdout:Maintainer: Ubuntu Kernel Team 2026-02-12T18:03:48.391 INFO:teuthology.orchestra.run.trial060.stdout:Architecture: amd64 2026-02-12T18:03:48.391 INFO:teuthology.orchestra.run.trial060.stdout:Source: linux-meta 2026-02-12T18:03:48.391 INFO:teuthology.orchestra.run.trial060.stdout:Version: 5.15.0.170.159 2026-02-12T18:03:48.391 INFO:teuthology.orchestra.run.trial060.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-12T18:03:48.391 INFO:teuthology.orchestra.run.trial060.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-12T18:03:48.391 INFO:teuthology.orchestra.run.trial060.stdout:Recommends: thermald 2026-02-12T18:03:48.391 INFO:teuthology.orchestra.run.trial060.stdout:Description: Generic Linux kernel image 2026-02-12T18:03:48.391 INFO:teuthology.orchestra.run.trial060.stdout: This package will always depend on the latest generic kernel image 2026-02-12T18:03:48.391 INFO:teuthology.orchestra.run.trial060.stdout: available. 2026-02-12T18:03:48.393 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-12T18:03:48.393 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T18:03:48.393 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T18:03:48.393 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T18:03:48.393 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial060.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T18:03:48.393 DEBUG:teuthology.orchestra.run.trial060:> sudo apt-get clean 2026-02-12T18:03:48.472 DEBUG:teuthology.orchestra.run.trial060:> sudo apt-get update 2026-02-12T18:03:48.664 INFO:teuthology.orchestra.run.trial060.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-12T18:03:48.668 INFO:teuthology.orchestra.run.trial060.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-12T18:03:48.678 INFO:teuthology.orchestra.run.trial060.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-12T18:03:48.688 INFO:teuthology.orchestra.run.trial060.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-12T18:03:49.508 INFO:teuthology.orchestra.run.trial060.stdout:Reading package lists... 2026-02-12T18:03:49.522 DEBUG:teuthology.orchestra.run.trial060:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-12T18:03:49.554 INFO:teuthology.orchestra.run.trial060.stdout:Reading package lists... 2026-02-12T18:03:49.661 INFO:teuthology.orchestra.run.trial060.stdout:Building dependency tree... 2026-02-12T18:03:49.661 INFO:teuthology.orchestra.run.trial060.stdout:Reading state information... 2026-02-12T18:03:49.746 INFO:teuthology.orchestra.run.trial060.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-12T18:03:49.746 INFO:teuthology.orchestra.run.trial060.stdout:linux-image-generic set to manually installed. 2026-02-12T18:03:49.746 INFO:teuthology.orchestra.run.trial060.stdout:The following packages were automatically installed and are no longer required: 2026-02-12T18:03:49.746 INFO:teuthology.orchestra.run.trial060.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-12T18:03:49.746 INFO:teuthology.orchestra.run.trial060.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-12T18:03:49.747 INFO:teuthology.orchestra.run.trial060.stdout: sg3-utils-udev 2026-02-12T18:03:49.747 INFO:teuthology.orchestra.run.trial060.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-12T18:03:49.766 INFO:teuthology.orchestra.run.trial060.stdout:0 upgraded, 0 newly installed, 0 to remove and 37 not upgraded. 2026-02-12T18:03:49.768 DEBUG:teuthology.orchestra.run.trial060:> dpkg -s linux-image-generic 2026-02-12T18:03:49.818 INFO:teuthology.orchestra.run.trial060.stdout:Package: linux-image-generic 2026-02-12T18:03:49.819 INFO:teuthology.orchestra.run.trial060.stdout:Status: install ok installed 2026-02-12T18:03:49.819 INFO:teuthology.orchestra.run.trial060.stdout:Priority: optional 2026-02-12T18:03:49.819 INFO:teuthology.orchestra.run.trial060.stdout:Section: kernel 2026-02-12T18:03:49.819 INFO:teuthology.orchestra.run.trial060.stdout:Installed-Size: 21 2026-02-12T18:03:49.819 INFO:teuthology.orchestra.run.trial060.stdout:Maintainer: Ubuntu Kernel Team 2026-02-12T18:03:49.819 INFO:teuthology.orchestra.run.trial060.stdout:Architecture: amd64 2026-02-12T18:03:49.819 INFO:teuthology.orchestra.run.trial060.stdout:Source: linux-meta 2026-02-12T18:03:49.819 INFO:teuthology.orchestra.run.trial060.stdout:Version: 5.15.0.170.159 2026-02-12T18:03:49.819 INFO:teuthology.orchestra.run.trial060.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-12T18:03:49.820 INFO:teuthology.orchestra.run.trial060.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-12T18:03:49.820 INFO:teuthology.orchestra.run.trial060.stdout:Recommends: thermald 2026-02-12T18:03:49.820 INFO:teuthology.orchestra.run.trial060.stdout:Description: Generic Linux kernel image 2026-02-12T18:03:49.820 INFO:teuthology.orchestra.run.trial060.stdout: This package will always depend on the latest generic kernel image 2026-02-12T18:03:49.820 INFO:teuthology.orchestra.run.trial060.stdout: available. 2026-02-12T18:03:49.820 DEBUG:teuthology.orchestra.run.trial060:> mktemp 2026-02-12T18:03:49.864 INFO:teuthology.orchestra.run.trial060.stdout:/tmp/tmp.GBKBykhFir 2026-02-12T18:03:49.864 DEBUG:teuthology.orchestra.run.trial060:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GBKBykhFir 2026-02-12T18:03:49.912 DEBUG:teuthology.orchestra.run.trial060:> sudo chmod 0666 /tmp/tmp.GBKBykhFir 2026-02-12T18:03:50.006 DEBUG:teuthology.orchestra.remote:trial060:/tmp/tmp.GBKBykhFir is 7KB 2026-02-12T18:03:50.013 DEBUG:teuthology.orchestra.run.trial060:> rm -fr /tmp/tmp.GBKBykhFir 2026-02-12T18:03:50.016 DEBUG:teuthology.orchestra.run.trial060:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-12T18:03:50.064 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:03:50.064 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-12T18:03:50.064 DEBUG:teuthology.orchestra.run.trial060:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-12T18:03:50.122 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-12T18:03:50.122 DEBUG:teuthology.orchestra.run.trial060:> sudo update-grub 2026-02-12T18:03:50.364 INFO:teuthology.orchestra.run.trial060.stderr:Sourcing file `/etc/default/grub' 2026-02-12T18:03:50.383 INFO:teuthology.orchestra.run.trial060.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-12T18:03:50.384 INFO:teuthology.orchestra.run.trial060.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-12T18:03:50.386 INFO:teuthology.orchestra.run.trial060.stderr:Generating grub configuration file ... 2026-02-12T18:03:50.467 INFO:teuthology.orchestra.run.trial060.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-12T18:03:50.473 INFO:teuthology.orchestra.run.trial060.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-12T18:03:50.646 INFO:teuthology.orchestra.run.trial060.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-12T18:03:50.652 INFO:teuthology.orchestra.run.trial060.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-12T18:03:50.721 INFO:teuthology.orchestra.run.trial060.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-12T18:03:50.721 INFO:teuthology.orchestra.run.trial060.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-12T18:03:50.721 INFO:teuthology.orchestra.run.trial060.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-12T18:03:50.724 INFO:teuthology.orchestra.run.trial060.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T18:03:50.731 INFO:teuthology.orchestra.run.trial060.stderr:done 2026-02-12T18:03:50.732 DEBUG:teuthology.orchestra.run.trial060:> sudo shutdown -r now 2026-02-12T18:04:20.764 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T18:04:20.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial060.front.sepia.ceph.com' 2026-02-12T18:04:20.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T18:04:35.037 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.60 2026-02-12T18:04:44.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial060.front.sepia.ceph.com' 2026-02-12T18:04:44.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T18:05:20.025 DEBUG:teuthology.orchestra.run.trial060:> true 2026-02-12T18:05:20.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial060.front.sepia.ceph.com' 2026-02-12T18:05:20.414 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-12T18:05:20.414 DEBUG:teuthology.orchestra.run.trial060:> uname -r 2026-02-12T18:05:20.462 INFO:teuthology.orchestra.run.trial060.stdout:5.15.0-170-generic 2026-02-12T18:05:20.463 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-12T18:05:20.463 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T18:05:20.463 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-12T18:05:21.464 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-12T18:05:21.464 DEBUG:teuthology.orchestra.run.trial060:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T18:05:21.478 INFO:teuthology.orchestra.run.trial060.stdout:ttyS1 2026-02-12T18:05:21.512 DEBUG:teuthology.parallel:result is None 2026-02-12T18:05:21.513 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-12T18:05:21.519 INFO:teuthology.task.internal:Creating test directory... 2026-02-12T18:05:21.519 DEBUG:teuthology.orchestra.run.trial060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T18:05:21.558 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-12T18:05:21.571 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-12T18:05:21.584 INFO:teuthology.task.internal:Creating archive directory... 2026-02-12T18:05:21.584 DEBUG:teuthology.orchestra.run.trial060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T18:05:21.609 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-12T18:05:21.624 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-12T18:05:21.624 DEBUG:teuthology.orchestra.run.trial060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T18:05:21.655 INFO:teuthology.orchestra.run.trial060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T18:05:21.661 INFO:teuthology.orchestra.run.trial060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T18:05:21.663 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-12T18:05:21.675 INFO:teuthology.task.internal:Configuring sudo... 2026-02-12T18:05:21.675 DEBUG:teuthology.orchestra.run.trial060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T18:05:21.715 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-12T18:05:21.731 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-12T18:05:21.731 DEBUG:teuthology.orchestra.run.trial060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T18:05:21.766 DEBUG:teuthology.orchestra.run.trial060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T18:05:21.810 DEBUG:teuthology.orchestra.run.trial060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T18:05:21.858 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:05:21.858 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T18:05:21.907 DEBUG:teuthology.orchestra.run.trial060:> sudo service rsyslog restart 2026-02-12T18:05:21.972 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-12T18:05:22.000 INFO:teuthology.task.internal:Starting timer... 2026-02-12T18:05:22.000 INFO:teuthology.run_tasks:Running task pcp... 2026-02-12T18:05:22.058 INFO:teuthology.run_tasks:Running task selinux... 2026-02-12T18:05:22.087 DEBUG:teuthology.task.selinux:Excluding trial060: OS 'ubuntu' does not support SELinux 2026-02-12T18:05:22.087 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-12T18:05:22.087 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-12T18:05:22.087 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-12T18:05:22.088 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-12T18:05:22.103 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-12T18:05:22.120 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-12T18:05:22.121 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial060.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-12T18:06:23.937 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial060.front.sepia.ceph.com')] 2026-02-12T18:06:23.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial060.front.sepia.ceph.com' 2026-02-12T18:06:23.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T18:06:24.051 DEBUG:teuthology.orchestra.run.trial060:> true 2026-02-12T18:06:24.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial060.front.sepia.ceph.com' 2026-02-12T18:06:24.299 INFO:teuthology.run_tasks:Running task clock... 2026-02-12T18:06:24.317 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-12T18:06:24.317 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T18:06:24.318 DEBUG:teuthology.orchestra.run.trial060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T18:06:24.363 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-12T18:06:24.363 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: Command line: ntpd -gq 2026-02-12T18:06:24.363 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: ---------------------------------------------------- 2026-02-12T18:06:24.363 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: ntp-4 is maintained by Network Time Foundation, 2026-02-12T18:06:24.363 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-12T18:06:24.363 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: corporation. Support and training for ntp-4 are 2026-02-12T18:06:24.363 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: available at https://www.nwtime.org/support 2026-02-12T18:06:24.363 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: ---------------------------------------------------- 2026-02-12T18:06:24.364 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: proto: precision = 0.020 usec (-25) 2026-02-12T18:06:24.364 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: basedate set to 2022-02-04 2026-02-12T18:06:24.364 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: gps base set to 2022-02-06 (week 2196) 2026-02-12T18:06:24.364 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-12T18:06:24.364 INFO:teuthology.orchestra.run.trial060.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-12T18:06:24.364 INFO:teuthology.orchestra.run.trial060.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-12T18:06:24.365 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: restrict ::: KOD does nothing without LIMITED. 2026-02-12T18:06:24.365 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: Listen and drop on 0 v6wildcard [::]:123 2026-02-12T18:06:24.366 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-12T18:06:24.366 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: Listen normally on 2 lo 127.0.0.1:123 2026-02-12T18:06:24.366 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: Listen normally on 3 enp1s0f0 10.20.193.60:123 2026-02-12T18:06:24.366 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: Listen normally on 4 lo [::1]:123 2026-02-12T18:06:24.366 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:6294%2]:123 2026-02-12T18:06:24.366 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:24 ntpd[4914]: Listening on routing socket on fd #22 for interface updates 2026-02-12T18:06:25.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:25 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:25.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:25 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:25.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:25 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:25.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:25 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:25.392 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:25 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:25.393 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:25 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:25.393 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:25 ntpd[4914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-12T18:06:25.393 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:25 ntpd[4914]: can't open /var/log/ntpstats/peerstats.20260212: Permission denied 2026-02-12T18:06:26.362 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:26 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:26.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:26 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:26.444 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:26 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:26.444 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:26 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:26.444 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:26 ntpd[4914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-12T18:06:26.444 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:26 ntpd[4914]: can't open /var/log/ntpstats/peerstats.20260212: Permission denied 2026-02-12T18:06:27.362 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:27 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:27.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:27 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:27.392 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:27 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:27.392 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:27 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:27.393 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:27 ntpd[4914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-12T18:06:27.393 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:27 ntpd[4914]: can't open /var/log/ntpstats/peerstats.20260212: Permission denied 2026-02-12T18:06:28.362 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:28 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:28.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:28 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:28.444 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:28 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:28.444 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:28 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:28.444 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:28 ntpd[4914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-12T18:06:28.444 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:28 ntpd[4914]: can't open /var/log/ntpstats/peerstats.20260212: Permission denied 2026-02-12T18:06:29.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:29 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:29.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:29 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:29.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:29 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:29.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:29 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:29.373 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:29 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:29.373 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:29 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:29.373 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:29 ntpd[4914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-12T18:06:29.373 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:29 ntpd[4914]: can't open /var/log/ntpstats/peerstats.20260212: Permission denied 2026-02-12T18:06:29.392 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:29 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:29.392 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:29 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:29.392 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:29 ntpd[4914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-12T18:06:29.393 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:29 ntpd[4914]: can't open /var/log/ntpstats/peerstats.20260212: Permission denied 2026-02-12T18:06:30.362 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:30 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:30.362 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:30 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:30.444 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:30 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:30.444 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:30 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:30.444 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:30 ntpd[4914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-12T18:06:30.444 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:30 ntpd[4914]: can't open /var/log/ntpstats/peerstats.20260212: Permission denied 2026-02-12T18:06:31.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:31.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:31.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:31.363 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:31.373 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:31.373 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:31.373 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-12T18:06:31.373 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: can't open /var/log/ntpstats/peerstats.20260212: Permission denied 2026-02-12T18:06:31.392 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-12T18:06:31.392 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: can't open /var/log/ntpstats/rawstats.20260212: Permission denied 2026-02-12T18:06:31.392 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-12T18:06:31.392 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: can't open /var/log/ntpstats/peerstats.20260212: Permission denied 2026-02-12T18:06:31.393 INFO:teuthology.orchestra.run.trial060.stdout:12 Feb 18:06:31 ntpd[4914]: ntpd: time set +0.140182 s 2026-02-12T18:06:31.393 INFO:teuthology.orchestra.run.trial060.stdout:ntpd: time set +0.140182s 2026-02-12T18:06:31.393 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-12T18:06:31.394 INFO:teuthology.orchestra.run.trial060.stderr:12 Feb 18:06:31 ntpd[4914]: can't open /var/log/ntpstats/loopstats.20260212: Permission denied 2026-02-12T18:06:31.463 INFO:teuthology.orchestra.run.trial060.stdout: remote refid st t when poll reach delay offset jitter 2026-02-12T18:06:31.463 INFO:teuthology.orchestra.run.trial060.stdout:============================================================================== 2026-02-12T18:06:31.464 INFO:teuthology.orchestra.run.trial060.stdout: sushi.ruselabs. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-12T18:06:31.464 INFO:teuthology.orchestra.run.trial060.stdout: dns-e.ns4v.icu .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-12T18:06:31.464 INFO:teuthology.orchestra.run.trial060.stdout: clock02.cymru.c .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-12T18:06:31.464 INFO:teuthology.orchestra.run.trial060.stdout: ntp1.wiktel.com .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-12T18:06:31.465 INFO:teuthology.run_tasks:Running task install... 2026-02-12T18:06:31.478 DEBUG:teuthology.task.install:project ceph 2026-02-12T18:06:31.478 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}} 2026-02-12T18:06:31.478 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'} 2026-02-12T18:06:31.479 INFO:teuthology.task.install:Using flavor: default 2026-02-12T18:06:31.488 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T18:06:31.488 INFO:teuthology.task.install:extra packages: [] 2026-02-12T18:06:31.488 DEBUG:teuthology.orchestra.run.trial060:> sudo apt-key list | grep Ceph 2026-02-12T18:06:31.559 INFO:teuthology.orchestra.run.trial060.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-12T18:06:31.588 INFO:teuthology.orchestra.run.trial060.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-12T18:06:31.589 INFO:teuthology.orchestra.run.trial060.stdout:uid [ unknown] Ceph.com (release key) 2026-02-12T18:06:31.590 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-12T18:06:31.591 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T18:06:31.756 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default/ 2026-02-12T18:06:31.756 INFO:teuthology.task.install.deb:Package version is 20.3.0-5230-gafefaa40-1jammy 2026-02-12T18:06:32.127 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:06:32.127 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-12T18:06:32.137 DEBUG:teuthology.orchestra.run.trial060:> sudo apt-get update 2026-02-12T18:06:32.524 INFO:teuthology.orchestra.run.trial060.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy InRelease 2026-02-12T18:06:32.580 INFO:teuthology.orchestra.run.trial060.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-12T18:06:32.592 INFO:teuthology.orchestra.run.trial060.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy Release [7689 B] 2026-02-12T18:06:32.646 INFO:teuthology.orchestra.run.trial060.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-12T18:06:32.660 INFO:teuthology.orchestra.run.trial060.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-12T18:06:32.719 INFO:teuthology.orchestra.run.trial060.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-12T18:06:32.729 INFO:teuthology.orchestra.run.trial060.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-12T18:06:32.791 INFO:teuthology.orchestra.run.trial060.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-12T18:06:32.934 INFO:teuthology.orchestra.run.trial060.stdout:Fetched 26.9 kB in 1s (42.3 kB/s) 2026-02-12T18:06:33.454 INFO:teuthology.orchestra.run.trial060.stdout:Reading package lists... 2026-02-12T18:06:33.467 DEBUG:teuthology.orchestra.run.trial060:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5230-gafefaa40-1jammy cephadm=20.3.0-5230-gafefaa40-1jammy ceph-mds=20.3.0-5230-gafefaa40-1jammy ceph-mgr=20.3.0-5230-gafefaa40-1jammy ceph-osd=20.3.0-5230-gafefaa40-1jammy ceph-osd-classic=20.3.0-5230-gafefaa40-1jammy ceph-common=20.3.0-5230-gafefaa40-1jammy ceph-fuse=20.3.0-5230-gafefaa40-1jammy ceph-test=20.3.0-5230-gafefaa40-1jammy ceph-volume=20.3.0-5230-gafefaa40-1jammy radosgw=20.3.0-5230-gafefaa40-1jammy python3-rados=20.3.0-5230-gafefaa40-1jammy python3-rgw=20.3.0-5230-gafefaa40-1jammy python3-cephfs=20.3.0-5230-gafefaa40-1jammy python3-rbd=20.3.0-5230-gafefaa40-1jammy libcephfs2=20.3.0-5230-gafefaa40-1jammy libcephfs-dev=20.3.0-5230-gafefaa40-1jammy librados2=20.3.0-5230-gafefaa40-1jammy librbd1=20.3.0-5230-gafefaa40-1jammy rbd-fuse=20.3.0-5230-gafefaa40-1jammy 2026-02-12T18:06:33.500 INFO:teuthology.orchestra.run.trial060.stdout:Reading package lists... 2026-02-12T18:06:33.607 INFO:teuthology.orchestra.run.trial060.stdout:Building dependency tree... 2026-02-12T18:06:33.608 INFO:teuthology.orchestra.run.trial060.stdout:Reading state information... 2026-02-12T18:06:33.696 INFO:teuthology.orchestra.run.trial060.stdout:The following packages were automatically installed and are no longer required: 2026-02-12T18:06:33.696 INFO:teuthology.orchestra.run.trial060.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-12T18:06:33.696 INFO:teuthology.orchestra.run.trial060.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-12T18:06:33.696 INFO:teuthology.orchestra.run.trial060.stdout: sg3-utils-udev 2026-02-12T18:06:33.696 INFO:teuthology.orchestra.run.trial060.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-12T18:06:33.696 INFO:teuthology.orchestra.run.trial060.stdout:The following additional packages will be installed: 2026-02-12T18:06:33.696 INFO:teuthology.orchestra.run.trial060.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-12T18:06:33.697 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-12T18:06:33.697 INFO:teuthology.orchestra.run.trial060.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-12T18:06:33.697 INFO:teuthology.orchestra.run.trial060.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-12T18:06:33.697 INFO:teuthology.orchestra.run.trial060.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-12T18:06:33.697 INFO:teuthology.orchestra.run.trial060.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-12T18:06:33.697 INFO:teuthology.orchestra.run.trial060.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-12T18:06:33.697 INFO:teuthology.orchestra.run.trial060.stdout: python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-12T18:06:33.697 INFO:teuthology.orchestra.run.trial060.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-12T18:06:33.697 INFO:teuthology.orchestra.run.trial060.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-12T18:06:33.697 INFO:teuthology.orchestra.run.trial060.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-12T18:06:33.697 INFO:teuthology.orchestra.run.trial060.stdout: python3-pygments python3-pytest python3-repoze.lru python3-requests-oauthlib 2026-02-12T18:06:33.698 INFO:teuthology.orchestra.run.trial060.stdout: python3-routes python3-rsa python3-simplejson python3-sklearn 2026-02-12T18:06:33.698 INFO:teuthology.orchestra.run.trial060.stdout: python3-sklearn-lib python3-tempora python3-threadpoolctl python3-toml 2026-02-12T18:06:33.698 INFO:teuthology.orchestra.run.trial060.stdout: python3-wcwidth python3-webob python3-websocket python3-zc.lockfile 2026-02-12T18:06:33.698 INFO:teuthology.orchestra.run.trial060.stdout: qttranslations5-l10n socat xmlstarlet 2026-02-12T18:06:33.698 INFO:teuthology.orchestra.run.trial060.stdout:Suggested packages: 2026-02-12T18:06:33.698 INFO:teuthology.orchestra.run.trial060.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-12T18:06:33.698 INFO:teuthology.orchestra.run.trial060.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-12T18:06:33.698 INFO:teuthology.orchestra.run.trial060.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-12T18:06:33.698 INFO:teuthology.orchestra.run.trial060.stdout:Recommended packages: 2026-02-12T18:06:33.698 INFO:teuthology.orchestra.run.trial060.stdout: btrfs-tools 2026-02-12T18:06:33.730 INFO:teuthology.orchestra.run.trial060.stdout:The following NEW packages will be installed: 2026-02-12T18:06:33.731 INFO:teuthology.orchestra.run.trial060.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-12T18:06:33.731 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-12T18:06:33.731 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-12T18:06:33.731 INFO:teuthology.orchestra.run.trial060.stdout: ceph-volume cephadm jq libcephfs-daemon libcephfs-dev libcephfs-proxy2 2026-02-12T18:06:33.731 INFO:teuthology.orchestra.run.trial060.stdout: libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-12T18:06:33.731 INFO:teuthology.orchestra.run.trial060.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-12T18:06:33.731 INFO:teuthology.orchestra.run.trial060.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-12T18:06:33.731 INFO:teuthology.orchestra.run.trial060.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-12T18:06:33.731 INFO:teuthology.orchestra.run.trial060.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-12T18:06:33.731 INFO:teuthology.orchestra.run.trial060.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-12T18:06:33.731 INFO:teuthology.orchestra.run.trial060.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-12T18:06:33.732 INFO:teuthology.orchestra.run.trial060.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-12T18:06:33.732 INFO:teuthology.orchestra.run.trial060.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-12T18:06:33.732 INFO:teuthology.orchestra.run.trial060.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-12T18:06:33.732 INFO:teuthology.orchestra.run.trial060.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-12T18:06:33.732 INFO:teuthology.orchestra.run.trial060.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-12T18:06:33.732 INFO:teuthology.orchestra.run.trial060.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-12T18:06:33.732 INFO:teuthology.orchestra.run.trial060.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-12T18:06:33.732 INFO:teuthology.orchestra.run.trial060.stdout: socat xmlstarlet 2026-02-12T18:06:34.064 INFO:teuthology.orchestra.run.trial060.stdout:0 upgraded, 87 newly installed, 0 to remove and 37 not upgraded. 2026-02-12T18:06:34.064 INFO:teuthology.orchestra.run.trial060.stdout:Need to get 701 MB of archives. 2026-02-12T18:06:34.064 INFO:teuthology.orchestra.run.trial060.stdout:After this operation, 2670 MB of additional disk space will be used. 2026-02-12T18:06:34.064 INFO:teuthology.orchestra.run.trial060.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5230-gafefaa40-1jammy [3798 kB] 2026-02-12T18:06:34.085 INFO:teuthology.orchestra.run.trial060.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-12T18:06:34.423 INFO:teuthology.orchestra.run.trial060.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-12T18:06:34.434 INFO:teuthology.orchestra.run.trial060.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-12T18:06:34.503 INFO:teuthology.orchestra.run.trial060.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-12T18:06:34.705 INFO:teuthology.orchestra.run.trial060.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-12T18:06:34.715 INFO:teuthology.orchestra.run.trial060.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-12T18:06:34.742 INFO:teuthology.orchestra.run.trial060.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-12T18:06:34.750 INFO:teuthology.orchestra.run.trial060.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-12T18:06:34.752 INFO:teuthology.orchestra.run.trial060.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-12T18:06:34.753 INFO:teuthology.orchestra.run.trial060.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-12T18:06:34.754 INFO:teuthology.orchestra.run.trial060.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-12T18:06:34.759 INFO:teuthology.orchestra.run.trial060.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5230-gafefaa40-1jammy [2910 kB] 2026-02-12T18:06:34.770 INFO:teuthology.orchestra.run.trial060.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-12T18:06:34.771 INFO:teuthology.orchestra.run.trial060.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-12T18:06:34.777 INFO:teuthology.orchestra.run.trial060.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-12T18:06:34.844 INFO:teuthology.orchestra.run.trial060.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-12T18:06:34.844 INFO:teuthology.orchestra.run.trial060.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-12T18:06:34.844 INFO:teuthology.orchestra.run.trial060.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-12T18:06:34.845 INFO:teuthology.orchestra.run.trial060.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-12T18:06:34.845 INFO:teuthology.orchestra.run.trial060.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-12T18:06:34.846 INFO:teuthology.orchestra.run.trial060.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-12T18:06:34.846 INFO:teuthology.orchestra.run.trial060.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-12T18:06:34.849 INFO:teuthology.orchestra.run.trial060.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-12T18:06:34.849 INFO:teuthology.orchestra.run.trial060.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-12T18:06:34.919 INFO:teuthology.orchestra.run.trial060.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-12T18:06:34.921 INFO:teuthology.orchestra.run.trial060.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-12T18:06:34.922 INFO:teuthology.orchestra.run.trial060.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-12T18:06:34.922 INFO:teuthology.orchestra.run.trial060.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-12T18:06:34.947 INFO:teuthology.orchestra.run.trial060.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-12T18:06:34.949 INFO:teuthology.orchestra.run.trial060.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-12T18:06:34.950 INFO:teuthology.orchestra.run.trial060.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-12T18:06:35.007 INFO:teuthology.orchestra.run.trial060.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-12T18:06:35.007 INFO:teuthology.orchestra.run.trial060.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-12T18:06:35.008 INFO:teuthology.orchestra.run.trial060.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-12T18:06:35.008 INFO:teuthology.orchestra.run.trial060.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-12T18:06:35.009 INFO:teuthology.orchestra.run.trial060.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-12T18:06:35.009 INFO:teuthology.orchestra.run.trial060.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-12T18:06:35.023 INFO:teuthology.orchestra.run.trial060.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5230-gafefaa40-1jammy [882 kB] 2026-02-12T18:06:35.067 INFO:teuthology.orchestra.run.trial060.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-12T18:06:35.069 INFO:teuthology.orchestra.run.trial060.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-12T18:06:35.070 INFO:teuthology.orchestra.run.trial060.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-12T18:06:35.092 INFO:teuthology.orchestra.run.trial060.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5230-gafefaa40-1jammy [359 kB] 2026-02-12T18:06:35.140 INFO:teuthology.orchestra.run.trial060.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-12T18:06:35.142 INFO:teuthology.orchestra.run.trial060.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-12T18:06:35.144 INFO:teuthology.orchestra.run.trial060.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-12T18:06:35.148 INFO:teuthology.orchestra.run.trial060.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-12T18:06:35.151 INFO:teuthology.orchestra.run.trial060.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-12T18:06:35.151 INFO:teuthology.orchestra.run.trial060.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-12T18:06:35.152 INFO:teuthology.orchestra.run.trial060.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-12T18:06:35.152 INFO:teuthology.orchestra.run.trial060.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5230-gafefaa40-1jammy [32.8 kB] 2026-02-12T18:06:35.152 INFO:teuthology.orchestra.run.trial060.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5230-gafefaa40-1jammy [225 kB] 2026-02-12T18:06:35.156 INFO:teuthology.orchestra.run.trial060.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5230-gafefaa40-1jammy [88.4 kB] 2026-02-12T18:06:35.211 INFO:teuthology.orchestra.run.trial060.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5230-gafefaa40-1jammy [339 kB] 2026-02-12T18:06:35.212 INFO:teuthology.orchestra.run.trial060.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-12T18:06:35.212 INFO:teuthology.orchestra.run.trial060.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-12T18:06:35.217 INFO:teuthology.orchestra.run.trial060.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5230-gafefaa40-1jammy [9083 kB] 2026-02-12T18:06:35.218 INFO:teuthology.orchestra.run.trial060.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-12T18:06:35.284 INFO:teuthology.orchestra.run.trial060.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-12T18:06:35.286 INFO:teuthology.orchestra.run.trial060.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-12T18:06:35.286 INFO:teuthology.orchestra.run.trial060.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-12T18:06:35.287 INFO:teuthology.orchestra.run.trial060.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-12T18:06:36.095 INFO:teuthology.orchestra.run.trial060.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5230-gafefaa40-1jammy [112 kB] 2026-02-12T18:06:36.096 INFO:teuthology.orchestra.run.trial060.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5230-gafefaa40-1jammy [261 kB] 2026-02-12T18:06:36.156 INFO:teuthology.orchestra.run.trial060.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5230-gafefaa40-1jammy [31.5 MB] 2026-02-12T18:06:39.542 INFO:teuthology.orchestra.run.trial060.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5230-gafefaa40-1jammy [4982 kB] 2026-02-12T18:06:40.036 INFO:teuthology.orchestra.run.trial060.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5230-gafefaa40-1jammy [293 kB] 2026-02-12T18:06:40.094 INFO:teuthology.orchestra.run.trial060.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5230-gafefaa40-1jammy [127 kB] 2026-02-12T18:06:40.097 INFO:teuthology.orchestra.run.trial060.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5230-gafefaa40-1jammy [922 kB] 2026-02-12T18:06:40.213 INFO:teuthology.orchestra.run.trial060.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5230-gafefaa40-1jammy [7542 kB] 2026-02-12T18:06:40.985 INFO:teuthology.orchestra.run.trial060.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5230-gafefaa40-1jammy [468 MB] 2026-02-12T18:07:02.189 INFO:teuthology.orchestra.run.trial060.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5230-gafefaa40-1jammy [180 kB] 2026-02-12T18:07:02.190 INFO:teuthology.orchestra.run.trial060.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5230-gafefaa40-1jammy [14.0 kB] 2026-02-12T18:07:02.190 INFO:teuthology.orchestra.run.trial060.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5230-gafefaa40-1jammy [1030 kB] 2026-02-12T18:07:02.196 INFO:teuthology.orchestra.run.trial060.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5230-gafefaa40-1jammy [2438 kB] 2026-02-12T18:07:02.209 INFO:teuthology.orchestra.run.trial060.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5230-gafefaa40-1jammy [1068 kB] 2026-02-12T18:07:02.214 INFO:teuthology.orchestra.run.trial060.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5230-gafefaa40-1jammy [190 kB] 2026-02-12T18:07:02.216 INFO:teuthology.orchestra.run.trial060.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5230-gafefaa40-1jammy [54.5 MB] 2026-02-12T18:07:03.253 INFO:teuthology.orchestra.run.trial060.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5230-gafefaa40-1jammy [8626 kB] 2026-02-12T18:07:03.406 INFO:teuthology.orchestra.run.trial060.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5230-gafefaa40-1jammy [14.2 kB] 2026-02-12T18:07:03.406 INFO:teuthology.orchestra.run.trial060.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5230-gafefaa40-1jammy [68.6 MB] 2026-02-12T18:07:04.711 INFO:teuthology.orchestra.run.trial060.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5230-gafefaa40-1jammy [136 kB] 2026-02-12T18:07:04.712 INFO:teuthology.orchestra.run.trial060.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5230-gafefaa40-1jammy [45.1 kB] 2026-02-12T18:07:04.712 INFO:teuthology.orchestra.run.trial060.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5230-gafefaa40-1jammy [31.7 kB] 2026-02-12T18:07:04.712 INFO:teuthology.orchestra.run.trial060.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5230-gafefaa40-1jammy [44.2 kB] 2026-02-12T18:07:04.713 INFO:teuthology.orchestra.run.trial060.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5230-gafefaa40-1jammy [18.3 MB] 2026-02-12T18:07:05.050 INFO:teuthology.orchestra.run.trial060.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5230-gafefaa40-1jammy [93.5 kB] 2026-02-12T18:07:05.325 INFO:teuthology.orchestra.run.trial060.stdout:Fetched 701 MB in 31s (22.4 MB/s) 2026-02-12T18:07:05.341 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-12T18:07:05.495 INFO:teuthology.orchestra.run.trial060.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-12T18:07:05.504 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-12T18:07:05.504 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-12T18:07:05.519 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-12T18:07:05.531 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-12T18:07:05.532 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-12T18:07:05.549 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-12T18:07:05.562 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-12T18:07:05.562 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-12T18:07:05.582 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-12T18:07:05.590 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-12T18:07:05.596 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-12T18:07:05.627 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-12T18:07:05.635 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-12T18:07:05.636 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-12T18:07:05.652 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-12T18:07:05.660 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-12T18:07:05.660 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-12T18:07:05.680 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-12T18:07:05.689 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-12T18:07:05.689 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-12T18:07:05.705 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package librados2. 2026-02-12T18:07:05.713 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../07-librados2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:05.714 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking librados2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:05.756 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libnbd0. 2026-02-12T18:07:05.764 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-12T18:07:05.765 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-12T18:07:05.779 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package librbd1. 2026-02-12T18:07:05.787 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../09-librbd1_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:05.788 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking librbd1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:05.824 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libcephfs2. 2026-02-12T18:07:05.832 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../10-libcephfs2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:05.833 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libcephfs2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:05.853 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-rados. 2026-02-12T18:07:05.861 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../11-python3-rados_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:05.861 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-rados (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:05.878 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-12T18:07:05.887 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-12T18:07:05.887 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-ceph-argparse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:05.901 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-cephfs. 2026-02-12T18:07:05.909 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../13-python3-cephfs_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:05.910 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-cephfs (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:05.926 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-12T18:07:05.934 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../14-python3-ceph-common_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-12T18:07:05.934 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:05.953 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-12T18:07:05.960 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-12T18:07:05.961 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-12T18:07:05.977 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-prettytable. 2026-02-12T18:07:05.985 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-12T18:07:05.985 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-12T18:07:05.999 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-rbd. 2026-02-12T18:07:06.008 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../17-python3-rbd_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:06.008 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-rbd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:06.025 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-12T18:07:06.034 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-12T18:07:06.034 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-12T18:07:06.052 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package librgw2. 2026-02-12T18:07:06.059 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../19-librgw2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:06.060 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking librgw2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:06.182 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-rgw. 2026-02-12T18:07:06.190 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../20-python3-rgw_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:06.191 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-rgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:06.206 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-12T18:07:06.214 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-12T18:07:06.214 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-12T18:07:06.229 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libradosstriper1. 2026-02-12T18:07:06.237 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../22-libradosstriper1_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:06.238 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libradosstriper1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:06.254 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-common. 2026-02-12T18:07:06.262 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../23-ceph-common_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:06.262 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:06.531 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-base. 2026-02-12T18:07:06.539 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../24-ceph-base_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:06.544 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-base (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:06.603 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-12T18:07:06.612 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-12T18:07:06.612 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-12T18:07:06.626 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-cheroot. 2026-02-12T18:07:06.635 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-12T18:07:06.635 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-12T18:07:06.653 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-12T18:07:06.661 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-12T18:07:06.662 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-12T18:07:06.676 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-12T18:07:06.685 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-12T18:07:06.685 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-12T18:07:06.699 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-12T18:07:06.707 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-12T18:07:06.708 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-12T18:07:06.721 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-tempora. 2026-02-12T18:07:06.730 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-12T18:07:06.730 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-12T18:07:06.745 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-portend. 2026-02-12T18:07:06.753 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-12T18:07:06.754 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-12T18:07:06.768 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-12T18:07:06.776 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-12T18:07:06.776 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-12T18:07:06.790 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-12T18:07:06.799 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-12T18:07:06.799 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-12T18:07:06.822 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-natsort. 2026-02-12T18:07:06.830 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-12T18:07:06.830 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-12T18:07:06.846 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-12T18:07:06.854 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-12T18:07:06.854 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:06.885 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-12T18:07:06.893 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:06.894 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:06.909 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-mgr. 2026-02-12T18:07:06.917 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../37-ceph-mgr_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:06.918 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-mgr (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:06.938 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-mon. 2026-02-12T18:07:06.946 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../38-ceph-mon_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:06.946 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-mon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:07.013 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-12T18:07:07.021 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-12T18:07:07.022 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-12T18:07:07.038 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-12T18:07:07.046 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../40-ceph-osd-classic_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:07.046 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-osd-classic (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:10.895 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-osd. 2026-02-12T18:07:10.908 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../41-ceph-osd_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:10.908 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-osd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:10.927 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph. 2026-02-12T18:07:10.940 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../42-ceph_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:10.940 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:10.956 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-fuse. 2026-02-12T18:07:10.969 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../43-ceph-fuse_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:10.969 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:10.996 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-mds. 2026-02-12T18:07:11.007 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../44-ceph-mds_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:11.007 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-mds (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:11.039 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package cephadm. 2026-02-12T18:07:11.047 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../45-cephadm_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:11.048 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:11.064 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-12T18:07:11.072 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../46-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-12T18:07:11.073 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-12T18:07:11.094 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-12T18:07:11.102 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../47-ceph-mgr-cephadm_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-12T18:07:11.102 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:11.124 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-12T18:07:11.132 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../48-python3-repoze.lru_0.7-2_all.deb ... 2026-02-12T18:07:11.133 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-12T18:07:11.147 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-routes. 2026-02-12T18:07:11.155 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../49-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-12T18:07:11.156 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-12T18:07:11.176 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-12T18:07:11.185 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../50-ceph-mgr-dashboard_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-12T18:07:11.185 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:11.852 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-12T18:07:11.861 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../51-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-12T18:07:11.862 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-12T18:07:11.901 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-joblib. 2026-02-12T18:07:11.909 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../52-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-12T18:07:11.910 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-12T18:07:11.938 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-12T18:07:11.946 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../53-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-12T18:07:11.947 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-12T18:07:11.961 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-sklearn. 2026-02-12T18:07:11.970 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../54-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-12T18:07:11.970 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-12T18:07:12.054 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-12T18:07:12.063 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-local_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-12T18:07:12.064 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:12.220 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-cachetools. 2026-02-12T18:07:12.229 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../56-python3-cachetools_5.0.0-1_all.deb ... 2026-02-12T18:07:12.229 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-12T18:07:12.244 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-rsa. 2026-02-12T18:07:12.253 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../57-python3-rsa_4.8-1_all.deb ... 2026-02-12T18:07:12.253 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-12T18:07:12.272 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-google-auth. 2026-02-12T18:07:12.280 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../58-python3-google-auth_1.5.1-3_all.deb ... 2026-02-12T18:07:12.281 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-12T18:07:12.298 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-12T18:07:12.307 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../59-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-12T18:07:12.307 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-12T18:07:12.322 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-websocket. 2026-02-12T18:07:12.331 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../60-python3-websocket_1.2.3-1_all.deb ... 2026-02-12T18:07:12.332 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-12T18:07:12.349 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-12T18:07:12.357 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../61-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-12T18:07:12.357 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-12T18:07:12.451 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-12T18:07:12.460 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-12T18:07:12.460 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:12.474 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-12T18:07:12.482 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../63-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-12T18:07:12.483 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-12T18:07:12.500 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-12T18:07:12.508 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../64-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-12T18:07:12.509 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-12T18:07:12.524 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package jq. 2026-02-12T18:07:12.532 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../65-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-12T18:07:12.533 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-12T18:07:12.547 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package socat. 2026-02-12T18:07:12.555 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../66-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-12T18:07:12.556 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-12T18:07:12.576 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package xmlstarlet. 2026-02-12T18:07:12.584 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../67-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-12T18:07:12.585 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-12T18:07:12.620 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-test. 2026-02-12T18:07:12.628 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../68-ceph-test_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:12.629 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-test (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:13.257 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package ceph-volume. 2026-02-12T18:07:13.266 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../69-ceph-volume_20.3.0-5230-gafefaa40-1jammy_all.deb ... 2026-02-12T18:07:13.266 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking ceph-volume (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:13.289 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-12T18:07:13.298 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../70-libcephfs-daemon_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:13.298 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libcephfs-daemon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:13.313 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-12T18:07:13.322 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../71-libcephfs-proxy2_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:13.322 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libcephfs-proxy2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:13.337 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-12T18:07:13.345 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../72-libcephfs-dev_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:13.346 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking libcephfs-dev (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:13.362 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package nvme-cli. 2026-02-12T18:07:13.371 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../73-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-12T18:07:13.371 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-12T18:07:13.402 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-12T18:07:13.410 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../74-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-12T18:07:13.411 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-12T18:07:13.440 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-12T18:07:13.449 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../75-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-12T18:07:13.449 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-12T18:07:13.463 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-pluggy. 2026-02-12T18:07:13.472 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../76-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-12T18:07:13.472 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-12T18:07:13.488 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-psutil. 2026-02-12T18:07:13.497 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../77-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-12T18:07:13.497 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-12T18:07:13.515 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-py. 2026-02-12T18:07:13.523 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../78-python3-py_1.10.0-1_all.deb ... 2026-02-12T18:07:13.523 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-12T18:07:13.544 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-pygments. 2026-02-12T18:07:13.553 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../79-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-12T18:07:13.553 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-12T18:07:13.594 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-toml. 2026-02-12T18:07:13.603 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../80-python3-toml_0.10.2-1_all.deb ... 2026-02-12T18:07:13.603 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-12T18:07:13.618 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-pytest. 2026-02-12T18:07:13.626 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../81-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-12T18:07:13.626 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-12T18:07:13.647 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-simplejson. 2026-02-12T18:07:13.656 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../82-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-12T18:07:13.656 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-12T18:07:13.681 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package python3-webob. 2026-02-12T18:07:13.689 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../83-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-12T18:07:13.689 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-12T18:07:13.706 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-12T18:07:13.715 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../84-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-12T18:07:13.715 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-12T18:07:13.783 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package radosgw. 2026-02-12T18:07:13.792 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../85-radosgw_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:13.792 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking radosgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:13.991 INFO:teuthology.orchestra.run.trial060.stdout:Selecting previously unselected package rbd-fuse. 2026-02-12T18:07:14.000 INFO:teuthology.orchestra.run.trial060.stdout:Preparing to unpack .../86-rbd-fuse_20.3.0-5230-gafefaa40-1jammy_amd64.deb ... 2026-02-12T18:07:14.000 INFO:teuthology.orchestra.run.trial060.stdout:Unpacking rbd-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:14.027 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-12T18:07:14.094 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-12T18:07:14.095 INFO:teuthology.orchestra.run.trial060.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-12T18:07:14.164 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T18:07:14.446 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-12T18:07:14.840 INFO:teuthology.orchestra.run.trial060.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-12T18:07:14.850 INFO:teuthology.orchestra.run.trial060.stdout:Setting up cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:14.892 INFO:teuthology.orchestra.run.trial060.stdout:Adding system user cephadm....done 2026-02-12T18:07:14.898 INFO:teuthology.orchestra.run.trial060.stdout:usermod: no changes 2026-02-12T18:07:14.904 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-12T18:07:14.977 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-12T18:07:14.978 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-12T18:07:15.050 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-12T18:07:15.124 INFO:teuthology.orchestra.run.trial060.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-12T18:07:15.125 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-12T18:07:15.220 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-12T18:07:15.343 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-12T18:07:15.419 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-12T18:07:15.491 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-ceph-argparse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:15.560 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-12T18:07:15.561 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-12T18:07:15.562 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-12T18:07:15.563 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-12T18:07:15.564 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-12T18:07:15.682 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-12T18:07:15.757 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libcephfs-proxy2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:15.758 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-12T18:07:15.834 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-12T18:07:15.921 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-12T18:07:16.167 INFO:teuthology.orchestra.run.trial060.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-12T18:07:16.168 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-12T18:07:16.260 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-12T18:07:16.380 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-12T18:07:16.461 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-12T18:07:16.534 INFO:teuthology.orchestra.run.trial060.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-12T18:07:16.535 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:16.623 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-12T18:07:17.119 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-12T18:07:17.123 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-12T18:07:17.198 INFO:teuthology.orchestra.run.trial060.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-12T18:07:17.199 INFO:teuthology.orchestra.run.trial060.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-12T18:07:17.200 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-12T18:07:17.276 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-12T18:07:17.348 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-12T18:07:17.349 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-12T18:07:17.426 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-12T18:07:17.499 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-12T18:07:17.575 INFO:teuthology.orchestra.run.trial060.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-12T18:07:17.576 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-12T18:07:17.656 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-12T18:07:17.657 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-12T18:07:17.733 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-12T18:07:17.817 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-12T18:07:17.890 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-12T18:07:17.891 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-12T18:07:18.025 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-12T18:07:18.097 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-12T18:07:18.098 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-12T18:07:18.178 INFO:teuthology.orchestra.run.trial060.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-12T18:07:18.179 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-12T18:07:18.308 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-12T18:07:18.309 INFO:teuthology.orchestra.run.trial060.stdout:Setting up librados2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:18.310 INFO:teuthology.orchestra.run.trial060.stdout:Setting up librgw2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:18.311 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:18.312 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-12T18:07:18.823 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libcephfs2 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:18.824 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libradosstriper1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:18.825 INFO:teuthology.orchestra.run.trial060.stdout:Setting up librbd1 (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:18.826 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-mgr-modules-core (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:18.827 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:18.898 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-12T18:07:18.899 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-12T18:07:19.319 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libcephfs-dev (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:19.320 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-rados (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:19.321 INFO:teuthology.orchestra.run.trial060.stdout:Setting up libcephfs-daemon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:19.322 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-rbd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:19.323 INFO:teuthology.orchestra.run.trial060.stdout:Setting up rbd-fuse (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:19.324 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-rgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:19.324 INFO:teuthology.orchestra.run.trial060.stdout:Setting up python3-cephfs (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:19.325 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-common (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:19.353 INFO:teuthology.orchestra.run.trial060.stdout:Adding group ceph....done 2026-02-12T18:07:19.389 INFO:teuthology.orchestra.run.trial060.stdout:Adding system user ceph....done 2026-02-12T18:07:19.399 INFO:teuthology.orchestra.run.trial060.stdout:Setting system user ceph properties....done 2026-02-12T18:07:19.406 INFO:teuthology.orchestra.run.trial060.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-12T18:07:19.493 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-12T18:07:19.772 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-12T18:07:20.164 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-test (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:20.165 INFO:teuthology.orchestra.run.trial060.stdout:Setting up radosgw (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:20.430 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-12T18:07:20.430 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-12T18:07:20.815 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-base (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:20.903 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-12T18:07:21.292 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-mds (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:21.352 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-12T18:07:21.352 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-12T18:07:21.748 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-mgr (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:21.828 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-12T18:07:21.828 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-12T18:07:22.215 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:22.216 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-osd-classic (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:22.234 INFO:teuthology.orchestra.run.trial060.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-12T18:07:22.243 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:22.255 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-mon (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:22.329 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-12T18:07:22.329 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-12T18:07:22.734 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-mgr-cephadm (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:22.745 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-mgr-dashboard (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:22.756 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-osd (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:22.842 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-12T18:07:22.843 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-12T18:07:23.254 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:23.255 INFO:teuthology.orchestra.run.trial060.stdout:Setting up ceph-volume (20.3.0-5230-gafefaa40-1jammy) ... 2026-02-12T18:07:23.360 INFO:teuthology.orchestra.run.trial060.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-12T18:07:23.444 INFO:teuthology.orchestra.run.trial060.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-12T18:07:23.847 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:23.847 INFO:teuthology.orchestra.run.trial060.stdout:Running kernel seems to be up-to-date. 2026-02-12T18:07:23.847 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:23.847 INFO:teuthology.orchestra.run.trial060.stdout:The processor microcode seems to be up-to-date. 2026-02-12T18:07:23.847 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:23.847 INFO:teuthology.orchestra.run.trial060.stdout:No services need to be restarted. 2026-02-12T18:07:23.847 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:23.847 INFO:teuthology.orchestra.run.trial060.stdout:No containers need to be restarted. 2026-02-12T18:07:23.847 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:23.847 INFO:teuthology.orchestra.run.trial060.stdout:No user sessions are running outdated binaries. 2026-02-12T18:07:23.847 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:23.847 INFO:teuthology.orchestra.run.trial060.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-12T18:07:24.488 INFO:teuthology.orchestra.run.trial060.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-12T18:07:24.495 DEBUG:teuthology.parallel:result is None 2026-02-12T18:07:24.495 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T18:07:24.657 DEBUG:teuthology.orchestra.run.trial060:> dpkg-query -W -f '${Version}' ceph 2026-02-12T18:07:24.668 INFO:teuthology.orchestra.run.trial060.stdout:20.3.0-5230-gafefaa40-1jammy 2026-02-12T18:07:24.668 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5230-gafefaa40-1jammy 2026-02-12T18:07:24.668 INFO:teuthology.task.install:The correct ceph version 20.3.0-5230-gafefaa40-1jammy is installed. 2026-02-12T18:07:24.670 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-12T18:07:24.671 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:24.671 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T18:07:24.717 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-12T18:07:24.717 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:24.717 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T18:07:24.769 DEBUG:teuthology.orchestra.run.trial060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T18:07:24.820 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-12T18:07:24.820 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:24.820 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T18:07:24.868 DEBUG:teuthology.orchestra.run.trial060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T18:07:24.916 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-12T18:07:24.916 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:24.917 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T18:07:24.965 DEBUG:teuthology.orchestra.run.trial060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T18:07:25.016 INFO:teuthology.run_tasks:Running task ceph... 2026-02-12T18:07:25.134 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-12T18:07:25.134 DEBUG:teuthology.orchestra.run.trial060:> sudo chmod 777 /var/log/ceph 2026-02-12T18:07:25.142 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-12T18:07:25.142 DEBUG:teuthology.orchestra.run.trial060:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T18:07:25.192 INFO:tasks.ceph:Creating extra log directories... 2026-02-12T18:07:25.192 DEBUG:teuthology.orchestra.run.trial060:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T18:07:25.250 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-12T18:07:25.250 INFO:tasks.ceph:config {'conf': {'osd': {'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-12T18:07:25.250 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46509', 'branch': 'wip-yuri4-testing-2026-02-11-2126', 'description': 'rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '46509', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2026-02-11-2126'}, 'ceph': {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}}, 'workunit': {'branch': 'wip-yuri4-testing-2026-02-11-2126', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'osd.8', 'osd.9', 'client.0']], 'seed': 7172, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri4-testing-2026-02-11-2126', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'targets': {'trial060.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhLA6B0D/hbdHtzPN2DFKKKTfH+TRh9EXzpd6xQ/875VX4ICZcKRtkGVvOS+rw4kMxlctZOzGrLHGWWVOKBvCY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'log-ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'cluster': 'ceph'}}, {'workunit': {'clients': {'all': ['rados/test_health_warnings.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8bec0da71becad44414c54979f64c9ef0e7099c6', 'timestamp': '2026-02-12_15:38:14', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482'} 2026-02-12T18:07:25.251 DEBUG:teuthology.orchestra.run.trial060:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T18:07:25.284 DEBUG:teuthology.orchestra.run.trial060:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T18:07:25.332 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:25.332 DEBUG:teuthology.orchestra.run.trial060:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T18:07:25.376 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T18:07:25.376 DEBUG:teuthology.orchestra.run.trial060:> stat /dev/vg_nvme/lv_1 2026-02-12T18:07:25.420 INFO:teuthology.orchestra.run.trial060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T18:07:25.421 INFO:teuthology.orchestra.run.trial060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T18:07:25.421 INFO:teuthology.orchestra.run.trial060.stdout:Device: 5h/5d Inode: 905 Links: 1 2026-02-12T18:07:25.421 INFO:teuthology.orchestra.run.trial060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T18:07:25.421 INFO:teuthology.orchestra.run.trial060.stdout:Access: 2026-02-12 18:06:10.980762640 +0000 2026-02-12T18:07:25.421 INFO:teuthology.orchestra.run.trial060.stdout:Modify: 2026-02-12 18:06:10.812767997 +0000 2026-02-12T18:07:25.421 INFO:teuthology.orchestra.run.trial060.stdout:Change: 2026-02-12 18:06:10.812767997 +0000 2026-02-12T18:07:25.421 INFO:teuthology.orchestra.run.trial060.stdout: Birth: - 2026-02-12T18:07:25.421 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T18:07:25.471 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records in 2026-02-12T18:07:25.471 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records out 2026-02-12T18:07:25.471 INFO:teuthology.orchestra.run.trial060.stderr:512 bytes copied, 0.000170464 s, 3.0 MB/s 2026-02-12T18:07:25.473 DEBUG:teuthology.orchestra.run.trial060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T18:07:25.522 DEBUG:teuthology.orchestra.run.trial060:> stat /dev/vg_nvme/lv_2 2026-02-12T18:07:25.568 INFO:teuthology.orchestra.run.trial060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T18:07:25.568 INFO:teuthology.orchestra.run.trial060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T18:07:25.568 INFO:teuthology.orchestra.run.trial060.stdout:Device: 5h/5d Inode: 929 Links: 1 2026-02-12T18:07:25.569 INFO:teuthology.orchestra.run.trial060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T18:07:25.569 INFO:teuthology.orchestra.run.trial060.stdout:Access: 2026-02-12 18:06:11.344751033 +0000 2026-02-12T18:07:25.569 INFO:teuthology.orchestra.run.trial060.stdout:Modify: 2026-02-12 18:06:11.152757157 +0000 2026-02-12T18:07:25.569 INFO:teuthology.orchestra.run.trial060.stdout:Change: 2026-02-12 18:06:11.152757157 +0000 2026-02-12T18:07:25.569 INFO:teuthology.orchestra.run.trial060.stdout: Birth: - 2026-02-12T18:07:25.569 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T18:07:25.615 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records in 2026-02-12T18:07:25.615 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records out 2026-02-12T18:07:25.615 INFO:teuthology.orchestra.run.trial060.stderr:512 bytes copied, 0.000182066 s, 2.8 MB/s 2026-02-12T18:07:25.616 DEBUG:teuthology.orchestra.run.trial060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T18:07:25.662 DEBUG:teuthology.orchestra.run.trial060:> stat /dev/vg_nvme/lv_3 2026-02-12T18:07:25.709 INFO:teuthology.orchestra.run.trial060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T18:07:25.709 INFO:teuthology.orchestra.run.trial060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T18:07:25.709 INFO:teuthology.orchestra.run.trial060.stdout:Device: 5h/5d Inode: 959 Links: 1 2026-02-12T18:07:25.709 INFO:teuthology.orchestra.run.trial060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T18:07:25.709 INFO:teuthology.orchestra.run.trial060.stdout:Access: 2026-02-12 18:06:11.692739934 +0000 2026-02-12T18:07:25.709 INFO:teuthology.orchestra.run.trial060.stdout:Modify: 2026-02-12 18:06:11.512745672 +0000 2026-02-12T18:07:25.709 INFO:teuthology.orchestra.run.trial060.stdout:Change: 2026-02-12 18:06:11.512745672 +0000 2026-02-12T18:07:25.709 INFO:teuthology.orchestra.run.trial060.stdout: Birth: - 2026-02-12T18:07:25.710 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T18:07:25.759 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records in 2026-02-12T18:07:25.760 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records out 2026-02-12T18:07:25.760 INFO:teuthology.orchestra.run.trial060.stderr:512 bytes copied, 0.000166818 s, 3.1 MB/s 2026-02-12T18:07:25.761 DEBUG:teuthology.orchestra.run.trial060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T18:07:25.810 DEBUG:teuthology.orchestra.run.trial060:> stat /dev/vg_nvme/lv_4 2026-02-12T18:07:25.856 INFO:teuthology.orchestra.run.trial060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T18:07:25.871 INFO:teuthology.orchestra.run.trial060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T18:07:25.871 INFO:teuthology.orchestra.run.trial060.stdout:Device: 5h/5d Inode: 979 Links: 1 2026-02-12T18:07:25.871 INFO:teuthology.orchestra.run.trial060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T18:07:25.871 INFO:teuthology.orchestra.run.trial060.stdout:Access: 2026-02-12 18:06:12.024729346 +0000 2026-02-12T18:07:25.871 INFO:teuthology.orchestra.run.trial060.stdout:Modify: 2026-02-12 18:06:11.856734702 +0000 2026-02-12T18:07:25.871 INFO:teuthology.orchestra.run.trial060.stdout:Change: 2026-02-12 18:06:11.856734702 +0000 2026-02-12T18:07:25.871 INFO:teuthology.orchestra.run.trial060.stdout: Birth: - 2026-02-12T18:07:25.872 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T18:07:25.903 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records in 2026-02-12T18:07:25.903 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records out 2026-02-12T18:07:25.903 INFO:teuthology.orchestra.run.trial060.stderr:512 bytes copied, 0.000175774 s, 2.9 MB/s 2026-02-12T18:07:25.905 DEBUG:teuthology.orchestra.run.trial060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T18:07:25.954 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-12T18:07:25.954 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-12T18:07:25.954 INFO:tasks.ceph:Generating config... 2026-02-12T18:07:25.956 INFO:tasks.ceph:[osd] osd max object name len = 400 2026-02-12T18:07:25.956 INFO:tasks.ceph:[osd] osd max object namespace len = 64 2026-02-12T18:07:25.957 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-12T18:07:25.957 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-12T18:07:25.957 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-12T18:07:25.957 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-12T18:07:25.957 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-12T18:07:25.957 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-12T18:07:25.957 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-12T18:07:25.957 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-12T18:07:25.957 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-12T18:07:25.957 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-12T18:07:25.957 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-12T18:07:25.958 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-12T18:07:25.958 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-12T18:07:25.958 INFO:tasks.ceph:[mon] debug mon = 30 2026-02-12T18:07:25.958 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-12T18:07:25.958 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-12T18:07:25.958 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-12T18:07:25.958 INFO:tasks.ceph:Setting up mon.a... 2026-02-12T18:07:25.958 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-12T18:07:26.013 INFO:teuthology.orchestra.run.trial060.stdout:creating /etc/ceph/ceph.keyring 2026-02-12T18:07:26.016 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-12T18:07:26.075 DEBUG:teuthology.orchestra.run.trial060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T18:07:26.123 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.60')] 2026-02-12T18:07:26.123 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.60', 'mon election default strategy': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 30, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-12T18:07:26.124 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:26.124 DEBUG:teuthology.orchestra.run.trial060:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T18:07:26.168 DEBUG:teuthology.orchestra.run.trial060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.60 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:26.224 INFO:teuthology.orchestra.run.trial060.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:26.225 INFO:teuthology.orchestra.run.trial060.stdout:monmaptool: generated fsid 25fa2def-3287-4142-b1ac-e832bbd8bb26 2026-02-12T18:07:26.225 INFO:teuthology.orchestra.run.trial060.stdout:setting min_mon_release = tentacle 2026-02-12T18:07:26.225 INFO:teuthology.orchestra.run.trial060.stdout:epoch 0 2026-02-12T18:07:26.225 INFO:teuthology.orchestra.run.trial060.stdout:fsid 25fa2def-3287-4142-b1ac-e832bbd8bb26 2026-02-12T18:07:26.225 INFO:teuthology.orchestra.run.trial060.stdout:last_changed 2026-02-12T18:07:26.224077+0000 2026-02-12T18:07:26.225 INFO:teuthology.orchestra.run.trial060.stdout:created 2026-02-12T18:07:26.224077+0000 2026-02-12T18:07:26.225 INFO:teuthology.orchestra.run.trial060.stdout:min_mon_release 20 (tentacle) 2026-02-12T18:07:26.225 INFO:teuthology.orchestra.run.trial060.stdout:election_strategy: 1 2026-02-12T18:07:26.225 INFO:teuthology.orchestra.run.trial060.stdout:0: [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] mon.a 2026-02-12T18:07:26.225 INFO:teuthology.orchestra.run.trial060.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-12T18:07:26.226 DEBUG:teuthology.orchestra.run.trial060:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T18:07:26.272 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 25fa2def-3287-4142-b1ac-e832bbd8bb26... 2026-02-12T18:07:26.273 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T18:07:26.332 INFO:teuthology.orchestra.run.trial060.stdout:[global] 2026-02-12T18:07:26.332 INFO:teuthology.orchestra.run.trial060.stdout: chdir = "" 2026-02-12T18:07:26.332 INFO:teuthology.orchestra.run.trial060.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T18:07:26.332 INFO:teuthology.orchestra.run.trial060.stdout: auth supported = cephx 2026-02-12T18:07:26.332 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.332 INFO:teuthology.orchestra.run.trial060.stdout: filestore xattr use omap = true 2026-02-12T18:07:26.332 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.332 INFO:teuthology.orchestra.run.trial060.stdout: mon clock drift allowed = 1.000 2026-02-12T18:07:26.333 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.333 INFO:teuthology.orchestra.run.trial060.stdout: osd crush chooseleaf type = 0 2026-02-12T18:07:26.333 INFO:teuthology.orchestra.run.trial060.stdout: auth debug = true 2026-02-12T18:07:26.333 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.333 INFO:teuthology.orchestra.run.trial060.stdout: ms die on old message = true 2026-02-12T18:07:26.333 INFO:teuthology.orchestra.run.trial060.stdout: ms die on bug = true 2026-02-12T18:07:26.333 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.333 INFO:teuthology.orchestra.run.trial060.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T18:07:26.333 INFO:teuthology.orchestra.run.trial060.stdout: mon pg warn max object skew = 0 2026-02-12T18:07:26.333 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.333 INFO:teuthology.orchestra.run.trial060.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T18:07:26.333 INFO:teuthology.orchestra.run.trial060.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T18:07:26.334 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.334 INFO:teuthology.orchestra.run.trial060.stdout: osd pool default size = 2 2026-02-12T18:07:26.334 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.334 INFO:teuthology.orchestra.run.trial060.stdout: mon osd allow primary affinity = true 2026-02-12T18:07:26.334 INFO:teuthology.orchestra.run.trial060.stdout: mon osd allow pg remap = true 2026-02-12T18:07:26.334 INFO:teuthology.orchestra.run.trial060.stdout: mon warn on legacy crush tunables = false 2026-02-12T18:07:26.334 INFO:teuthology.orchestra.run.trial060.stdout: mon warn on crush straw calc version zero = false 2026-02-12T18:07:26.334 INFO:teuthology.orchestra.run.trial060.stdout: mon warn on no sortbitwise = false 2026-02-12T18:07:26.334 INFO:teuthology.orchestra.run.trial060.stdout: mon warn on osd down out interval zero = false 2026-02-12T18:07:26.334 INFO:teuthology.orchestra.run.trial060.stdout: mon warn on too few osds = false 2026-02-12T18:07:26.334 INFO:teuthology.orchestra.run.trial060.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T18:07:26.334 INFO:teuthology.orchestra.run.trial060.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T18:07:26.335 INFO:teuthology.orchestra.run.trial060.stdout: mon_allow_pool_size_one = true 2026-02-12T18:07:26.335 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.335 INFO:teuthology.orchestra.run.trial060.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T18:07:26.335 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.335 INFO:teuthology.orchestra.run.trial060.stdout: osd default data pool replay window = 5 2026-02-12T18:07:26.335 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.335 INFO:teuthology.orchestra.run.trial060.stdout: mon allow pool delete = true 2026-02-12T18:07:26.335 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.335 INFO:teuthology.orchestra.run.trial060.stdout: mon cluster log file level = debug 2026-02-12T18:07:26.335 INFO:teuthology.orchestra.run.trial060.stdout: debug asserts on shutdown = true 2026-02-12T18:07:26.335 INFO:teuthology.orchestra.run.trial060.stdout: mon health detail to clog = false 2026-02-12T18:07:26.335 INFO:teuthology.orchestra.run.trial060.stdout: mon host = 10.20.193.60 2026-02-12T18:07:26.336 INFO:teuthology.orchestra.run.trial060.stdout: mon election default strategy = 1 2026-02-12T18:07:26.336 INFO:teuthology.orchestra.run.trial060.stdout: fsid = 25fa2def-3287-4142-b1ac-e832bbd8bb26 2026-02-12T18:07:26.336 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.336 INFO:teuthology.orchestra.run.trial060.stdout:[osd] 2026-02-12T18:07:26.336 INFO:teuthology.orchestra.run.trial060.stdout: osd journal size = 100 2026-02-12T18:07:26.336 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.336 INFO:teuthology.orchestra.run.trial060.stdout: osd scrub load threshold = 5.0 2026-02-12T18:07:26.336 INFO:teuthology.orchestra.run.trial060.stdout: osd scrub max interval = 600 2026-02-12T18:07:26.336 INFO:teuthology.orchestra.run.trial060.stdout: osd mclock profile = high_recovery_ops 2026-02-12T18:07:26.336 INFO:teuthology.orchestra.run.trial060.stdout: osd mclock skip benchmark = True 2026-02-12T18:07:26.336 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.336 INFO:teuthology.orchestra.run.trial060.stdout: osd recover clone overlap = true 2026-02-12T18:07:26.337 INFO:teuthology.orchestra.run.trial060.stdout: osd recovery max chunk = 1048576 2026-02-12T18:07:26.337 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.337 INFO:teuthology.orchestra.run.trial060.stdout: osd debug shutdown = true 2026-02-12T18:07:26.337 INFO:teuthology.orchestra.run.trial060.stdout: osd debug op order = true 2026-02-12T18:07:26.337 INFO:teuthology.orchestra.run.trial060.stdout: osd debug verify stray on activate = true 2026-02-12T18:07:26.337 INFO:teuthology.orchestra.run.trial060.stdout: osd debug trim objects = true 2026-02-12T18:07:26.337 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.337 INFO:teuthology.orchestra.run.trial060.stdout: osd open classes on start = true 2026-02-12T18:07:26.337 INFO:teuthology.orchestra.run.trial060.stdout: osd debug pg log writeout = true 2026-02-12T18:07:26.337 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.337 INFO:teuthology.orchestra.run.trial060.stdout: osd deep scrub update digest min age = 30 2026-02-12T18:07:26.337 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.337 INFO:teuthology.orchestra.run.trial060.stdout: osd map max advance = 10 2026-02-12T18:07:26.338 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.338 INFO:teuthology.orchestra.run.trial060.stdout: journal zero on create = true 2026-02-12T18:07:26.338 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.338 INFO:teuthology.orchestra.run.trial060.stdout: filestore ondisk finisher threads = 3 2026-02-12T18:07:26.338 INFO:teuthology.orchestra.run.trial060.stdout: filestore apply finisher threads = 3 2026-02-12T18:07:26.338 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.338 INFO:teuthology.orchestra.run.trial060.stdout: bdev debug aio = true 2026-02-12T18:07:26.338 INFO:teuthology.orchestra.run.trial060.stdout: osd debug misdirected ops = true 2026-02-12T18:07:26.338 INFO:teuthology.orchestra.run.trial060.stdout: osd max object name len = 400 2026-02-12T18:07:26.338 INFO:teuthology.orchestra.run.trial060.stdout: osd max object namespace len = 64 2026-02-12T18:07:26.338 INFO:teuthology.orchestra.run.trial060.stdout: bluestore zero block detection = True 2026-02-12T18:07:26.338 INFO:teuthology.orchestra.run.trial060.stdout: debug ms = 1 2026-02-12T18:07:26.338 INFO:teuthology.orchestra.run.trial060.stdout: debug osd = 20 2026-02-12T18:07:26.339 INFO:teuthology.orchestra.run.trial060.stdout: osd debug verify cached snaps = True 2026-02-12T18:07:26.339 INFO:teuthology.orchestra.run.trial060.stdout: osd debug verify missing on start = True 2026-02-12T18:07:26.339 INFO:teuthology.orchestra.run.trial060.stdout: osd mclock override recovery settings = True 2026-02-12T18:07:26.339 INFO:teuthology.orchestra.run.trial060.stdout: osd op queue = debug_random 2026-02-12T18:07:26.339 INFO:teuthology.orchestra.run.trial060.stdout: osd op queue cut off = debug_random 2026-02-12T18:07:26.339 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.339 INFO:teuthology.orchestra.run.trial060.stdout:[mgr] 2026-02-12T18:07:26.339 INFO:teuthology.orchestra.run.trial060.stdout: debug ms = 1 2026-02-12T18:07:26.339 INFO:teuthology.orchestra.run.trial060.stdout: debug mgr = 20 2026-02-12T18:07:26.339 INFO:teuthology.orchestra.run.trial060.stdout: debug mon = 20 2026-02-12T18:07:26.339 INFO:teuthology.orchestra.run.trial060.stdout: debug auth = 20 2026-02-12T18:07:26.339 INFO:teuthology.orchestra.run.trial060.stdout: mon reweight min pgs per osd = 4 2026-02-12T18:07:26.340 INFO:teuthology.orchestra.run.trial060.stdout: mon reweight min bytes per osd = 10 2026-02-12T18:07:26.340 INFO:teuthology.orchestra.run.trial060.stdout: mgr/telemetry/nag = false 2026-02-12T18:07:26.340 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.340 INFO:teuthology.orchestra.run.trial060.stdout:[mon] 2026-02-12T18:07:26.340 INFO:teuthology.orchestra.run.trial060.stdout: debug ms = 1 2026-02-12T18:07:26.340 INFO:teuthology.orchestra.run.trial060.stdout: debug mon = 30 2026-02-12T18:07:26.340 INFO:teuthology.orchestra.run.trial060.stdout: debug paxos = 20 2026-02-12T18:07:26.340 INFO:teuthology.orchestra.run.trial060.stdout: debug auth = 20 2026-02-12T18:07:26.340 INFO:teuthology.orchestra.run.trial060.stdout: mon data avail warn = 5 2026-02-12T18:07:26.340 INFO:teuthology.orchestra.run.trial060.stdout: mon mgr mkfs grace = 240 2026-02-12T18:07:26.340 INFO:teuthology.orchestra.run.trial060.stdout: mon reweight min pgs per osd = 4 2026-02-12T18:07:26.340 INFO:teuthology.orchestra.run.trial060.stdout: mon osd reporter subtree level = osd 2026-02-12T18:07:26.340 INFO:teuthology.orchestra.run.trial060.stdout: mon osd prime pg temp = true 2026-02-12T18:07:26.341 INFO:teuthology.orchestra.run.trial060.stdout: mon reweight min bytes per osd = 10 2026-02-12T18:07:26.341 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.341 INFO:teuthology.orchestra.run.trial060.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T18:07:26.341 INFO:teuthology.orchestra.run.trial060.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T18:07:26.341 INFO:teuthology.orchestra.run.trial060.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T18:07:26.341 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.341 INFO:teuthology.orchestra.run.trial060.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T18:07:26.341 INFO:teuthology.orchestra.run.trial060.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T18:07:26.341 INFO:teuthology.orchestra.run.trial060.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T18:07:26.341 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.341 INFO:teuthology.orchestra.run.trial060.stdout: # 1m isn't quite enough 2026-02-12T18:07:26.341 INFO:teuthology.orchestra.run.trial060.stdout: mon_down_mkfs_grace = 2m 2026-02-12T18:07:26.341 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.342 INFO:teuthology.orchestra.run.trial060.stdout: mon_warn_on_filestore_osds = false 2026-02-12T18:07:26.342 INFO:teuthology.orchestra.run.trial060.stdout: mon scrub interval = 300 2026-02-12T18:07:26.342 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:26.342 INFO:teuthology.orchestra.run.trial060.stdout:[client] 2026-02-12T18:07:26.342 INFO:teuthology.orchestra.run.trial060.stdout: rgw cache enabled = true 2026-02-12T18:07:26.342 INFO:teuthology.orchestra.run.trial060.stdout: rgw enable ops log = true 2026-02-12T18:07:26.342 INFO:teuthology.orchestra.run.trial060.stdout: rgw enable usage log = true 2026-02-12T18:07:26.342 INFO:teuthology.orchestra.run.trial060.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T18:07:26.342 INFO:teuthology.orchestra.run.trial060.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T18:07:26.342 INFO:teuthology.orchestra.run.trial060.stdout:[mon.a] 2026-02-12T18:07:26.343 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-12T18:07:26.344 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-12T18:07:26.406 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-12T18:07:26.406 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:26.406 DEBUG:teuthology.orchestra.run.trial060:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-12T18:07:26.452 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:26.452 DEBUG:teuthology.orchestra.run.trial060:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-12T18:07:26.495 INFO:tasks.ceph:Sending monmap to node ubuntu@trial060.front.sepia.ceph.com 2026-02-12T18:07:26.495 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:26.495 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T18:07:26.495 DEBUG:teuthology.orchestra.run.trial060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T18:07:26.549 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:26.549 DEBUG:teuthology.orchestra.run.trial060:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:26.596 INFO:tasks.ceph:Setting up mon nodes... 2026-02-12T18:07:26.596 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-12T18:07:26.596 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T18:07:26.657 INFO:teuthology.orchestra.run.trial060.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T18:07:26.659 INFO:tasks.ceph:Setting up mds nodes... 2026-02-12T18:07:26.659 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-12T18:07:26.659 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-12T18:07:26.716 INFO:teuthology.orchestra.run.trial060.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-12T18:07:26.723 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-12T18:07:26.723 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-12T18:07:26.723 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-12T18:07:26.772 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-12T18:07:26.772 INFO:tasks.ceph:role: osd.0 2026-02-12T18:07:26.773 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial060.front.sepia.ceph.com 2026-02-12T18:07:26.773 DEBUG:teuthology.orchestra.run.trial060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T18:07:26.822 INFO:teuthology.orchestra.run.trial060.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T18:07:26.822 INFO:teuthology.orchestra.run.trial060.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T18:07:26.823 INFO:teuthology.orchestra.run.trial060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T18:07:26.823 INFO:teuthology.orchestra.run.trial060.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-12T18:07:26.823 INFO:teuthology.orchestra.run.trial060.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T18:07:26.823 INFO:teuthology.orchestra.run.trial060.stdout: = sunit=0 swidth=0 blks 2026-02-12T18:07:26.823 INFO:teuthology.orchestra.run.trial060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T18:07:26.823 INFO:teuthology.orchestra.run.trial060.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T18:07:26.823 INFO:teuthology.orchestra.run.trial060.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T18:07:26.823 INFO:teuthology.orchestra.run.trial060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T18:07:27.405 INFO:teuthology.orchestra.run.trial060.stdout:Discarding blocks...Done. 2026-02-12T18:07:27.407 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial060.front.sepia.ceph.com -o noatime 2026-02-12T18:07:27.407 DEBUG:teuthology.orchestra.run.trial060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-12T18:07:27.461 DEBUG:teuthology.orchestra.run.trial060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-12T18:07:27.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T18:07:27.511 INFO:teuthology.orchestra.run.trial060.stderr:sudo: /sbin/restorecon: command not found 2026-02-12T18:07:27.511 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-12T18:07:27.561 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-12T18:07:27.561 INFO:tasks.ceph:role: osd.1 2026-02-12T18:07:27.561 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial060.front.sepia.ceph.com 2026-02-12T18:07:27.561 DEBUG:teuthology.orchestra.run.trial060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T18:07:27.614 INFO:teuthology.orchestra.run.trial060.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T18:07:27.615 INFO:teuthology.orchestra.run.trial060.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T18:07:27.615 INFO:teuthology.orchestra.run.trial060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T18:07:27.615 INFO:teuthology.orchestra.run.trial060.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-12T18:07:27.615 INFO:teuthology.orchestra.run.trial060.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T18:07:27.615 INFO:teuthology.orchestra.run.trial060.stdout: = sunit=0 swidth=0 blks 2026-02-12T18:07:27.615 INFO:teuthology.orchestra.run.trial060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T18:07:27.615 INFO:teuthology.orchestra.run.trial060.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T18:07:27.615 INFO:teuthology.orchestra.run.trial060.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T18:07:27.615 INFO:teuthology.orchestra.run.trial060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T18:07:28.185 INFO:teuthology.orchestra.run.trial060.stdout:Discarding blocks...Done. 2026-02-12T18:07:28.186 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial060.front.sepia.ceph.com -o noatime 2026-02-12T18:07:28.187 DEBUG:teuthology.orchestra.run.trial060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-12T18:07:28.242 DEBUG:teuthology.orchestra.run.trial060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-12T18:07:28.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T18:07:28.291 INFO:teuthology.orchestra.run.trial060.stderr:sudo: /sbin/restorecon: command not found 2026-02-12T18:07:28.292 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-12T18:07:28.341 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-12T18:07:28.341 INFO:tasks.ceph:role: osd.2 2026-02-12T18:07:28.341 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial060.front.sepia.ceph.com 2026-02-12T18:07:28.341 DEBUG:teuthology.orchestra.run.trial060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-12T18:07:28.394 INFO:teuthology.orchestra.run.trial060.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T18:07:28.395 INFO:teuthology.orchestra.run.trial060.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T18:07:28.395 INFO:teuthology.orchestra.run.trial060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T18:07:28.395 INFO:teuthology.orchestra.run.trial060.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-12T18:07:28.395 INFO:teuthology.orchestra.run.trial060.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T18:07:28.395 INFO:teuthology.orchestra.run.trial060.stdout: = sunit=0 swidth=0 blks 2026-02-12T18:07:28.395 INFO:teuthology.orchestra.run.trial060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T18:07:28.395 INFO:teuthology.orchestra.run.trial060.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T18:07:28.395 INFO:teuthology.orchestra.run.trial060.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T18:07:28.395 INFO:teuthology.orchestra.run.trial060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T18:07:28.957 INFO:teuthology.orchestra.run.trial060.stdout:Discarding blocks...Done. 2026-02-12T18:07:28.958 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial060.front.sepia.ceph.com -o noatime 2026-02-12T18:07:28.959 DEBUG:teuthology.orchestra.run.trial060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-12T18:07:29.014 DEBUG:teuthology.orchestra.run.trial060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-12T18:07:29.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T18:07:29.063 INFO:teuthology.orchestra.run.trial060.stderr:sudo: /sbin/restorecon: command not found 2026-02-12T18:07:29.063 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-12T18:07:29.112 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-12T18:07:29.113 INFO:tasks.ceph:role: osd.3 2026-02-12T18:07:29.113 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial060.front.sepia.ceph.com 2026-02-12T18:07:29.113 DEBUG:teuthology.orchestra.run.trial060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-12T18:07:29.162 INFO:teuthology.orchestra.run.trial060.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T18:07:29.162 INFO:teuthology.orchestra.run.trial060.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T18:07:29.162 INFO:teuthology.orchestra.run.trial060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T18:07:29.162 INFO:teuthology.orchestra.run.trial060.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-12T18:07:29.162 INFO:teuthology.orchestra.run.trial060.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T18:07:29.162 INFO:teuthology.orchestra.run.trial060.stdout: = sunit=0 swidth=0 blks 2026-02-12T18:07:29.162 INFO:teuthology.orchestra.run.trial060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T18:07:29.162 INFO:teuthology.orchestra.run.trial060.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T18:07:29.162 INFO:teuthology.orchestra.run.trial060.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T18:07:29.162 INFO:teuthology.orchestra.run.trial060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T18:07:29.725 INFO:teuthology.orchestra.run.trial060.stdout:Discarding blocks...Done. 2026-02-12T18:07:29.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial060.front.sepia.ceph.com -o noatime 2026-02-12T18:07:29.727 DEBUG:teuthology.orchestra.run.trial060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-12T18:07:29.785 DEBUG:teuthology.orchestra.run.trial060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-12T18:07:29.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T18:07:29.835 INFO:teuthology.orchestra.run.trial060.stderr:sudo: /sbin/restorecon: command not found 2026-02-12T18:07:29.835 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-12T18:07:29.885 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-12T18:07:29.885 INFO:tasks.ceph:role: osd.4 2026-02-12T18:07:29.885 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-12T18:07:29.936 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-12T18:07:29.937 INFO:tasks.ceph:role: osd.5 2026-02-12T18:07:29.937 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-12T18:07:29.984 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-12T18:07:29.985 INFO:tasks.ceph:role: osd.6 2026-02-12T18:07:29.985 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-12T18:07:30.037 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-12T18:07:30.037 INFO:tasks.ceph:role: osd.7 2026-02-12T18:07:30.037 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-12T18:07:30.088 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-12T18:07:30.088 INFO:tasks.ceph:role: osd.8 2026-02-12T18:07:30.089 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-12T18:07:30.136 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-12T18:07:30.137 INFO:tasks.ceph:role: osd.9 2026-02-12T18:07:30.137 DEBUG:teuthology.orchestra.run.trial060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:30.198 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:30.194+0000 7f5947710a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-12T18:07:30.199 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:30.194+0000 7f5947710a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-12T18:07:30.199 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:30.194+0000 7f5947710a40 -1 bdev(0x55fbc44c3800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-12T18:07:30.199 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:30.194+0000 7f5947710a40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-12T18:07:30.844 DEBUG:teuthology.orchestra.run.trial060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-12T18:07:30.894 DEBUG:teuthology.orchestra.run.trial060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:30.958 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:30.954+0000 7f8a77ecca40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-12T18:07:30.958 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:30.954+0000 7f8a77ecca40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-12T18:07:30.958 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:30.954+0000 7f8a77ecca40 -1 bdev(0x557678911800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-12T18:07:30.958 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:30.954+0000 7f8a77ecca40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-12T18:07:31.614 DEBUG:teuthology.orchestra.run.trial060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-12T18:07:31.666 DEBUG:teuthology.orchestra.run.trial060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:31.729 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:31.726+0000 7f48617f3a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-12T18:07:31.730 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:31.726+0000 7f48617f3a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-12T18:07:31.730 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:31.726+0000 7f48617f3a40 -1 bdev(0x5593dc215800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-12T18:07:31.731 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:31.726+0000 7f48617f3a40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-12T18:07:32.377 DEBUG:teuthology.orchestra.run.trial060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-12T18:07:32.433 DEBUG:teuthology.orchestra.run.trial060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:32.496 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:32.490+0000 7efcab367a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-12T18:07:32.497 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:32.494+0000 7efcab367a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-12T18:07:32.497 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:32.494+0000 7efcab367a40 -1 bdev(0x557fbd997800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-12T18:07:32.497 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:32.494+0000 7efcab367a40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-12T18:07:33.162 DEBUG:teuthology.orchestra.run.trial060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-12T18:07:33.213 DEBUG:teuthology.orchestra.run.trial060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:33.277 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:33.274+0000 7f14719d2a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-12T18:07:33.278 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:33.274+0000 7f14719d2a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-12T18:07:33.278 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:33.274+0000 7f14719d2a40 -1 bdev(0x5604f56f3800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-12T18:07:33.278 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:33.274+0000 7f14719d2a40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-12T18:07:33.905 DEBUG:teuthology.orchestra.run.trial060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-12T18:07:33.957 DEBUG:teuthology.orchestra.run.trial060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:34.021 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:34.018+0000 7f353316ca40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-12T18:07:34.022 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:34.018+0000 7f353316ca40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-12T18:07:34.022 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:34.018+0000 7f353316ca40 -1 bdev(0x563963903800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-12T18:07:34.022 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:34.018+0000 7f353316ca40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-12T18:07:34.677 DEBUG:teuthology.orchestra.run.trial060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-12T18:07:34.728 DEBUG:teuthology.orchestra.run.trial060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:34.789 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:34.786+0000 7f49168ffa40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-12T18:07:34.789 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:34.786+0000 7f49168ffa40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-12T18:07:34.789 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:34.786+0000 7f49168ffa40 -1 bdev(0x56359ef79800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-12T18:07:34.789 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:34.786+0000 7f49168ffa40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-12T18:07:35.412 DEBUG:teuthology.orchestra.run.trial060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-12T18:07:35.461 DEBUG:teuthology.orchestra.run.trial060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:35.525 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:35.522+0000 7f260026aa40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-12T18:07:35.525 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:35.522+0000 7f260026aa40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-12T18:07:35.526 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:35.522+0000 7f260026aa40 -1 bdev(0x5566a2f0d800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-12T18:07:35.526 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:35.522+0000 7f260026aa40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-12T18:07:36.157 DEBUG:teuthology.orchestra.run.trial060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-12T18:07:36.209 DEBUG:teuthology.orchestra.run.trial060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:36.274 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:36.270+0000 7f9bc1390a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-12T18:07:36.275 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:36.270+0000 7f9bc1390a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-12T18:07:36.275 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:36.270+0000 7f9bc1390a40 -1 bdev(0x55c3479a1800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-12T18:07:36.275 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:36.270+0000 7f9bc1390a40 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-12T18:07:36.908 DEBUG:teuthology.orchestra.run.trial060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-12T18:07:36.956 DEBUG:teuthology.orchestra.run.trial060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:37.021 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:37.018+0000 7f9be1426a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-12T18:07:37.021 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:37.018+0000 7f9be1426a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-12T18:07:37.021 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:37.018+0000 7f9be1426a40 -1 bdev(0x56355ee11800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-12T18:07:37.021 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-12T18:07:37.018+0000 7f9be1426a40 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-12T18:07:37.657 DEBUG:teuthology.orchestra.run.trial060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-12T18:07:37.709 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-12T18:07:37.709 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:37.709 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-12T18:07:37.761 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:37.761 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-12T18:07:37.813 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:37.813 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-12T18:07:37.865 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:37.865 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-12T18:07:37.917 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:37.917 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-12T18:07:37.968 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:37.968 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-12T18:07:38.016 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:38.016 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-12T18:07:38.064 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:38.065 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-12T18:07:38.117 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:38.117 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-12T18:07:38.169 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:38.169 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-12T18:07:38.223 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:38.224 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-12T18:07:38.271 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:38.271 DEBUG:teuthology.orchestra.run.trial060:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-12T18:07:38.316 INFO:tasks.ceph:Adding keys to all mons... 2026-02-12T18:07:38.316 DEBUG:teuthology.orchestra.run.trial060:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout:[mgr.x] 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout: key = AQDeFo5pXwUrJxAAhJ4vYMkN1gNXGybCOKn8ZA== 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout:[osd.0] 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout: key = AQDiFo5pSbPGCxAA8hSCX3q8vRWo1G7lCAZQqQ== 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout:[osd.1] 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout: key = AQDiFo5pwVYEORAAc7atw4ta4B5+lEFBaEg52w== 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout:[osd.2] 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout: key = AQDjFo5pf81yKxAAYrMH7gYsYEZt5jo0XFRkRA== 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout:[osd.3] 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout: key = AQDkFo5p4PmQHRAA2nqUuOVSCs8yss9vr4GE5A== 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout:[osd.4] 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout: key = AQDlFo5pbkJ6EBAAu1iWSuRD7GsW96Ezg98obw== 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout:[osd.5] 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout: key = AQDmFo5p9802ARAACRw9LQDbn+15JsFmDqM9eA== 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout:[osd.6] 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout: key = AQDmFo5pCCEDLxAAxYqx+E1YfbHFpBx8JT1jEQ== 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout:[osd.7] 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout: key = AQDnFo5piKdAHxAAnAU4OxBxqQB7qXRxAf3iGg== 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout:[osd.8] 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout: key = AQDoFo5p+J9OEBAAy78Gt/KUTN9baCbQqsdzpg== 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout:[osd.9] 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout: key = AQDpFo5puGY1ARAAxGni/ati3OyPpUuWZO0s1g== 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout:[client.0] 2026-02-12T18:07:38.363 INFO:teuthology.orchestra.run.trial060.stdout: key = AQDeFo5pr4+xKhAAK34JCl0Z6H88SG9Xv0WzWA== 2026-02-12T18:07:38.363 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T18:07:38.425 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:07:38.489 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:07:38.552 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:07:38.612 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:07:38.672 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:07:38.732 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:07:38.796 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:07:38.860 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:07:38.920 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:07:38.981 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:07:39.049 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T18:07:39.118 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-12T18:07:39.118 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-12T18:07:39.172 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T18:07:39.238 DEBUG:teuthology.orchestra.run.trial060:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-12T18:07:39.289 DEBUG:teuthology.orchestra.run.trial060:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:07:39.336 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-12T18:07:39.337 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-12T18:07:39.337 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-12T18:07:39.378 INFO:tasks.ceph.mon.a:Started 2026-02-12T18:07:39.379 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph config set mgr mgr_pool false --force 2026-02-12T18:07:39.508 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-12T18:07:39.509 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-12T18:07:39.509 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-12T18:07:39.511 INFO:tasks.ceph.mgr.x:Started 2026-02-12T18:07:39.511 DEBUG:tasks.ceph:set 0 configs 2026-02-12T18:07:39.512 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph config dump 2026-02-12T18:07:39.605 INFO:teuthology.orchestra.run.trial060.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-12T18:07:39.605 INFO:teuthology.orchestra.run.trial060.stdout:mgr dev mgr_pool false * 2026-02-12T18:07:39.614 INFO:tasks.ceph:Setting crush tunables to default 2026-02-12T18:07:39.614 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph osd crush tunables default 2026-02-12T18:07:39.709 INFO:teuthology.orchestra.run.trial060.stderr:adjusted tunables profile to default 2026-02-12T18:07:39.718 INFO:tasks.ceph:check_enable_crimson: False 2026-02-12T18:07:39.719 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-12T18:07:39.719 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:39.719 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-12T18:07:39.730 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:39.730 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-12T18:07:39.780 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:39.780 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-12T18:07:39.828 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:39.828 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-12T18:07:39.876 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:39.876 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-12T18:07:39.924 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:39.924 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-12T18:07:39.972 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:39.972 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-12T18:07:40.020 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:40.020 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-12T18:07:40.068 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:40.068 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-12T18:07:40.116 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:07:40.116 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-12T18:07:40.164 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph osd new 8ad3e842-c1f9-4b56-9d5c-97cd470a6929 0 2026-02-12T18:07:40.300 INFO:teuthology.orchestra.run.trial060.stdout:0 2026-02-12T18:07:40.309 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph osd new bfa10ffc-c863-4cf1-8c88-0a779cfc73fa 1 2026-02-12T18:07:40.405 INFO:teuthology.orchestra.run.trial060.stdout:1 2026-02-12T18:07:40.413 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph osd new 97e2a94a-d5b2-4254-ace1-f21d76a702a5 2 2026-02-12T18:07:40.511 INFO:teuthology.orchestra.run.trial060.stdout:2 2026-02-12T18:07:40.520 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph osd new 49826740-fd2f-46b7-b6ab-ff968ce54201 3 2026-02-12T18:07:40.618 INFO:teuthology.orchestra.run.trial060.stdout:3 2026-02-12T18:07:40.627 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph osd new 98c28f51-3a65-4387-bc9a-072addee6349 4 2026-02-12T18:07:40.725 INFO:teuthology.orchestra.run.trial060.stdout:4 2026-02-12T18:07:40.734 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph osd new 282e5382-9f9e-41fe-9620-40fb2b9ea2a1 5 2026-02-12T18:07:40.830 INFO:teuthology.orchestra.run.trial060.stdout:5 2026-02-12T18:07:40.839 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph osd new f72c16d3-3504-4ea0-8566-4ff600674ebe 6 2026-02-12T18:07:40.937 INFO:teuthology.orchestra.run.trial060.stdout:6 2026-02-12T18:07:40.946 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph osd new 40b9cbfa-b547-4bdf-8138-8a153fcdc783 7 2026-02-12T18:07:41.016 INFO:tasks.ceph.mgr.x.trial060.stderr:ERROR:root:Module 'jmespath' is not installed. 2026-02-12T18:07:41.042 INFO:teuthology.orchestra.run.trial060.stdout:7 2026-02-12T18:07:41.051 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph osd new 5fc057b6-c560-4963-bcd8-53d743e23ed8 8 2026-02-12T18:07:41.071 INFO:tasks.ceph.mgr.x.trial060.stderr:ERROR:dashboard.controllers.nvmeof:Failed to import NVMeoFClient and related components: cannot import name 'NVMeoFClient' from 'dashboard.services.nvmeof_client' (/usr/share/ceph/mgr/dashboard/services/nvmeof_client.py) 2026-02-12T18:07:41.077 INFO:tasks.ceph.mgr.x.trial060.stderr:ERROR:sso:Module 'jmespath' is not installed. 2026-02-12T18:07:41.128 INFO:tasks.ceph.mgr.x.trial060.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-12T18:07:41.149 INFO:teuthology.orchestra.run.trial060.stdout:8 2026-02-12T18:07:41.158 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph osd new 4aeac3b5-484a-4c74-93f6-0e4244fefcb3 9 2026-02-12T18:07:41.297 INFO:teuthology.orchestra.run.trial060.stdout:9 2026-02-12T18:07:41.306 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-12T18:07:41.306 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-12T18:07:41.308 INFO:tasks.ceph.osd.0:Started 2026-02-12T18:07:41.308 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-12T18:07:41.308 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-12T18:07:41.310 INFO:tasks.ceph.osd.1:Started 2026-02-12T18:07:41.310 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-12T18:07:41.310 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-12T18:07:41.312 INFO:tasks.ceph.osd.2:Started 2026-02-12T18:07:41.313 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-12T18:07:41.313 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-12T18:07:41.315 INFO:tasks.ceph.osd.3:Started 2026-02-12T18:07:41.315 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-12T18:07:41.315 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-12T18:07:41.317 INFO:tasks.ceph.osd.4:Started 2026-02-12T18:07:41.317 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-12T18:07:41.317 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-12T18:07:41.319 INFO:tasks.ceph.osd.5:Started 2026-02-12T18:07:41.319 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-12T18:07:41.320 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2026-02-12T18:07:41.322 INFO:tasks.ceph.osd.6:Started 2026-02-12T18:07:41.322 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-12T18:07:41.322 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2026-02-12T18:07:41.324 INFO:tasks.ceph.osd.7:Started 2026-02-12T18:07:41.325 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-12T18:07:41.325 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2026-02-12T18:07:41.327 INFO:tasks.ceph.osd.8:Started 2026-02-12T18:07:41.327 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-12T18:07:41.327 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2026-02-12T18:07:41.329 INFO:tasks.ceph.osd.9:Started 2026-02-12T18:07:41.330 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T18:07:41.423 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:41.424 INFO:teuthology.orchestra.run.trial060.stdout:{"epoch":12,"fsid":"25fa2def-3287-4142-b1ac-e832bbd8bb26","created":"2026-02-12T18:07:39.457591+0000","modified":"2026-02-12T18:07:41.295407+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T18:07:41.295407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8ad3e842-c1f9-4b56-9d5c-97cd470a6929","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bfa10ffc-c863-4cf1-8c88-0a779cfc73fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"97e2a94a-d5b2-4254-ace1-f21d76a702a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"49826740-fd2f-46b7-b6ab-ff968ce54201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"98c28f51-3a65-4387-bc9a-072addee6349","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"282e5382-9f9e-41fe-9620-40fb2b9ea2a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f72c16d3-3504-4ea0-8566-4ff600674ebe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"40b9cbfa-b547-4bdf-8138-8a153fcdc783","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"5fc057b6-c560-4963-bcd8-53d743e23ed8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"4aeac3b5-484a-4c74-93f6-0e4244fefcb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T18:07:41.434 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-12T18:07:41.434 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-12T18:07:41.582 INFO:tasks.ceph.mgr.x.trial060.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T18:07:41.582 INFO:tasks.ceph.mgr.x.trial060.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T18:07:41.583 INFO:tasks.ceph.mgr.x.trial060.stderr: from numpy import show_config as show_numpy_config 2026-02-12T18:07:41.818 INFO:tasks.ceph.osd.3.trial060.stderr:2026-02-12T18:07:41.814+0000 7fb72ddc5a40 -1 Falling back to public interface 2026-02-12T18:07:41.838 INFO:tasks.ceph.osd.1.trial060.stderr:2026-02-12T18:07:41.834+0000 7f8abd2e6a40 -1 Falling back to public interface 2026-02-12T18:07:41.839 INFO:tasks.ceph.osd.2.trial060.stderr:2026-02-12T18:07:41.834+0000 7fbdeadb5a40 -1 Falling back to public interface 2026-02-12T18:07:41.839 INFO:tasks.ceph.osd.7.trial060.stderr:2026-02-12T18:07:41.834+0000 7fa120b1da40 -1 Falling back to public interface 2026-02-12T18:07:41.858 INFO:tasks.ceph.osd.4.trial060.stderr:2026-02-12T18:07:41.854+0000 7fccf8229a40 -1 Falling back to public interface 2026-02-12T18:07:41.874 INFO:tasks.ceph.osd.0.trial060.stderr:2026-02-12T18:07:41.870+0000 7f6df32eba40 -1 Falling back to public interface 2026-02-12T18:07:41.894 INFO:tasks.ceph.osd.9.trial060.stderr:2026-02-12T18:07:41.890+0000 7f63a1deda40 -1 Falling back to public interface 2026-02-12T18:07:41.910 INFO:tasks.ceph.osd.6.trial060.stderr:2026-02-12T18:07:41.906+0000 7fc0d6cf2a40 -1 Falling back to public interface 2026-02-12T18:07:41.922 INFO:tasks.ceph.osd.5.trial060.stderr:2026-02-12T18:07:41.918+0000 7f9aa0fc2a40 -1 Falling back to public interface 2026-02-12T18:07:41.998 INFO:tasks.ceph.osd.8.trial060.stderr:2026-02-12T18:07:41.994+0000 7f5f81b4da40 -1 Falling back to public interface 2026-02-12T18:07:42.438 DEBUG:teuthology.orchestra.run.trial060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T18:07:42.524 INFO:teuthology.misc.health.trial060.stdout: 2026-02-12T18:07:42.525 INFO:teuthology.misc.health.trial060.stdout:{"epoch":12,"fsid":"25fa2def-3287-4142-b1ac-e832bbd8bb26","created":"2026-02-12T18:07:39.457591+0000","modified":"2026-02-12T18:07:41.295407+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T18:07:41.295407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8ad3e842-c1f9-4b56-9d5c-97cd470a6929","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bfa10ffc-c863-4cf1-8c88-0a779cfc73fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"97e2a94a-d5b2-4254-ace1-f21d76a702a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"49826740-fd2f-46b7-b6ab-ff968ce54201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"98c28f51-3a65-4387-bc9a-072addee6349","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"282e5382-9f9e-41fe-9620-40fb2b9ea2a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f72c16d3-3504-4ea0-8566-4ff600674ebe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"40b9cbfa-b547-4bdf-8138-8a153fcdc783","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"5fc057b6-c560-4963-bcd8-53d743e23ed8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"4aeac3b5-484a-4c74-93f6-0e4244fefcb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T18:07:42.533 DEBUG:teuthology.misc:0 of 10 OSDs are up 2026-02-12T18:07:42.660 INFO:tasks.ceph.mgr.x.trial060.stderr:2026-02-12T18:07:42.654+0000 7f006c381640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-12T18:07:42.680 INFO:tasks.ceph.osd.7.trial060.stderr:2026-02-12T18:07:42.674+0000 7fa120b1da40 -1 osd.7 0 log_to_monitors true 2026-02-12T18:07:42.730 INFO:tasks.ceph.osd.3.trial060.stderr:2026-02-12T18:07:42.726+0000 7fb72ddc5a40 -1 osd.3 0 log_to_monitors true 2026-02-12T18:07:42.735 INFO:tasks.ceph.osd.4.trial060.stderr:2026-02-12T18:07:42.730+0000 7fccf8229a40 -1 osd.4 0 log_to_monitors true 2026-02-12T18:07:42.737 INFO:tasks.ceph.osd.2.trial060.stderr:2026-02-12T18:07:42.734+0000 7fbdeadb5a40 -1 osd.2 0 log_to_monitors true 2026-02-12T18:07:42.760 INFO:tasks.ceph.osd.9.trial060.stderr:2026-02-12T18:07:42.754+0000 7f63a1deda40 -1 osd.9 0 log_to_monitors true 2026-02-12T18:07:42.789 INFO:tasks.ceph.osd.6.trial060.stderr:2026-02-12T18:07:42.786+0000 7fc0d6cf2a40 -1 osd.6 0 log_to_monitors true 2026-02-12T18:07:42.809 INFO:tasks.ceph.osd.0.trial060.stderr:2026-02-12T18:07:42.806+0000 7f6df32eba40 -1 osd.0 0 log_to_monitors true 2026-02-12T18:07:42.812 INFO:tasks.ceph.osd.1.trial060.stderr:2026-02-12T18:07:42.806+0000 7f8abd2e6a40 -1 osd.1 0 log_to_monitors true 2026-02-12T18:07:42.903 INFO:tasks.ceph.osd.5.trial060.stderr:2026-02-12T18:07:42.898+0000 7f9aa0fc2a40 -1 osd.5 0 log_to_monitors true 2026-02-12T18:07:43.010 INFO:tasks.ceph.osd.8.trial060.stderr:2026-02-12T18:07:43.006+0000 7f5f81b4da40 -1 osd.8 0 log_to_monitors true 2026-02-12T18:07:44.667 INFO:tasks.ceph.osd.3.trial060.stderr:2026-02-12T18:07:44.661+0000 7fb729d6f640 -1 osd.3 0 waiting for initial osdmap 2026-02-12T18:07:44.667 INFO:tasks.ceph.osd.4.trial060.stderr:2026-02-12T18:07:44.661+0000 7fccf41d3640 -1 osd.4 0 waiting for initial osdmap 2026-02-12T18:07:44.668 INFO:tasks.ceph.osd.2.trial060.stderr:2026-02-12T18:07:44.661+0000 7fbde6d5f640 -1 osd.2 0 waiting for initial osdmap 2026-02-12T18:07:44.668 INFO:tasks.ceph.osd.9.trial060.stderr:2026-02-12T18:07:44.661+0000 7f639dd97640 -1 osd.9 0 waiting for initial osdmap 2026-02-12T18:07:44.669 INFO:tasks.ceph.osd.0.trial060.stderr:2026-02-12T18:07:44.661+0000 7f6def295640 -1 osd.0 0 waiting for initial osdmap 2026-02-12T18:07:44.669 INFO:tasks.ceph.osd.5.trial060.stderr:2026-02-12T18:07:44.661+0000 7f9a9cf6c640 -1 osd.5 0 waiting for initial osdmap 2026-02-12T18:07:44.669 INFO:tasks.ceph.osd.1.trial060.stderr:2026-02-12T18:07:44.661+0000 7f8ab9290640 -1 osd.1 0 waiting for initial osdmap 2026-02-12T18:07:44.670 INFO:tasks.ceph.osd.6.trial060.stderr:2026-02-12T18:07:44.661+0000 7fc0d2c9c640 -1 osd.6 0 waiting for initial osdmap 2026-02-12T18:07:44.670 INFO:tasks.ceph.osd.8.trial060.stderr:2026-02-12T18:07:44.661+0000 7f5f7daf7640 -1 osd.8 0 waiting for initial osdmap 2026-02-12T18:07:44.670 INFO:tasks.ceph.osd.7.trial060.stderr:2026-02-12T18:07:44.661+0000 7fa11cac7640 -1 osd.7 0 waiting for initial osdmap 2026-02-12T18:07:44.671 INFO:tasks.ceph.osd.1.trial060.stderr:2026-02-12T18:07:44.665+0000 7f8ab4967640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:07:44.672 INFO:tasks.ceph.osd.3.trial060.stderr:2026-02-12T18:07:44.665+0000 7fb725446640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:07:44.672 INFO:tasks.ceph.osd.4.trial060.stderr:2026-02-12T18:07:44.665+0000 7fcceb8a2640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:07:44.672 INFO:tasks.ceph.osd.9.trial060.stderr:2026-02-12T18:07:44.665+0000 7f639946e640 -1 osd.9 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:07:44.673 INFO:tasks.ceph.osd.0.trial060.stderr:2026-02-12T18:07:44.665+0000 7f6dea96c640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:07:44.673 INFO:tasks.ceph.osd.2.trial060.stderr:2026-02-12T18:07:44.665+0000 7fbdde42e640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:07:44.673 INFO:tasks.ceph.osd.6.trial060.stderr:2026-02-12T18:07:44.665+0000 7fc0ca36b640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:07:44.674 INFO:tasks.ceph.osd.5.trial060.stderr:2026-02-12T18:07:44.665+0000 7f9a9463b640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:07:44.674 INFO:tasks.ceph.osd.8.trial060.stderr:2026-02-12T18:07:44.665+0000 7f5f751c6640 -1 osd.8 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:07:44.674 INFO:tasks.ceph.osd.7.trial060.stderr:2026-02-12T18:07:44.665+0000 7fa114196640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:07:49.538 DEBUG:teuthology.orchestra.run.trial060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T18:07:49.687 INFO:teuthology.misc.health.trial060.stdout: 2026-02-12T18:07:49.688 INFO:teuthology.misc.health.trial060.stdout:{"epoch":15,"fsid":"25fa2def-3287-4142-b1ac-e832bbd8bb26","created":"2026-02-12T18:07:39.457591+0000","modified":"2026-02-12T18:07:45.660976+0000","last_up_change":"2026-02-12T18:07:45.660976+0000","last_in_change":"2026-02-12T18:07:41.295407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8ad3e842-c1f9-4b56-9d5c-97cd470a6929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6842","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6843","nonce":3591020635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6844","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6845","nonce":3591020635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6848","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6849","nonce":3591020635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6846","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6847","nonce":3591020635}]},"public_addr":"10.20.193.60:6843/3591020635","cluster_addr":"10.20.193.60:6845/3591020635","heartbeat_back_addr":"10.20.193.60:6849/3591020635","heartbeat_front_addr":"10.20.193.60:6847/3591020635","state":["exists","up"]},{"osd":1,"uuid":"bfa10ffc-c863-4cf1-8c88-0a779cfc73fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6810","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6811","nonce":1953903305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6814","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6816","nonce":1953903305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6825","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6828","nonce":1953903305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6819","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6822","nonce":1953903305}]},"public_addr":"10.20.193.60:6811/1953903305","cluster_addr":"10.20.193.60:6816/1953903305","heartbeat_back_addr":"10.20.193.60:6828/1953903305","heartbeat_front_addr":"10.20.193.60:6822/1953903305","state":["exists","up"]},{"osd":2,"uuid":"97e2a94a-d5b2-4254-ace1-f21d76a702a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6813","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6817","nonce":1093602441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6820","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6823","nonce":1093602441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6832","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6833","nonce":1093602441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6827","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6830","nonce":1093602441}]},"public_addr":"10.20.193.60:6817/1093602441","cluster_addr":"10.20.193.60:6823/1093602441","heartbeat_back_addr":"10.20.193.60:6833/1093602441","heartbeat_front_addr":"10.20.193.60:6830/1093602441","state":["exists","up"]},{"osd":3,"uuid":"49826740-fd2f-46b7-b6ab-ff968ce54201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6802","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6803","nonce":3027881260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6804","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6805","nonce":3027881260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6808","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6809","nonce":3027881260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6806","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6807","nonce":3027881260}]},"public_addr":"10.20.193.60:6803/3027881260","cluster_addr":"10.20.193.60:6805/3027881260","heartbeat_back_addr":"10.20.193.60:6809/3027881260","heartbeat_front_addr":"10.20.193.60:6807/3027881260","state":["exists","up"]},{"osd":4,"uuid":"98c28f51-3a65-4387-bc9a-072addee6349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6834","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6835","nonce":1082935684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6836","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6837","nonce":1082935684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6840","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6841","nonce":1082935684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6838","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6839","nonce":1082935684}]},"public_addr":"10.20.193.60:6835/1082935684","cluster_addr":"10.20.193.60:6837/1082935684","heartbeat_back_addr":"10.20.193.60:6841/1082935684","heartbeat_front_addr":"10.20.193.60:6839/1082935684","state":["exists","up"]},{"osd":5,"uuid":"282e5382-9f9e-41fe-9620-40fb2b9ea2a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6866","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6867","nonce":3686635770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6868","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6869","nonce":3686635770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6872","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6873","nonce":3686635770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6870","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6871","nonce":3686635770}]},"public_addr":"10.20.193.60:6867/3686635770","cluster_addr":"10.20.193.60:6869/3686635770","heartbeat_back_addr":"10.20.193.60:6873/3686635770","heartbeat_front_addr":"10.20.193.60:6871/3686635770","state":["exists","up"]},{"osd":6,"uuid":"f72c16d3-3504-4ea0-8566-4ff600674ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6858","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6859","nonce":4090637263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6860","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6861","nonce":4090637263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6864","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6865","nonce":4090637263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6862","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6863","nonce":4090637263}]},"public_addr":"10.20.193.60:6859/4090637263","cluster_addr":"10.20.193.60:6861/4090637263","heartbeat_back_addr":"10.20.193.60:6865/4090637263","heartbeat_front_addr":"10.20.193.60:6863/4090637263","state":["exists","up"]},{"osd":7,"uuid":"40b9cbfa-b547-4bdf-8138-8a153fcdc783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6812","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6815","nonce":2933518250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6818","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6821","nonce":2933518250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6829","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6831","nonce":2933518250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6824","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6826","nonce":2933518250}]},"public_addr":"10.20.193.60:6815/2933518250","cluster_addr":"10.20.193.60:6821/2933518250","heartbeat_back_addr":"10.20.193.60:6831/2933518250","heartbeat_front_addr":"10.20.193.60:6826/2933518250","state":["exists","up"]},{"osd":8,"uuid":"5fc057b6-c560-4963-bcd8-53d743e23ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6874","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6875","nonce":1343250244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6876","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6877","nonce":1343250244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6880","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6881","nonce":1343250244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6878","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6879","nonce":1343250244}]},"public_addr":"10.20.193.60:6875/1343250244","cluster_addr":"10.20.193.60:6877/1343250244","heartbeat_back_addr":"10.20.193.60:6881/1343250244","heartbeat_front_addr":"10.20.193.60:6879/1343250244","state":["exists","up"]},{"osd":9,"uuid":"4aeac3b5-484a-4c74-93f6-0e4244fefcb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6850","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6851","nonce":2786579016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6852","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6853","nonce":2786579016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6856","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6857","nonce":2786579016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6854","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6855","nonce":2786579016}]},"public_addr":"10.20.193.60:6851/2786579016","cluster_addr":"10.20.193.60:6853/2786579016","heartbeat_back_addr":"10.20.193.60:6857/2786579016","heartbeat_front_addr":"10.20.193.60:6855/2786579016","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T18:07:49.697 DEBUG:teuthology.misc:10 of 10 OSDs are up 2026-02-12T18:07:49.697 INFO:tasks.ceph:Creating RBD pool 2026-02-12T18:07:49.697 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-12T18:07:50.675 INFO:teuthology.orchestra.run.trial060.stderr:pool 'rbd' created 2026-02-12T18:07:50.690 DEBUG:teuthology.orchestra.run.trial060:> rbd --cluster ceph pool init rbd 2026-02-12T18:07:53.691 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-12T18:07:53.692 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-12T18:07:53.692 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-12T18:07:53.848 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:53.860 INFO:teuthology.orchestra.run.trial060.stdout:[{"version":2,"timestamp":"2026-02-12T18:07:39.496906+0000","name":"","changes":[{"name":"mgr/mgr_pool","new_value":"false"}]}] 2026-02-12T18:07:53.861 INFO:tasks.ceph_manager:config epoch is 2 2026-02-12T18:07:53.861 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-12T18:07:53.861 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-12T18:07:53.861 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-12T18:07:54.047 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:54.058 INFO:teuthology.orchestra.run.trial060.stdout:{"epoch":4,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6800","nonce":3845764431},{"type":"v1","addr":"10.20.193.60:6801","nonce":3845764431}]},"active_addr":"10.20.193.60:6801/3845764431","active_change":"2026-02-12T18:07:41.652937+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.60:0","nonce":2721591126}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.60:0","nonce":1268893272}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.60:0","nonce":172532726}]}]} 2026-02-12T18:07:54.063 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-12T18:07:54.063 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-12T18:07:54.063 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T18:07:54.230 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:54.231 INFO:teuthology.orchestra.run.trial060.stdout:{"epoch":19,"fsid":"25fa2def-3287-4142-b1ac-e832bbd8bb26","created":"2026-02-12T18:07:39.457591+0000","modified":"2026-02-12T18:07:53.678749+0000","last_up_change":"2026-02-12T18:07:45.660976+0000","last_in_change":"2026-02-12T18:07:41.295407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-12T18:07:49.856623+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.89999997615814209,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ad3e842-c1f9-4b56-9d5c-97cd470a6929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6842","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6843","nonce":3591020635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6844","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6845","nonce":3591020635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6848","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6849","nonce":3591020635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6846","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6847","nonce":3591020635}]},"public_addr":"10.20.193.60:6843/3591020635","cluster_addr":"10.20.193.60:6845/3591020635","heartbeat_back_addr":"10.20.193.60:6849/3591020635","heartbeat_front_addr":"10.20.193.60:6847/3591020635","state":["exists","up"]},{"osd":1,"uuid":"bfa10ffc-c863-4cf1-8c88-0a779cfc73fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6810","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6811","nonce":1953903305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6814","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6816","nonce":1953903305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6825","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6828","nonce":1953903305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6819","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6822","nonce":1953903305}]},"public_addr":"10.20.193.60:6811/1953903305","cluster_addr":"10.20.193.60:6816/1953903305","heartbeat_back_addr":"10.20.193.60:6828/1953903305","heartbeat_front_addr":"10.20.193.60:6822/1953903305","state":["exists","up"]},{"osd":2,"uuid":"97e2a94a-d5b2-4254-ace1-f21d76a702a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6813","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6817","nonce":1093602441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6820","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6823","nonce":1093602441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6832","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6833","nonce":1093602441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6827","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6830","nonce":1093602441}]},"public_addr":"10.20.193.60:6817/1093602441","cluster_addr":"10.20.193.60:6823/1093602441","heartbeat_back_addr":"10.20.193.60:6833/1093602441","heartbeat_front_addr":"10.20.193.60:6830/1093602441","state":["exists","up"]},{"osd":3,"uuid":"49826740-fd2f-46b7-b6ab-ff968ce54201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6802","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6803","nonce":3027881260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6804","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6805","nonce":3027881260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6808","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6809","nonce":3027881260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6806","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6807","nonce":3027881260}]},"public_addr":"10.20.193.60:6803/3027881260","cluster_addr":"10.20.193.60:6805/3027881260","heartbeat_back_addr":"10.20.193.60:6809/3027881260","heartbeat_front_addr":"10.20.193.60:6807/3027881260","state":["exists","up"]},{"osd":4,"uuid":"98c28f51-3a65-4387-bc9a-072addee6349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6834","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6835","nonce":1082935684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6836","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6837","nonce":1082935684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6840","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6841","nonce":1082935684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6838","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6839","nonce":1082935684}]},"public_addr":"10.20.193.60:6835/1082935684","cluster_addr":"10.20.193.60:6837/1082935684","heartbeat_back_addr":"10.20.193.60:6841/1082935684","heartbeat_front_addr":"10.20.193.60:6839/1082935684","state":["exists","up"]},{"osd":5,"uuid":"282e5382-9f9e-41fe-9620-40fb2b9ea2a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6866","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6867","nonce":3686635770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6868","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6869","nonce":3686635770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6872","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6873","nonce":3686635770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6870","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6871","nonce":3686635770}]},"public_addr":"10.20.193.60:6867/3686635770","cluster_addr":"10.20.193.60:6869/3686635770","heartbeat_back_addr":"10.20.193.60:6873/3686635770","heartbeat_front_addr":"10.20.193.60:6871/3686635770","state":["exists","up"]},{"osd":6,"uuid":"f72c16d3-3504-4ea0-8566-4ff600674ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6858","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6859","nonce":4090637263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6860","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6861","nonce":4090637263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6864","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6865","nonce":4090637263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6862","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6863","nonce":4090637263}]},"public_addr":"10.20.193.60:6859/4090637263","cluster_addr":"10.20.193.60:6861/4090637263","heartbeat_back_addr":"10.20.193.60:6865/4090637263","heartbeat_front_addr":"10.20.193.60:6863/4090637263","state":["exists","up"]},{"osd":7,"uuid":"40b9cbfa-b547-4bdf-8138-8a153fcdc783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6812","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6815","nonce":2933518250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6818","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6821","nonce":2933518250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6829","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6831","nonce":2933518250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6824","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6826","nonce":2933518250}]},"public_addr":"10.20.193.60:6815/2933518250","cluster_addr":"10.20.193.60:6821/2933518250","heartbeat_back_addr":"10.20.193.60:6831/2933518250","heartbeat_front_addr":"10.20.193.60:6826/2933518250","state":["exists","up"]},{"osd":8,"uuid":"5fc057b6-c560-4963-bcd8-53d743e23ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6874","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6875","nonce":1343250244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6876","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6877","nonce":1343250244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6880","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6881","nonce":1343250244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6878","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6879","nonce":1343250244}]},"public_addr":"10.20.193.60:6875/1343250244","cluster_addr":"10.20.193.60:6877/1343250244","heartbeat_back_addr":"10.20.193.60:6881/1343250244","heartbeat_front_addr":"10.20.193.60:6879/1343250244","state":["exists","up"]},{"osd":9,"uuid":"4aeac3b5-484a-4c74-93f6-0e4244fefcb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6850","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6851","nonce":2786579016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6852","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6853","nonce":2786579016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6856","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6857","nonce":2786579016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6854","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6855","nonce":2786579016}]},"public_addr":"10.20.193.60:6851/2786579016","cluster_addr":"10.20.193.60:6853/2786579016","heartbeat_back_addr":"10.20.193.60:6857/2786579016","heartbeat_front_addr":"10.20.193.60:6855/2786579016","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T18:07:54.242 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-12T18:07:54.243 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T18:07:54.405 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:54.405 INFO:teuthology.orchestra.run.trial060.stdout:{"epoch":19,"fsid":"25fa2def-3287-4142-b1ac-e832bbd8bb26","created":"2026-02-12T18:07:39.457591+0000","modified":"2026-02-12T18:07:53.678749+0000","last_up_change":"2026-02-12T18:07:45.660976+0000","last_in_change":"2026-02-12T18:07:41.295407+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-12T18:07:49.856623+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.89999997615814209,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ad3e842-c1f9-4b56-9d5c-97cd470a6929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6842","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6843","nonce":3591020635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6844","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6845","nonce":3591020635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6848","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6849","nonce":3591020635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6846","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6847","nonce":3591020635}]},"public_addr":"10.20.193.60:6843/3591020635","cluster_addr":"10.20.193.60:6845/3591020635","heartbeat_back_addr":"10.20.193.60:6849/3591020635","heartbeat_front_addr":"10.20.193.60:6847/3591020635","state":["exists","up"]},{"osd":1,"uuid":"bfa10ffc-c863-4cf1-8c88-0a779cfc73fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6810","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6811","nonce":1953903305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6814","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6816","nonce":1953903305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6825","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6828","nonce":1953903305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6819","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6822","nonce":1953903305}]},"public_addr":"10.20.193.60:6811/1953903305","cluster_addr":"10.20.193.60:6816/1953903305","heartbeat_back_addr":"10.20.193.60:6828/1953903305","heartbeat_front_addr":"10.20.193.60:6822/1953903305","state":["exists","up"]},{"osd":2,"uuid":"97e2a94a-d5b2-4254-ace1-f21d76a702a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6813","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6817","nonce":1093602441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6820","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6823","nonce":1093602441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6832","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6833","nonce":1093602441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6827","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6830","nonce":1093602441}]},"public_addr":"10.20.193.60:6817/1093602441","cluster_addr":"10.20.193.60:6823/1093602441","heartbeat_back_addr":"10.20.193.60:6833/1093602441","heartbeat_front_addr":"10.20.193.60:6830/1093602441","state":["exists","up"]},{"osd":3,"uuid":"49826740-fd2f-46b7-b6ab-ff968ce54201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6802","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6803","nonce":3027881260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6804","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6805","nonce":3027881260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6808","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6809","nonce":3027881260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6806","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6807","nonce":3027881260}]},"public_addr":"10.20.193.60:6803/3027881260","cluster_addr":"10.20.193.60:6805/3027881260","heartbeat_back_addr":"10.20.193.60:6809/3027881260","heartbeat_front_addr":"10.20.193.60:6807/3027881260","state":["exists","up"]},{"osd":4,"uuid":"98c28f51-3a65-4387-bc9a-072addee6349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6834","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6835","nonce":1082935684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6836","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6837","nonce":1082935684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6840","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6841","nonce":1082935684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6838","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6839","nonce":1082935684}]},"public_addr":"10.20.193.60:6835/1082935684","cluster_addr":"10.20.193.60:6837/1082935684","heartbeat_back_addr":"10.20.193.60:6841/1082935684","heartbeat_front_addr":"10.20.193.60:6839/1082935684","state":["exists","up"]},{"osd":5,"uuid":"282e5382-9f9e-41fe-9620-40fb2b9ea2a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6866","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6867","nonce":3686635770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6868","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6869","nonce":3686635770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6872","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6873","nonce":3686635770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6870","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6871","nonce":3686635770}]},"public_addr":"10.20.193.60:6867/3686635770","cluster_addr":"10.20.193.60:6869/3686635770","heartbeat_back_addr":"10.20.193.60:6873/3686635770","heartbeat_front_addr":"10.20.193.60:6871/3686635770","state":["exists","up"]},{"osd":6,"uuid":"f72c16d3-3504-4ea0-8566-4ff600674ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6858","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6859","nonce":4090637263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6860","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6861","nonce":4090637263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6864","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6865","nonce":4090637263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6862","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6863","nonce":4090637263}]},"public_addr":"10.20.193.60:6859/4090637263","cluster_addr":"10.20.193.60:6861/4090637263","heartbeat_back_addr":"10.20.193.60:6865/4090637263","heartbeat_front_addr":"10.20.193.60:6863/4090637263","state":["exists","up"]},{"osd":7,"uuid":"40b9cbfa-b547-4bdf-8138-8a153fcdc783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6812","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6815","nonce":2933518250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6818","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6821","nonce":2933518250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6829","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6831","nonce":2933518250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6824","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6826","nonce":2933518250}]},"public_addr":"10.20.193.60:6815/2933518250","cluster_addr":"10.20.193.60:6821/2933518250","heartbeat_back_addr":"10.20.193.60:6831/2933518250","heartbeat_front_addr":"10.20.193.60:6826/2933518250","state":["exists","up"]},{"osd":8,"uuid":"5fc057b6-c560-4963-bcd8-53d743e23ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6874","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6875","nonce":1343250244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6876","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6877","nonce":1343250244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6880","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6881","nonce":1343250244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6878","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6879","nonce":1343250244}]},"public_addr":"10.20.193.60:6875/1343250244","cluster_addr":"10.20.193.60:6877/1343250244","heartbeat_back_addr":"10.20.193.60:6881/1343250244","heartbeat_front_addr":"10.20.193.60:6879/1343250244","state":["exists","up"]},{"osd":9,"uuid":"4aeac3b5-484a-4c74-93f6-0e4244fefcb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6850","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6851","nonce":2786579016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6852","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6853","nonce":2786579016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6856","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6857","nonce":2786579016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6854","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6855","nonce":2786579016}]},"public_addr":"10.20.193.60:6851/2786579016","cluster_addr":"10.20.193.60:6853/2786579016","heartbeat_back_addr":"10.20.193.60:6857/2786579016","heartbeat_front_addr":"10.20.193.60:6855/2786579016","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T18:07:54.416 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-12T18:07:54.417 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-12T18:07:54.418 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-12T18:07:54.418 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-12T18:07:54.419 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-12T18:07:54.419 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-12T18:07:54.420 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-12T18:07:54.420 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-12T18:07:54.421 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-12T18:07:54.421 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-12T18:07:54.515 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:54.515 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T18:07:54.517 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:54.518 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-12T18:07:54.519 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:54.520 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-12T18:07:54.522 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:54.522 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-12T18:07:54.524 INFO:teuthology.orchestra.run.trial060.stdout:64424509444 2026-02-12T18:07:54.524 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-12T18:07:54.525 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:54.526 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-12T18:07:54.527 INFO:teuthology.orchestra.run.trial060.stdout:64424509444 2026-02-12T18:07:54.527 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-12T18:07:54.529 INFO:teuthology.orchestra.run.trial060.stdout:64424509444 2026-02-12T18:07:54.530 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T18:07:54.531 INFO:teuthology.orchestra.run.trial060.stdout:64424509444 2026-02-12T18:07:54.531 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T18:07:54.534 INFO:teuthology.orchestra.run.trial060.stdout:64424509444 2026-02-12T18:07:54.535 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T18:07:54.684 INFO:teuthology.orchestra.run.trial060.stdout:64424509442 2026-02-12T18:07:54.688 INFO:teuthology.orchestra.run.trial060.stdout:64424509442 2026-02-12T18:07:54.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.2 2026-02-12T18:07:54.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.5 2026-02-12T18:07:54.702 INFO:teuthology.orchestra.run.trial060.stdout:64424509442 2026-02-12T18:07:54.711 INFO:teuthology.orchestra.run.trial060.stdout:64424509442 2026-02-12T18:07:54.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.6 2026-02-12T18:07:54.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.4 2026-02-12T18:07:54.743 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:54.746 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:54.748 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:54.752 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:54.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.8 2026-02-12T18:07:54.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.9 2026-02-12T18:07:54.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.3 2026-02-12T18:07:54.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.1 2026-02-12T18:07:54.769 INFO:teuthology.orchestra.run.trial060.stdout:64424509442 2026-02-12T18:07:54.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.7 2026-02-12T18:07:54.810 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:54.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.0 2026-02-12T18:07:55.700 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T18:07:55.703 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-12T18:07:55.715 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-12T18:07:55.725 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-12T18:07:55.757 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-12T18:07:55.760 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-12T18:07:55.761 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T18:07:55.765 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T18:07:55.782 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-12T18:07:55.823 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T18:07:55.860 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:55.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.2 2026-02-12T18:07:55.874 DEBUG:teuthology.parallel:result is None 2026-02-12T18:07:55.918 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:55.928 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:55.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.6 2026-02-12T18:07:55.932 DEBUG:teuthology.parallel:result is None 2026-02-12T18:07:55.938 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:55.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.4 2026-02-12T18:07:55.942 DEBUG:teuthology.parallel:result is None 2026-02-12T18:07:55.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.5 2026-02-12T18:07:55.952 DEBUG:teuthology.parallel:result is None 2026-02-12T18:07:55.961 INFO:teuthology.orchestra.run.trial060.stdout:64424509443 2026-02-12T18:07:55.966 INFO:teuthology.orchestra.run.trial060.stdout:64424509444 2026-02-12T18:07:55.970 INFO:teuthology.orchestra.run.trial060.stdout:64424509444 2026-02-12T18:07:55.970 INFO:teuthology.orchestra.run.trial060.stdout:64424509444 2026-02-12T18:07:55.971 INFO:teuthology.orchestra.run.trial060.stdout:64424509444 2026-02-12T18:07:55.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.7 2026-02-12T18:07:55.974 DEBUG:teuthology.parallel:result is None 2026-02-12T18:07:55.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.8 2026-02-12T18:07:55.979 DEBUG:teuthology.parallel:result is None 2026-02-12T18:07:55.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.9 2026-02-12T18:07:55.984 DEBUG:teuthology.parallel:result is None 2026-02-12T18:07:55.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.1 2026-02-12T18:07:55.986 DEBUG:teuthology.parallel:result is None 2026-02-12T18:07:55.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.3 2026-02-12T18:07:55.986 DEBUG:teuthology.parallel:result is None 2026-02-12T18:07:56.009 INFO:teuthology.orchestra.run.trial060.stdout:64424509444 2026-02-12T18:07:56.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.0 2026-02-12T18:07:56.022 DEBUG:teuthology.parallel:result is None 2026-02-12T18:07:56.022 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T18:07:56.022 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:07:56.219 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:56.220 INFO:teuthology.orchestra.run.trial060.stderr:dumped all 2026-02-12T18:07:56.231 INFO:teuthology.orchestra.run.trial060.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-12T18:07:55.657932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":1048576000,"kb_used":271324,"kb_used_data":1724,"kb_used_omap":62,"kb_used_meta":269377,"kb_avail":1048304676,"statfs":{"total":1073741824000,"available":1073463988224,"internally_reserved":0,"allocated":1765376,"data_stored":553285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63647,"internal_metadata":275842913},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:54.212597+0000","last_change":"2026-02-12T18:07:54.212727+0000","last_active":"2026-02-12T18:07:54.212597+0000","last_peered":"2026-02-12T18:07:54.212597+0000","last_clean":"2026-02-12T18:07:54.212597+0000","last_became_active":"2026-02-12T18:07:51.679293+0000","last_became_peered":"2026-02-12T18:07:51.679293+0000","last_unstale":"2026-02-12T18:07:54.212597+0000","last_undegraded":"2026-02-12T18:07:54.212597+0000","last_fullsized":"2026-02-12T18:07:54.212597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:03:03.693393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027722199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:54.212627+0000","last_change":"2026-02-12T18:07:54.212775+0000","last_active":"2026-02-12T18:07:54.212627+0000","last_peered":"2026-02-12T18:07:54.212627+0000","last_clean":"2026-02-12T18:07:54.212627+0000","last_became_active":"2026-02-12T18:07:51.788606+0000","last_became_peered":"2026-02-12T18:07:51.788606+0000","last_unstale":"2026-02-12T18:07:54.212627+0000","last_undegraded":"2026-02-12T18:07:54.212627+0000","last_fullsized":"2026-02-12T18:07:54.212627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:44:25.477636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030204800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:54.212544+0000","last_change":"2026-02-12T18:07:54.212544+0000","last_active":"2026-02-12T18:07:54.212544+0000","last_peered":"2026-02-12T18:07:54.212544+0000","last_clean":"2026-02-12T18:07:54.212544+0000","last_became_active":"2026-02-12T18:07:51.679306+0000","last_became_peered":"2026-02-12T18:07:51.679306+0000","last_unstale":"2026-02-12T18:07:54.212544+0000","last_undegraded":"2026-02-12T18:07:54.212544+0000","last_fullsized":"2026-02-12T18:07:54.212544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:04:35.409425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:53.681423+0000","last_change":"2026-02-12T18:07:53.681548+0000","last_active":"2026-02-12T18:07:53.681423+0000","last_peered":"2026-02-12T18:07:53.681423+0000","last_clean":"2026-02-12T18:07:53.681423+0000","last_became_active":"2026-02-12T18:07:51.679379+0000","last_became_peered":"2026-02-12T18:07:51.679379+0000","last_unstale":"2026-02-12T18:07:53.681423+0000","last_undegraded":"2026-02-12T18:07:53.681423+0000","last_fullsized":"2026-02-12T18:07:53.681423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:43:26.081792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000280108,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:54.212552+0000","last_change":"2026-02-12T18:07:54.212552+0000","last_active":"2026-02-12T18:07:54.212552+0000","last_peered":"2026-02-12T18:07:54.212552+0000","last_clean":"2026-02-12T18:07:54.212552+0000","last_became_active":"2026-02-12T18:07:51.732563+0000","last_became_peered":"2026-02-12T18:07:51.732563+0000","last_unstale":"2026-02-12T18:07:54.212552+0000","last_undegraded":"2026-02-12T18:07:54.212552+0000","last_fullsized":"2026-02-12T18:07:54.212552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:22:18.480910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030960200000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:53.683882+0000","last_change":"2026-02-12T18:07:53.683372+0000","last_active":"2026-02-12T18:07:53.683882+0000","last_peered":"2026-02-12T18:07:53.683882+0000","last_clean":"2026-02-12T18:07:53.683882+0000","last_became_active":"2026-02-12T18:07:51.679288+0000","last_became_peered":"2026-02-12T18:07:51.679288+0000","last_unstale":"2026-02-12T18:07:53.683882+0000","last_undegraded":"2026-02-12T18:07:53.683882+0000","last_fullsized":"2026-02-12T18:07:53.683882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:43:26.081792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057906899999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:54.212709+0000","last_change":"2026-02-12T18:07:54.212709+0000","last_active":"2026-02-12T18:07:54.212709+0000","last_peered":"2026-02-12T18:07:54.212709+0000","last_clean":"2026-02-12T18:07:54.212709+0000","last_became_active":"2026-02-12T18:07:51.679322+0000","last_became_peered":"2026-02-12T18:07:51.679322+0000","last_unstale":"2026-02-12T18:07:54.212709+0000","last_undegraded":"2026-02-12T18:07:54.212709+0000","last_fullsized":"2026-02-12T18:07:54.212709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:43:56.645338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028142899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:54.212807+0000","last_change":"2026-02-12T18:07:54.212807+0000","last_active":"2026-02-12T18:07:54.212807+0000","last_peered":"2026-02-12T18:07:54.212807+0000","last_clean":"2026-02-12T18:07:54.212807+0000","last_became_active":"2026-02-12T18:07:51.679360+0000","last_became_peered":"2026-02-12T18:07:51.679360+0000","last_unstale":"2026-02-12T18:07:54.212807+0000","last_undegraded":"2026-02-12T18:07:54.212807+0000","last_fullsized":"2026-02-12T18:07:54.212807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:19:23.860056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033961700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6173,"internal_metadata":27584483},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":59683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6820,"internal_metadata":27583836},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6167,"internal_metadata":27584489},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6822,"internal_metadata":27583834},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":59683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:07:56.233 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:07:56.388 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:56.388 INFO:teuthology.orchestra.run.trial060.stderr:dumped all 2026-02-12T18:07:56.397 INFO:teuthology.orchestra.run.trial060.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-12T18:07:55.657932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":1048576000,"kb_used":271324,"kb_used_data":1724,"kb_used_omap":62,"kb_used_meta":269377,"kb_avail":1048304676,"statfs":{"total":1073741824000,"available":1073463988224,"internally_reserved":0,"allocated":1765376,"data_stored":553285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63647,"internal_metadata":275842913},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:54.212597+0000","last_change":"2026-02-12T18:07:54.212727+0000","last_active":"2026-02-12T18:07:54.212597+0000","last_peered":"2026-02-12T18:07:54.212597+0000","last_clean":"2026-02-12T18:07:54.212597+0000","last_became_active":"2026-02-12T18:07:51.679293+0000","last_became_peered":"2026-02-12T18:07:51.679293+0000","last_unstale":"2026-02-12T18:07:54.212597+0000","last_undegraded":"2026-02-12T18:07:54.212597+0000","last_fullsized":"2026-02-12T18:07:54.212597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:03:03.693393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027722199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:54.212627+0000","last_change":"2026-02-12T18:07:54.212775+0000","last_active":"2026-02-12T18:07:54.212627+0000","last_peered":"2026-02-12T18:07:54.212627+0000","last_clean":"2026-02-12T18:07:54.212627+0000","last_became_active":"2026-02-12T18:07:51.788606+0000","last_became_peered":"2026-02-12T18:07:51.788606+0000","last_unstale":"2026-02-12T18:07:54.212627+0000","last_undegraded":"2026-02-12T18:07:54.212627+0000","last_fullsized":"2026-02-12T18:07:54.212627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:44:25.477636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030204800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:54.212544+0000","last_change":"2026-02-12T18:07:54.212544+0000","last_active":"2026-02-12T18:07:54.212544+0000","last_peered":"2026-02-12T18:07:54.212544+0000","last_clean":"2026-02-12T18:07:54.212544+0000","last_became_active":"2026-02-12T18:07:51.679306+0000","last_became_peered":"2026-02-12T18:07:51.679306+0000","last_unstale":"2026-02-12T18:07:54.212544+0000","last_undegraded":"2026-02-12T18:07:54.212544+0000","last_fullsized":"2026-02-12T18:07:54.212544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:04:35.409425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:53.681423+0000","last_change":"2026-02-12T18:07:53.681548+0000","last_active":"2026-02-12T18:07:53.681423+0000","last_peered":"2026-02-12T18:07:53.681423+0000","last_clean":"2026-02-12T18:07:53.681423+0000","last_became_active":"2026-02-12T18:07:51.679379+0000","last_became_peered":"2026-02-12T18:07:51.679379+0000","last_unstale":"2026-02-12T18:07:53.681423+0000","last_undegraded":"2026-02-12T18:07:53.681423+0000","last_fullsized":"2026-02-12T18:07:53.681423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:43:26.081792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000280108,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:54.212552+0000","last_change":"2026-02-12T18:07:54.212552+0000","last_active":"2026-02-12T18:07:54.212552+0000","last_peered":"2026-02-12T18:07:54.212552+0000","last_clean":"2026-02-12T18:07:54.212552+0000","last_became_active":"2026-02-12T18:07:51.732563+0000","last_became_peered":"2026-02-12T18:07:51.732563+0000","last_unstale":"2026-02-12T18:07:54.212552+0000","last_undegraded":"2026-02-12T18:07:54.212552+0000","last_fullsized":"2026-02-12T18:07:54.212552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:22:18.480910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030960200000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:53.683882+0000","last_change":"2026-02-12T18:07:53.683372+0000","last_active":"2026-02-12T18:07:53.683882+0000","last_peered":"2026-02-12T18:07:53.683882+0000","last_clean":"2026-02-12T18:07:53.683882+0000","last_became_active":"2026-02-12T18:07:51.679288+0000","last_became_peered":"2026-02-12T18:07:51.679288+0000","last_unstale":"2026-02-12T18:07:53.683882+0000","last_undegraded":"2026-02-12T18:07:53.683882+0000","last_fullsized":"2026-02-12T18:07:53.683882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:43:26.081792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057906899999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:54.212709+0000","last_change":"2026-02-12T18:07:54.212709+0000","last_active":"2026-02-12T18:07:54.212709+0000","last_peered":"2026-02-12T18:07:54.212709+0000","last_clean":"2026-02-12T18:07:54.212709+0000","last_became_active":"2026-02-12T18:07:51.679322+0000","last_became_peered":"2026-02-12T18:07:51.679322+0000","last_unstale":"2026-02-12T18:07:54.212709+0000","last_undegraded":"2026-02-12T18:07:54.212709+0000","last_fullsized":"2026-02-12T18:07:54.212709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:43:56.645338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028142899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-12T18:07:54.212807+0000","last_change":"2026-02-12T18:07:54.212807+0000","last_active":"2026-02-12T18:07:54.212807+0000","last_peered":"2026-02-12T18:07:54.212807+0000","last_clean":"2026-02-12T18:07:54.212807+0000","last_became_active":"2026-02-12T18:07:51.679360+0000","last_became_peered":"2026-02-12T18:07:51.679360+0000","last_unstale":"2026-02-12T18:07:54.212807+0000","last_undegraded":"2026-02-12T18:07:54.212807+0000","last_fullsized":"2026-02-12T18:07:54.212807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:19:23.860056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033961700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6173,"internal_metadata":27584483},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":59683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6820,"internal_metadata":27583836},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509443,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6167,"internal_metadata":27584489},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6822,"internal_metadata":27583834},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27128,"kb_used_data":168,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830472,"statfs":{"total":107374182400,"available":107346403328,"internally_reserved":0,"allocated":172032,"data_stored":53465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6168,"internal_metadata":27584488},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":59683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:07:56.399 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T18:07:56.399 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-12T18:07:56.399 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-12T18:07:56.400 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-12T18:07:56.580 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:07:56.580 INFO:teuthology.orchestra.run.trial060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-12T18:07:56.593 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-12T18:07:56.593 INFO:teuthology.run_tasks:Running task workunit... 2026-02-12T18:07:56.619 INFO:tasks.workunit:Pulling workunits from ref afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T18:07:56.620 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-12T18:07:56.620 INFO:tasks.workunit:timeout=3h 2026-02-12T18:07:56.620 INFO:tasks.workunit:cleanup=True 2026-02-12T18:07:56.620 DEBUG:teuthology.orchestra.run.trial060:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-12T18:07:56.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T18:07:56.626 INFO:teuthology.orchestra.run.trial060.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-12T18:07:56.626 DEBUG:teuthology.orchestra.run.trial060:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-12T18:07:56.674 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-12T18:07:56.674 DEBUG:teuthology.orchestra.run.trial060:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-12T18:07:56.721 DEBUG:teuthology.orchestra.run.trial060:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T18:07:56.772 INFO:tasks.workunit.client.0.trial060.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-12T18:08:18.267 INFO:tasks.workunit.client.0.trial060.stderr:Note: switching to 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'. 2026-02-12T18:08:18.267 INFO:tasks.workunit.client.0.trial060.stderr: 2026-02-12T18:08:18.268 INFO:tasks.workunit.client.0.trial060.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-12T18:08:18.268 INFO:tasks.workunit.client.0.trial060.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-12T18:08:18.268 INFO:tasks.workunit.client.0.trial060.stderr:state without impacting any branches by switching back to a branch. 2026-02-12T18:08:18.268 INFO:tasks.workunit.client.0.trial060.stderr: 2026-02-12T18:08:18.268 INFO:tasks.workunit.client.0.trial060.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-12T18:08:18.268 INFO:tasks.workunit.client.0.trial060.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-12T18:08:18.268 INFO:tasks.workunit.client.0.trial060.stderr: 2026-02-12T18:08:18.268 INFO:tasks.workunit.client.0.trial060.stderr: git switch -c 2026-02-12T18:08:18.268 INFO:tasks.workunit.client.0.trial060.stderr: 2026-02-12T18:08:18.268 INFO:tasks.workunit.client.0.trial060.stderr:Or undo this operation with: 2026-02-12T18:08:18.268 INFO:tasks.workunit.client.0.trial060.stderr: 2026-02-12T18:08:18.269 INFO:tasks.workunit.client.0.trial060.stderr: git switch - 2026-02-12T18:08:18.269 INFO:tasks.workunit.client.0.trial060.stderr: 2026-02-12T18:08:18.269 INFO:tasks.workunit.client.0.trial060.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-12T18:08:18.269 INFO:tasks.workunit.client.0.trial060.stderr: 2026-02-12T18:08:18.269 INFO:tasks.workunit.client.0.trial060.stderr:HEAD is now at afefaa40503 Merge branch 'block_non_4k_chunks' of https://github.com/aainscow/ceph into wip-yuri4-testing-2026-02-11-2126 2026-02-12T18:08:18.276 DEBUG:teuthology.orchestra.run.trial060:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-12T18:08:18.322 INFO:tasks.workunit.client.0.trial060.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-12T18:08:18.323 INFO:tasks.workunit.client.0.trial060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-12T18:08:18.323 INFO:tasks.workunit.client.0.trial060.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-12T18:08:18.421 INFO:tasks.workunit.client.0.trial060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-12T18:08:18.454 INFO:tasks.workunit.client.0.trial060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-12T18:08:18.480 INFO:tasks.workunit.client.0.trial060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-12T18:08:18.481 INFO:tasks.workunit.client.0.trial060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-12T18:08:18.482 INFO:tasks.workunit.client.0.trial060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-12T18:08:18.508 INFO:tasks.workunit.client.0.trial060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-12T18:08:18.511 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-12T18:08:18.511 DEBUG:teuthology.orchestra.run.trial060:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-12T18:08:18.558 INFO:tasks.workunit:Running workunits matching rados/test_health_warnings.sh on client.0... 2026-02-12T18:08:18.561 INFO:tasks.workunit:Running workunit rados/test_health_warnings.sh... 2026-02-12T18:08:18.561 DEBUG:teuthology.orchestra.run.trial060:workunit test rados/test_health_warnings.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=afefaa40503a4bf024e96f97dd7f852b75f00ad6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_health_warnings.sh 2026-02-12T18:08:18.610 INFO:tasks.workunit.client.0.trial060.stderr:+ crushtool -o crushmap --build --num_osds 10 host straw 2 rack straw 2 row straw 2 root straw 0 2026-02-12T18:08:18.621 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd setcrushmap -i crushmap 2026-02-12T18:08:20.432 INFO:tasks.workunit.client.0.trial060.stderr:6 2026-02-12T18:08:20.447 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd tree 2026-02-12T18:08:20.641 INFO:tasks.workunit.client.0.trial060.stdout:ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF 2026-02-12T18:08:20.642 INFO:tasks.workunit.client.0.trial060.stdout:-11 10.00000 root root 2026-02-12T18:08:20.642 INFO:tasks.workunit.client.0.trial060.stdout: -9 8.00000 row row0 2026-02-12T18:08:20.642 INFO:tasks.workunit.client.0.trial060.stdout: -6 4.00000 rack rack0 2026-02-12T18:08:20.642 INFO:tasks.workunit.client.0.trial060.stdout: -1 2.00000 host host0 2026-02-12T18:08:20.642 INFO:tasks.workunit.client.0.trial060.stdout: 0 1.00000 osd.0 up 1.00000 1.00000 2026-02-12T18:08:20.642 INFO:tasks.workunit.client.0.trial060.stdout: 1 1.00000 osd.1 up 1.00000 1.00000 2026-02-12T18:08:20.642 INFO:tasks.workunit.client.0.trial060.stdout: -2 2.00000 host host1 2026-02-12T18:08:20.642 INFO:tasks.workunit.client.0.trial060.stdout: 2 1.00000 osd.2 up 1.00000 1.00000 2026-02-12T18:08:20.642 INFO:tasks.workunit.client.0.trial060.stdout: 3 1.00000 osd.3 up 1.00000 1.00000 2026-02-12T18:08:20.643 INFO:tasks.workunit.client.0.trial060.stdout: -7 4.00000 rack rack1 2026-02-12T18:08:20.643 INFO:tasks.workunit.client.0.trial060.stdout: -3 2.00000 host host2 2026-02-12T18:08:20.643 INFO:tasks.workunit.client.0.trial060.stdout: 4 1.00000 osd.4 up 1.00000 1.00000 2026-02-12T18:08:20.643 INFO:tasks.workunit.client.0.trial060.stdout: 5 1.00000 osd.5 up 1.00000 1.00000 2026-02-12T18:08:20.643 INFO:tasks.workunit.client.0.trial060.stdout: -4 2.00000 host host3 2026-02-12T18:08:20.643 INFO:tasks.workunit.client.0.trial060.stdout: 6 1.00000 osd.6 up 1.00000 1.00000 2026-02-12T18:08:20.643 INFO:tasks.workunit.client.0.trial060.stdout: 7 1.00000 osd.7 up 1.00000 1.00000 2026-02-12T18:08:20.643 INFO:tasks.workunit.client.0.trial060.stdout:-10 2.00000 row row1 2026-02-12T18:08:20.643 INFO:tasks.workunit.client.0.trial060.stdout: -8 2.00000 rack rack2 2026-02-12T18:08:20.643 INFO:tasks.workunit.client.0.trial060.stdout: -5 2.00000 host host4 2026-02-12T18:08:20.643 INFO:tasks.workunit.client.0.trial060.stdout: 8 1.00000 osd.8 up 1.00000 1.00000 2026-02-12T18:08:20.643 INFO:tasks.workunit.client.0.trial060.stdout: 9 1.00000 osd.9 up 1.00000 1.00000 2026-02-12T18:08:20.651 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph tell 'osd.*' injectargs --osd_max_markdown_count 1024 --osd_max_markdown_period 1 2026-02-12T18:08:20.742 INFO:tasks.workunit.client.0.trial060.stdout:osd.0: {} 2026-02-12T18:08:20.759 INFO:tasks.workunit.client.0.trial060.stdout:osd.1: {} 2026-02-12T18:08:20.776 INFO:tasks.workunit.client.0.trial060.stdout:osd.2: {} 2026-02-12T18:08:20.792 INFO:tasks.workunit.client.0.trial060.stdout:osd.3: {} 2026-02-12T18:08:20.809 INFO:tasks.workunit.client.0.trial060.stdout:osd.4: {} 2026-02-12T18:08:20.826 INFO:tasks.workunit.client.0.trial060.stdout:osd.5: {} 2026-02-12T18:08:20.843 INFO:tasks.workunit.client.0.trial060.stdout:osd.6: {} 2026-02-12T18:08:20.860 INFO:tasks.workunit.client.0.trial060.stdout:osd.7: {} 2026-02-12T18:08:20.877 INFO:tasks.workunit.client.0.trial060.stdout:osd.8: {} 2026-02-12T18:08:20.894 INFO:tasks.workunit.client.0.trial060.stdout:osd.9: {} 2026-02-12T18:08:20.902 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd set noout 2026-02-12T18:08:22.441 INFO:tasks.workunit.client.0.trial060.stderr:noout is set 2026-02-12T18:08:22.452 INFO:tasks.workunit.client.0.trial060.stderr:+ test_mark_two_osds_same_host_down 2026-02-12T18:08:22.452 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd set noup 2026-02-12T18:08:24.444 INFO:tasks.workunit.client.0.trial060.stderr:noup is set 2026-02-12T18:08:24.458 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd down osd.0 osd.1 2026-02-12T18:08:24.608 INFO:tasks.ceph.mon.a.trial060.stderr:2026-02-12T18:08:24.600+0000 7ff7b6f15640 -1 mon.a@0(leader).osd e26 definitely_dead 0 2026-02-12T18:08:25.497 INFO:tasks.ceph.mon.a.trial060.stderr:2026-02-12T18:08:25.488+0000 7ff7b6f15640 -1 mon.a@0(leader).osd e27 definitely_dead 0 2026-02-12T18:08:25.497 INFO:tasks.workunit.client.0.trial060.stderr:osd.0 is already down. osd.1 is already down. 2026-02-12T18:08:25.507 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health detail 2026-02-12T18:08:25.779 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-12T18:08:25.780 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-12T18:08:25.780 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-12T18:08:25.780 INFO:tasks.workunit.client.0.trial060.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-12T18:08:25.780 INFO:tasks.workunit.client.0.trial060.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-12T18:08:25.780 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-12T18:08:25.780 INFO:tasks.workunit.client.0.trial060.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-12T18:08:25.791 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:25.791 INFO:tasks.workunit.client.0.trial060.stderr:+ grep '1 host' 2026-02-12T18:08:26.032 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-12T18:08:26.032 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:26.033 INFO:tasks.workunit.client.0.trial060.stderr:+ grep '2 osds' 2026-02-12T18:08:26.268 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-12T18:08:26.268 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health detail 2026-02-12T18:08:26.269 INFO:tasks.workunit.client.0.trial060.stderr:+ grep osd.0 2026-02-12T18:08:26.500 INFO:tasks.ceph.osd.1.trial060.stderr:2026-02-12T18:08:26.492+0000 7f8ab9a91640 -1 osd.1 28 osdmap NOUP flag is set, waiting for it to clear 2026-02-12T18:08:26.535 INFO:tasks.workunit.client.0.trial060.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-12T18:08:26.536 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health detail 2026-02-12T18:08:26.536 INFO:tasks.workunit.client.0.trial060.stderr:+ grep osd.1 2026-02-12T18:08:26.801 INFO:tasks.workunit.client.0.trial060.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-12T18:08:26.801 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd unset noup 2026-02-12T18:08:27.454 INFO:tasks.ceph.osd.1.trial060.stderr:2026-02-12T18:08:27.448+0000 7f8ab4967640 -1 osd.1 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:28.457 INFO:tasks.workunit.client.0.trial060.stderr:noup is unset 2026-02-12T18:08:28.470 INFO:tasks.workunit.client.0.trial060.stderr:+ wait_for_healthy 2026-02-12T18:08:28.470 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:28.470 INFO:tasks.workunit.client.0.trial060.stderr:+ grep down 2026-02-12T18:08:28.707 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noout flag(s) set; 1 osds down; Degraded data redundancy: 1/4 objects degraded (25.000%), 1 pg degraded 2026-02-12T18:08:28.708 INFO:tasks.workunit.client.0.trial060.stderr:+ sleep 1 2026-02-12T18:08:29.467 INFO:tasks.ceph.osd.0.trial060.stderr:2026-02-12T18:08:29.460+0000 7f6dea96c640 -1 osd.0 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:29.709 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:29.709 INFO:tasks.workunit.client.0.trial060.stderr:+ grep down 2026-02-12T18:08:29.956 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noout flag(s) set; 1 osds down; Degraded data redundancy: 1/4 objects degraded (25.000%), 1 pg degraded 2026-02-12T18:08:29.957 INFO:tasks.workunit.client.0.trial060.stderr:+ sleep 1 2026-02-12T18:08:30.958 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:30.959 INFO:tasks.workunit.client.0.trial060.stderr:+ grep down 2026-02-12T18:08:31.199 INFO:tasks.workunit.client.0.trial060.stderr:+ test_mark_two_osds_same_rack_down 2026-02-12T18:08:31.199 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd set noup 2026-02-12T18:08:32.469 INFO:tasks.workunit.client.0.trial060.stderr:noup is set 2026-02-12T18:08:32.481 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd down osd.8 osd.9 2026-02-12T18:08:32.635 INFO:tasks.ceph.mon.a.trial060.stderr:2026-02-12T18:08:32.628+0000 7ff7b6f15640 -1 mon.a@0(leader).osd e34 definitely_dead 0 2026-02-12T18:08:33.520 INFO:tasks.ceph.mon.a.trial060.stderr:2026-02-12T18:08:33.512+0000 7ff7b6f15640 -1 mon.a@0(leader).osd e35 definitely_dead 0 2026-02-12T18:08:33.521 INFO:tasks.workunit.client.0.trial060.stderr:osd.8 is already down. osd.9 is already down. 2026-02-12T18:08:33.531 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health detail 2026-02-12T18:08:33.801 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down; Degraded data redundancy: 1/4 objects degraded (25.000%), 1 pg degraded 2026-02-12T18:08:33.801 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-12T18:08:33.801 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-12T18:08:33.801 INFO:tasks.workunit.client.0.trial060.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-12T18:08:33.801 INFO:tasks.workunit.client.0.trial060.stdout: osd.9 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-12T18:08:33.801 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-12T18:08:33.801 INFO:tasks.workunit.client.0.trial060.stdout: host host4 (root=root,row=row1,rack=rack2) (2 osds) is down 2026-02-12T18:08:33.801 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSD_RACK_DOWN: 1 rack (2 osds) down 2026-02-12T18:08:33.801 INFO:tasks.workunit.client.0.trial060.stdout: rack rack2 (root=root,row=row1) (2 osds) is down 2026-02-12T18:08:33.801 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSD_ROW_DOWN: 1 row (2 osds) down 2026-02-12T18:08:33.801 INFO:tasks.workunit.client.0.trial060.stdout: row row1 (root=root) (2 osds) is down 2026-02-12T18:08:33.801 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 1/4 objects degraded (25.000%), 1 pg degraded 2026-02-12T18:08:33.801 INFO:tasks.workunit.client.0.trial060.stdout: pg 1.3 is active+undersized+degraded, acting [3] 2026-02-12T18:08:33.813 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:33.813 INFO:tasks.workunit.client.0.trial060.stderr:+ grep '1 host' 2026-02-12T18:08:34.055 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down; Degraded data redundancy: 1/4 objects degraded (25.000%), 1 pg degraded 2026-02-12T18:08:34.056 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:34.056 INFO:tasks.workunit.client.0.trial060.stderr:+ grep '1 rack' 2026-02-12T18:08:34.145 INFO:tasks.ceph.osd.8.trial060.stderr:2026-02-12T18:08:34.136+0000 7f5f7e2f8640 -1 osd.8 35 osdmap NOUP flag is set, waiting for it to clear 2026-02-12T18:08:34.302 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down; Degraded data redundancy: 1/4 objects degraded (25.000%), 1 pg degraded 2026-02-12T18:08:34.302 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:34.303 INFO:tasks.workunit.client.0.trial060.stderr:+ grep '1 row' 2026-02-12T18:08:34.475 INFO:tasks.ceph.osd.8.trial060.stderr:2026-02-12T18:08:34.468+0000 7f5f6ce7c640 -1 osd.8 36 osdmap NOUP flag is set, waiting for it to clear 2026-02-12T18:08:34.548 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-12T18:08:34.548 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:34.549 INFO:tasks.workunit.client.0.trial060.stderr:+ grep '2 osds' 2026-02-12T18:08:34.787 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down 2026-02-12T18:08:34.788 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health detail 2026-02-12T18:08:34.788 INFO:tasks.workunit.client.0.trial060.stderr:+ grep osd.8 2026-02-12T18:08:35.063 INFO:tasks.workunit.client.0.trial060.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-12T18:08:35.063 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health detail 2026-02-12T18:08:35.063 INFO:tasks.workunit.client.0.trial060.stderr:+ grep osd.9 2026-02-12T18:08:35.334 INFO:tasks.workunit.client.0.trial060.stdout: osd.9 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-12T18:08:35.334 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd unset noup 2026-02-12T18:08:36.478 INFO:tasks.ceph.osd.8.trial060.stderr:2026-02-12T18:08:36.472+0000 7f5f751c6640 -1 osd.8 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:37.477 INFO:tasks.workunit.client.0.trial060.stderr:noup is unset 2026-02-12T18:08:37.491 INFO:tasks.workunit.client.0.trial060.stderr:+ wait_for_healthy 2026-02-12T18:08:37.491 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:37.491 INFO:tasks.workunit.client.0.trial060.stderr:+ grep down 2026-02-12T18:08:37.727 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2026-02-12T18:08:37.727 INFO:tasks.workunit.client.0.trial060.stderr:+ sleep 1 2026-02-12T18:08:38.729 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:38.729 INFO:tasks.workunit.client.0.trial060.stderr:+ grep down 2026-02-12T18:08:38.969 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2026-02-12T18:08:38.969 INFO:tasks.workunit.client.0.trial060.stderr:+ sleep 1 2026-02-12T18:08:39.650 INFO:tasks.ceph.osd.9.trial060.stderr:2026-02-12T18:08:39.648+0000 7f639946e640 -1 osd.9 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:39.971 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:39.971 INFO:tasks.workunit.client.0.trial060.stderr:+ grep down 2026-02-12T18:08:40.218 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2026-02-12T18:08:40.218 INFO:tasks.workunit.client.0.trial060.stderr:+ sleep 1 2026-02-12T18:08:41.220 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:41.220 INFO:tasks.workunit.client.0.trial060.stderr:+ grep down 2026-02-12T18:08:41.468 INFO:tasks.workunit.client.0.trial060.stderr:+ test_mark_all_but_last_osds_down 2026-02-12T18:08:41.468 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd set noup 2026-02-12T18:08:43.493 INFO:tasks.workunit.client.0.trial060.stderr:noup is set 2026-02-12T18:08:43.508 INFO:tasks.workunit.client.0.trial060.stderr:++ ceph osd ls 2026-02-12T18:08:43.508 INFO:tasks.workunit.client.0.trial060.stderr:++ sed '$d' 2026-02-12T18:08:43.720 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd down 0 1 2 3 4 5 6 7 8 2026-02-12T18:08:43.877 INFO:tasks.ceph.mon.a.trial060.stderr:2026-02-12T18:08:43.872+0000 7ff7b6f15640 -1 mon.a@0(leader).osd e43 definitely_dead 0 2026-02-12T18:08:44.549 INFO:tasks.ceph.mon.a.trial060.stderr:2026-02-12T18:08:44.544+0000 7ff7b6f15640 -1 mon.a@0(leader).osd e44 definitely_dead 0 2026-02-12T18:08:44.550 INFO:tasks.workunit.client.0.trial060.stderr:osd.0 is already down. osd.1 is already down. osd.2 is already down. osd.3 is already down. osd.4 is already down. osd.5 is already down. osd.6 is already down. osd.7 is already down. osd.8 is already down. 2026-02-12T18:08:44.559 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health detail 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSD_DOWN: 9 osds down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: osd.2 (root=root,row=row0,rack=rack0,host=host1) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: osd.3 (root=root,row=row0,rack=rack0,host=host1) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: osd.4 (root=root,row=row0,rack=rack1,host=host2) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: osd.5 (root=root,row=row0,rack=rack1,host=host2) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: osd.6 (root=root,row=row0,rack=rack1,host=host3) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: osd.7 (root=root,row=row0,rack=rack1,host=host3) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSD_HOST_DOWN: 4 hosts (8 osds) down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: host host1 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: host host2 (root=root,row=row0,rack=rack1) (2 osds) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: host host3 (root=root,row=row0,rack=rack1) (2 osds) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSD_RACK_DOWN: 2 racks (8 osds) down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: rack rack0 (root=root,row=row0) (4 osds) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: rack rack1 (root=root,row=row0) (4 osds) is down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSD_ROW_DOWN: 1 row (8 osds) down 2026-02-12T18:08:44.824 INFO:tasks.workunit.client.0.trial060.stdout: row row0 (root=root) (8 osds) is down 2026-02-12T18:08:44.835 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:44.835 INFO:tasks.workunit.client.0.trial060.stderr:+ grep '1 row' 2026-02-12T18:08:45.097 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-12T18:08:45.098 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:45.098 INFO:tasks.workunit.client.0.trial060.stderr:+ grep '2 racks' 2026-02-12T18:08:45.341 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-12T18:08:45.342 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:45.342 INFO:tasks.workunit.client.0.trial060.stderr:+ grep '4 hosts' 2026-02-12T18:08:45.401 INFO:tasks.ceph.osd.0.trial060.stderr:2026-02-12T18:08:45.396+0000 7f6def295640 -1 osd.0 44 osdmap NOUP flag is set, waiting for it to clear 2026-02-12T18:08:45.501 INFO:tasks.ceph.osd.0.trial060.stderr:2026-02-12T18:08:45.496+0000 7f6de2622640 -1 osd.0 45 osdmap NOUP flag is set, waiting for it to clear 2026-02-12T18:08:45.580 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-12T18:08:45.581 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:45.581 INFO:tasks.workunit.client.0.trial060.stderr:+ grep '9 osds' 2026-02-12T18:08:45.627 INFO:tasks.ceph.osd.7.trial060.stderr:2026-02-12T18:08:45.624+0000 7fa11d2c8640 -1 osd.7 45 osdmap NOUP flag is set, waiting for it to clear 2026-02-12T18:08:45.769 INFO:tasks.ceph.osd.1.trial060.stderr:2026-02-12T18:08:45.764+0000 7f8ab9290640 -1 osd.1 45 osdmap NOUP flag is set, waiting for it to clear 2026-02-12T18:08:45.820 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-12T18:08:45.820 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd unset noup 2026-02-12T18:08:45.936 INFO:tasks.ceph.osd.2.trial060.stderr:2026-02-12T18:08:45.932+0000 7fbde7560640 -1 osd.2 45 osdmap NOUP flag is set, waiting for it to clear 2026-02-12T18:08:46.056 INFO:tasks.ceph.osd.4.trial060.stderr:2026-02-12T18:08:46.052+0000 7fccf49d4640 -1 osd.4 45 osdmap NOUP flag is set, waiting for it to clear 2026-02-12T18:08:46.216 INFO:tasks.ceph.osd.5.trial060.stderr:2026-02-12T18:08:46.212+0000 7f9a9d76d640 -1 osd.5 45 osdmap NOUP flag is set, waiting for it to clear 2026-02-12T18:08:46.505 INFO:tasks.ceph.osd.2.trial060.stderr:2026-02-12T18:08:46.500+0000 7fbdde42e640 -1 osd.2 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:46.505 INFO:tasks.ceph.osd.0.trial060.stderr:2026-02-12T18:08:46.500+0000 7f6dea96c640 -1 osd.0 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:46.505 INFO:tasks.ceph.osd.1.trial060.stderr:2026-02-12T18:08:46.500+0000 7f8ab4967640 -1 osd.1 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:46.506 INFO:tasks.ceph.osd.4.trial060.stderr:2026-02-12T18:08:46.500+0000 7fcceb8a2640 -1 osd.4 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:46.506 INFO:tasks.ceph.osd.5.trial060.stderr:2026-02-12T18:08:46.500+0000 7f9a9463b640 -1 osd.5 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:46.506 INFO:tasks.ceph.osd.7.trial060.stderr:2026-02-12T18:08:46.500+0000 7fa114196640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:47.025 INFO:tasks.ceph.osd.6.trial060.stderr:2026-02-12T18:08:47.020+0000 7fc0ca36b640 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:47.050 INFO:tasks.ceph.osd.8.trial060.stderr:2026-02-12T18:08:47.044+0000 7f5f751c6640 -1 osd.8 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:47.503 INFO:tasks.workunit.client.0.trial060.stderr:noup is unset 2026-02-12T18:08:47.519 INFO:tasks.workunit.client.0.trial060.stderr:+ wait_for_healthy 2026-02-12T18:08:47.519 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:47.519 INFO:tasks.workunit.client.0.trial060.stderr:+ grep down 2026-02-12T18:08:47.758 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noout flag(s) set; 1 osds down 2026-02-12T18:08:47.759 INFO:tasks.workunit.client.0.trial060.stderr:+ sleep 1 2026-02-12T18:08:48.475 INFO:tasks.ceph.osd.3.trial060.stderr:2026-02-12T18:08:48.471+0000 7fb725446640 -1 osd.3 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:48.760 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:48.760 INFO:tasks.workunit.client.0.trial060.stderr:+ grep down 2026-02-12T18:08:49.003 INFO:tasks.workunit.client.0.trial060.stderr:+ test_mark_two_osds_same_host_down_with_classes 2026-02-12T18:08:49.004 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd set noup 2026-02-12T18:08:50.513 INFO:tasks.workunit.client.0.trial060.stderr:noup is set 2026-02-12T18:08:50.527 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd crush set-device-class ssd osd.0 osd.2 osd.4 osd.6 osd.8 2026-02-12T18:08:52.519 INFO:tasks.workunit.client.0.trial060.stderr:osd.0 already set to class ssd. set-device-class item id 0 name 'osd.0' device_class 'ssd': no change. osd.2 already set to class ssd. set-device-class item id 2 name 'osd.2' device_class 'ssd': no change. osd.4 already set to class ssd. set-device-class item id 4 name 'osd.4' device_class 'ssd': no change. osd.6 already set to class ssd. set-device-class item id 6 name 'osd.6' device_class 'ssd': no change. osd.8 already set to class ssd. set-device-class item id 8 name 'osd.8' device_class 'ssd': no change. set osd(s) to class 'ssd' 2026-02-12T18:08:52.533 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd crush set-device-class hdd osd.1 osd.3 osd.5 osd.7 osd.9 2026-02-12T18:08:54.524 INFO:tasks.workunit.client.0.trial060.stderr:osd.1 already set to class hdd. set-device-class item id 1 name 'osd.1' device_class 'hdd': no change. osd.3 already set to class hdd. set-device-class item id 3 name 'osd.3' device_class 'hdd': no change. osd.5 already set to class hdd. set-device-class item id 5 name 'osd.5' device_class 'hdd': no change. osd.7 already set to class hdd. set-device-class item id 7 name 'osd.7' device_class 'hdd': no change. osd.9 already set to class hdd. set-device-class item id 9 name 'osd.9' device_class 'hdd': no change. set osd(s) to class 'hdd' 2026-02-12T18:08:54.537 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd down osd.0 osd.1 2026-02-12T18:08:54.687 INFO:tasks.ceph.mon.a.trial060.stderr:2026-02-12T18:08:54.683+0000 7ff7b6f15640 -1 mon.a@0(leader).osd e54 definitely_dead 0 2026-02-12T18:08:55.576 INFO:tasks.ceph.mon.a.trial060.stderr:2026-02-12T18:08:55.571+0000 7ff7b6f15640 -1 mon.a@0(leader).osd e55 definitely_dead 0 2026-02-12T18:08:55.576 INFO:tasks.workunit.client.0.trial060.stderr:osd.0 is already down. osd.1 is already down. 2026-02-12T18:08:55.586 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health detail 2026-02-12T18:08:55.854 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-12T18:08:55.854 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-12T18:08:55.854 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-12T18:08:55.854 INFO:tasks.workunit.client.0.trial060.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-12T18:08:55.855 INFO:tasks.workunit.client.0.trial060.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-12T18:08:55.855 INFO:tasks.workunit.client.0.trial060.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-12T18:08:55.855 INFO:tasks.workunit.client.0.trial060.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-12T18:08:55.864 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:55.864 INFO:tasks.workunit.client.0.trial060.stderr:+ grep '1 host' 2026-02-12T18:08:56.115 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-12T18:08:56.116 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:56.116 INFO:tasks.workunit.client.0.trial060.stderr:+ grep '2 osds' 2026-02-12T18:08:56.360 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-12T18:08:56.360 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health detail 2026-02-12T18:08:56.360 INFO:tasks.workunit.client.0.trial060.stderr:+ grep osd.0 2026-02-12T18:08:56.635 INFO:tasks.workunit.client.0.trial060.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-12T18:08:56.636 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health detail 2026-02-12T18:08:56.636 INFO:tasks.workunit.client.0.trial060.stderr:+ grep osd.1 2026-02-12T18:08:56.827 INFO:tasks.ceph.osd.1.trial060.stderr:2026-02-12T18:08:56.823+0000 7f8ab9a91640 -1 osd.1 56 osdmap NOUP flag is set, waiting for it to clear 2026-02-12T18:08:56.920 INFO:tasks.workunit.client.0.trial060.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-12T18:08:56.920 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph osd unset noup 2026-02-12T18:08:57.534 INFO:tasks.ceph.osd.1.trial060.stderr:2026-02-12T18:08:57.527+0000 7f8ab4967640 -1 osd.1 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:08:58.537 INFO:tasks.workunit.client.0.trial060.stderr:noup is unset 2026-02-12T18:08:58.550 INFO:tasks.workunit.client.0.trial060.stderr:+ wait_for_healthy 2026-02-12T18:08:58.550 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:58.550 INFO:tasks.workunit.client.0.trial060.stderr:+ grep down 2026-02-12T18:08:58.789 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noout flag(s) set; 1 osds down; Degraded data redundancy: 1/4 objects degraded (25.000%), 1 pg degraded 2026-02-12T18:08:58.789 INFO:tasks.workunit.client.0.trial060.stderr:+ sleep 1 2026-02-12T18:08:59.790 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:08:59.791 INFO:tasks.workunit.client.0.trial060.stderr:+ grep down 2026-02-12T18:09:00.035 INFO:tasks.workunit.client.0.trial060.stdout:HEALTH_WARN noout flag(s) set; 1 osds down; Degraded data redundancy: 1/4 objects degraded (25.000%), 1 pg degraded 2026-02-12T18:09:00.036 INFO:tasks.workunit.client.0.trial060.stderr:+ sleep 1 2026-02-12T18:09:00.338 INFO:tasks.ceph.osd.0.trial060.stderr:2026-02-12T18:09:00.331+0000 7f6dea96c640 -1 osd.0 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:09:01.037 INFO:tasks.workunit.client.0.trial060.stderr:+ ceph health 2026-02-12T18:09:01.037 INFO:tasks.workunit.client.0.trial060.stderr:+ grep down 2026-02-12T18:09:01.279 INFO:tasks.workunit.client.0.trial060.stderr:+ exit 0 2026-02-12T18:09:01.279 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-12T18:09:01.280 DEBUG:teuthology.orchestra.run.trial060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-12T18:09:01.335 INFO:tasks.workunit:Stopping ['rados/test_health_warnings.sh'] on client.0... 2026-02-12T18:09:01.335 DEBUG:teuthology.orchestra.run.trial060:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-12T18:09:01.694 DEBUG:teuthology.parallel:result is None 2026-02-12T18:09:01.694 DEBUG:teuthology.orchestra.run.trial060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T18:09:01.702 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T18:09:01.702 DEBUG:teuthology.orchestra.run.trial060:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-12T18:09:01.750 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T18:09:01.750 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-12T18:09:01.824 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T18:09:01.825 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:09:01.976 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:01.977 INFO:teuthology.orchestra.run.trial060.stderr:dumped all 2026-02-12T18:09:01.987 INFO:teuthology.orchestra.run.trial060.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2026-02-12T18:09:01.666413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276160,"kb_used_data":6560,"kb_used_omap":278,"kb_used_meta":269161,"kb_avail":1048299840,"statfs":{"total":1073741824000,"available":1073459036160,"internally_reserved":0,"allocated":6717440,"data_stored":3222775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":285228,"internal_metadata":275621332},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000550"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":72,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-12T18:08:56.529107+0000","last_change":"2026-02-12T18:08:49.902326+0000","last_active":"2026-02-12T18:08:56.529107+0000","last_peered":"2026-02-12T18:08:56.529107+0000","last_clean":"2026-02-12T18:08:56.529107+0000","last_became_active":"2026-02-12T18:08:49.902123+0000","last_became_peered":"2026-02-12T18:08:49.902123+0000","last_unstale":"2026-02-12T18:08:56.529107+0000","last_undegraded":"2026-02-12T18:08:56.529107+0000","last_fullsized":"2026-02-12T18:08:56.529107+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:03:04.261206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027722199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713377+0000","last_change":"2026-02-12T18:08:48.510355+0000","last_active":"2026-02-12T18:08:59.713377+0000","last_peered":"2026-02-12T18:08:59.713377+0000","last_clean":"2026-02-12T18:08:59.713377+0000","last_became_active":"2026-02-12T18:08:48.509978+0000","last_became_peered":"2026-02-12T18:08:48.509978+0000","last_unstale":"2026-02-12T18:08:59.713377+0000","last_undegraded":"2026-02-12T18:08:59.713377+0000","last_fullsized":"2026-02-12T18:08:59.713377+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:15:49.558001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030204800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"peering","last_fresh":"2026-02-12T18:08:59.806139+0000","last_change":"2026-02-12T18:09:00.678209+0000","last_active":"2026-02-12T18:09:00.678209+0000","last_peered":"2026-02-12T18:08:59.806139+0000","last_clean":"2026-02-12T18:08:55.527069+0000","last_became_active":"2026-02-12T18:08:56.530596+0000","last_became_peered":"2026-02-12T18:08:56.530596+0000","last_unstale":"2026-02-12T18:08:59.806139+0000","last_undegraded":"2026-02-12T18:08:59.806139+0000","last_fullsized":"2026-02-12T18:08:56.530387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.714143+0000","last_change":"2026-02-12T18:08:59.714071+0000","last_active":"2026-02-12T18:08:59.714143+0000","last_peered":"2026-02-12T18:08:59.714143+0000","last_clean":"2026-02-12T18:08:59.714143+0000","last_became_active":"2026-02-12T18:08:59.713880+0000","last_became_peered":"2026-02-12T18:08:59.713880+0000","last_unstale":"2026-02-12T18:08:59.714143+0000","last_undegraded":"2026-02-12T18:08:59.714143+0000","last_fullsized":"2026-02-12T18:08:59.714143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:25:12.322281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":88,"reported_epoch":56,"state":"active+undersized+degraded","last_fresh":"2026-02-12T18:08:56.529573+0000","last_change":"2026-02-12T18:08:56.529454+0000","last_active":"2026-02-12T18:08:56.529573+0000","last_peered":"2026-02-12T18:08:56.529573+0000","last_clean":"2026-02-12T18:08:55.575083+0000","last_became_active":"2026-02-12T18:08:56.529454+0000","last_became_peered":"2026-02-12T18:08:56.529454+0000","last_unstale":"2026-02-12T18:08:56.529573+0000","last_undegraded":"2026-02-12T18:08:56.529206+0000","last_fullsized":"2026-02-12T18:08:56.529141+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:11.098464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541719+0000","last_change":"2026-02-12T18:08:59.541099+0000","last_active":"2026-02-12T18:09:00.541719+0000","last_peered":"2026-02-12T18:09:00.541719+0000","last_clean":"2026-02-12T18:09:00.541719+0000","last_became_active":"2026-02-12T18:08:59.540942+0000","last_became_peered":"2026-02-12T18:08:59.540942+0000","last_unstale":"2026-02-12T18:09:00.541719+0000","last_undegraded":"2026-02-12T18:09:00.541719+0000","last_fullsized":"2026-02-12T18:09:00.541719+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:45.164694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057906899999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541763+0000","last_change":"2026-02-12T18:08:49.511896+0000","last_active":"2026-02-12T18:09:00.541763+0000","last_peered":"2026-02-12T18:09:00.541763+0000","last_clean":"2026-02-12T18:09:00.541763+0000","last_became_active":"2026-02-12T18:08:49.511747+0000","last_became_peered":"2026-02-12T18:08:49.511747+0000","last_unstale":"2026-02-12T18:09:00.541763+0000","last_undegraded":"2026-02-12T18:09:00.541763+0000","last_fullsized":"2026-02-12T18:09:00.541763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:09:54.305249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028142899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713277+0000","last_change":"2026-02-12T18:08:48.509928+0000","last_active":"2026-02-12T18:08:59.713277+0000","last_peered":"2026-02-12T18:08:59.713277+0000","last_clean":"2026-02-12T18:08:59.713277+0000","last_became_active":"2026-02-12T18:08:48.509745+0000","last_became_peered":"2026-02-12T18:08:48.509745+0000","last_unstale":"2026-02-12T18:08:59.713277+0000","last_undegraded":"2026-02-12T18:08:59.713277+0000","last_fullsized":"2026-02-12T18:08:59.713277+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:54:40.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":40,"seq":171798691858,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27096,"internal_metadata":27563560},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30341,"internal_metadata":27560315},"hb_peers":[2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28392,"internal_metadata":27562264},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31648,"internal_metadata":27559008},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":47,"seq":201863462929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":48,"seq":206158430225,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":294299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25786,"internal_metadata":27564870},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":58,"seq":249108103186,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":60,"seq":257698037778,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26440,"internal_metadata":27564216},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:09:01.989 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:09:02.142 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:02.142 INFO:teuthology.orchestra.run.trial060.stderr:dumped all 2026-02-12T18:09:02.153 INFO:teuthology.orchestra.run.trial060.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2026-02-12T18:09:01.666413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276160,"kb_used_data":6560,"kb_used_omap":278,"kb_used_meta":269161,"kb_avail":1048299840,"statfs":{"total":1073741824000,"available":1073459036160,"internally_reserved":0,"allocated":6717440,"data_stored":3222775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":285228,"internal_metadata":275621332},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000550"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":72,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-12T18:08:56.529107+0000","last_change":"2026-02-12T18:08:49.902326+0000","last_active":"2026-02-12T18:08:56.529107+0000","last_peered":"2026-02-12T18:08:56.529107+0000","last_clean":"2026-02-12T18:08:56.529107+0000","last_became_active":"2026-02-12T18:08:49.902123+0000","last_became_peered":"2026-02-12T18:08:49.902123+0000","last_unstale":"2026-02-12T18:08:56.529107+0000","last_undegraded":"2026-02-12T18:08:56.529107+0000","last_fullsized":"2026-02-12T18:08:56.529107+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:03:04.261206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027722199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713377+0000","last_change":"2026-02-12T18:08:48.510355+0000","last_active":"2026-02-12T18:08:59.713377+0000","last_peered":"2026-02-12T18:08:59.713377+0000","last_clean":"2026-02-12T18:08:59.713377+0000","last_became_active":"2026-02-12T18:08:48.509978+0000","last_became_peered":"2026-02-12T18:08:48.509978+0000","last_unstale":"2026-02-12T18:08:59.713377+0000","last_undegraded":"2026-02-12T18:08:59.713377+0000","last_fullsized":"2026-02-12T18:08:59.713377+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:15:49.558001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030204800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"peering","last_fresh":"2026-02-12T18:08:59.806139+0000","last_change":"2026-02-12T18:09:00.678209+0000","last_active":"2026-02-12T18:09:00.678209+0000","last_peered":"2026-02-12T18:08:59.806139+0000","last_clean":"2026-02-12T18:08:55.527069+0000","last_became_active":"2026-02-12T18:08:56.530596+0000","last_became_peered":"2026-02-12T18:08:56.530596+0000","last_unstale":"2026-02-12T18:08:59.806139+0000","last_undegraded":"2026-02-12T18:08:59.806139+0000","last_fullsized":"2026-02-12T18:08:56.530387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.714143+0000","last_change":"2026-02-12T18:08:59.714071+0000","last_active":"2026-02-12T18:08:59.714143+0000","last_peered":"2026-02-12T18:08:59.714143+0000","last_clean":"2026-02-12T18:08:59.714143+0000","last_became_active":"2026-02-12T18:08:59.713880+0000","last_became_peered":"2026-02-12T18:08:59.713880+0000","last_unstale":"2026-02-12T18:08:59.714143+0000","last_undegraded":"2026-02-12T18:08:59.714143+0000","last_fullsized":"2026-02-12T18:08:59.714143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:25:12.322281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":88,"reported_epoch":56,"state":"active+undersized+degraded","last_fresh":"2026-02-12T18:08:56.529573+0000","last_change":"2026-02-12T18:08:56.529454+0000","last_active":"2026-02-12T18:08:56.529573+0000","last_peered":"2026-02-12T18:08:56.529573+0000","last_clean":"2026-02-12T18:08:55.575083+0000","last_became_active":"2026-02-12T18:08:56.529454+0000","last_became_peered":"2026-02-12T18:08:56.529454+0000","last_unstale":"2026-02-12T18:08:56.529573+0000","last_undegraded":"2026-02-12T18:08:56.529206+0000","last_fullsized":"2026-02-12T18:08:56.529141+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:11.098464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541719+0000","last_change":"2026-02-12T18:08:59.541099+0000","last_active":"2026-02-12T18:09:00.541719+0000","last_peered":"2026-02-12T18:09:00.541719+0000","last_clean":"2026-02-12T18:09:00.541719+0000","last_became_active":"2026-02-12T18:08:59.540942+0000","last_became_peered":"2026-02-12T18:08:59.540942+0000","last_unstale":"2026-02-12T18:09:00.541719+0000","last_undegraded":"2026-02-12T18:09:00.541719+0000","last_fullsized":"2026-02-12T18:09:00.541719+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:45.164694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057906899999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541763+0000","last_change":"2026-02-12T18:08:49.511896+0000","last_active":"2026-02-12T18:09:00.541763+0000","last_peered":"2026-02-12T18:09:00.541763+0000","last_clean":"2026-02-12T18:09:00.541763+0000","last_became_active":"2026-02-12T18:08:49.511747+0000","last_became_peered":"2026-02-12T18:08:49.511747+0000","last_unstale":"2026-02-12T18:09:00.541763+0000","last_undegraded":"2026-02-12T18:09:00.541763+0000","last_fullsized":"2026-02-12T18:09:00.541763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:09:54.305249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028142899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713277+0000","last_change":"2026-02-12T18:08:48.509928+0000","last_active":"2026-02-12T18:08:59.713277+0000","last_peered":"2026-02-12T18:08:59.713277+0000","last_clean":"2026-02-12T18:08:59.713277+0000","last_became_active":"2026-02-12T18:08:48.509745+0000","last_became_peered":"2026-02-12T18:08:48.509745+0000","last_unstale":"2026-02-12T18:08:59.713277+0000","last_undegraded":"2026-02-12T18:08:59.713277+0000","last_fullsized":"2026-02-12T18:08:59.713277+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:54:40.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":40,"seq":171798691858,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27096,"internal_metadata":27563560},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30341,"internal_metadata":27560315},"hb_peers":[2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28392,"internal_metadata":27562264},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31648,"internal_metadata":27559008},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":47,"seq":201863462929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":48,"seq":206158430225,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":294299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25786,"internal_metadata":27564870},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":58,"seq":249108103186,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":60,"seq":257698037778,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26440,"internal_metadata":27564216},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:09:02.154 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:09:02.310 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:02.310 INFO:teuthology.orchestra.run.trial060.stderr:dumped all 2026-02-12T18:09:02.322 INFO:teuthology.orchestra.run.trial060.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2026-02-12T18:09:01.666413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276160,"kb_used_data":6560,"kb_used_omap":278,"kb_used_meta":269161,"kb_avail":1048299840,"statfs":{"total":1073741824000,"available":1073459036160,"internally_reserved":0,"allocated":6717440,"data_stored":3222775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":285228,"internal_metadata":275621332},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000550"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":72,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-12T18:08:56.529107+0000","last_change":"2026-02-12T18:08:49.902326+0000","last_active":"2026-02-12T18:08:56.529107+0000","last_peered":"2026-02-12T18:08:56.529107+0000","last_clean":"2026-02-12T18:08:56.529107+0000","last_became_active":"2026-02-12T18:08:49.902123+0000","last_became_peered":"2026-02-12T18:08:49.902123+0000","last_unstale":"2026-02-12T18:08:56.529107+0000","last_undegraded":"2026-02-12T18:08:56.529107+0000","last_fullsized":"2026-02-12T18:08:56.529107+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:03:04.261206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027722199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713377+0000","last_change":"2026-02-12T18:08:48.510355+0000","last_active":"2026-02-12T18:08:59.713377+0000","last_peered":"2026-02-12T18:08:59.713377+0000","last_clean":"2026-02-12T18:08:59.713377+0000","last_became_active":"2026-02-12T18:08:48.509978+0000","last_became_peered":"2026-02-12T18:08:48.509978+0000","last_unstale":"2026-02-12T18:08:59.713377+0000","last_undegraded":"2026-02-12T18:08:59.713377+0000","last_fullsized":"2026-02-12T18:08:59.713377+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:15:49.558001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030204800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"peering","last_fresh":"2026-02-12T18:08:59.806139+0000","last_change":"2026-02-12T18:09:00.678209+0000","last_active":"2026-02-12T18:09:00.678209+0000","last_peered":"2026-02-12T18:08:59.806139+0000","last_clean":"2026-02-12T18:08:55.527069+0000","last_became_active":"2026-02-12T18:08:56.530596+0000","last_became_peered":"2026-02-12T18:08:56.530596+0000","last_unstale":"2026-02-12T18:08:59.806139+0000","last_undegraded":"2026-02-12T18:08:59.806139+0000","last_fullsized":"2026-02-12T18:08:56.530387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.714143+0000","last_change":"2026-02-12T18:08:59.714071+0000","last_active":"2026-02-12T18:08:59.714143+0000","last_peered":"2026-02-12T18:08:59.714143+0000","last_clean":"2026-02-12T18:08:59.714143+0000","last_became_active":"2026-02-12T18:08:59.713880+0000","last_became_peered":"2026-02-12T18:08:59.713880+0000","last_unstale":"2026-02-12T18:08:59.714143+0000","last_undegraded":"2026-02-12T18:08:59.714143+0000","last_fullsized":"2026-02-12T18:08:59.714143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:25:12.322281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":88,"reported_epoch":56,"state":"active+undersized+degraded","last_fresh":"2026-02-12T18:08:56.529573+0000","last_change":"2026-02-12T18:08:56.529454+0000","last_active":"2026-02-12T18:08:56.529573+0000","last_peered":"2026-02-12T18:08:56.529573+0000","last_clean":"2026-02-12T18:08:55.575083+0000","last_became_active":"2026-02-12T18:08:56.529454+0000","last_became_peered":"2026-02-12T18:08:56.529454+0000","last_unstale":"2026-02-12T18:08:56.529573+0000","last_undegraded":"2026-02-12T18:08:56.529206+0000","last_fullsized":"2026-02-12T18:08:56.529141+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:11.098464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541719+0000","last_change":"2026-02-12T18:08:59.541099+0000","last_active":"2026-02-12T18:09:00.541719+0000","last_peered":"2026-02-12T18:09:00.541719+0000","last_clean":"2026-02-12T18:09:00.541719+0000","last_became_active":"2026-02-12T18:08:59.540942+0000","last_became_peered":"2026-02-12T18:08:59.540942+0000","last_unstale":"2026-02-12T18:09:00.541719+0000","last_undegraded":"2026-02-12T18:09:00.541719+0000","last_fullsized":"2026-02-12T18:09:00.541719+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:45.164694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057906899999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541763+0000","last_change":"2026-02-12T18:08:49.511896+0000","last_active":"2026-02-12T18:09:00.541763+0000","last_peered":"2026-02-12T18:09:00.541763+0000","last_clean":"2026-02-12T18:09:00.541763+0000","last_became_active":"2026-02-12T18:08:49.511747+0000","last_became_peered":"2026-02-12T18:08:49.511747+0000","last_unstale":"2026-02-12T18:09:00.541763+0000","last_undegraded":"2026-02-12T18:09:00.541763+0000","last_fullsized":"2026-02-12T18:09:00.541763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:09:54.305249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028142899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713277+0000","last_change":"2026-02-12T18:08:48.509928+0000","last_active":"2026-02-12T18:08:59.713277+0000","last_peered":"2026-02-12T18:08:59.713277+0000","last_clean":"2026-02-12T18:08:59.713277+0000","last_became_active":"2026-02-12T18:08:48.509745+0000","last_became_peered":"2026-02-12T18:08:48.509745+0000","last_unstale":"2026-02-12T18:08:59.713277+0000","last_undegraded":"2026-02-12T18:08:59.713277+0000","last_fullsized":"2026-02-12T18:08:59.713277+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:54:40.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":40,"seq":171798691858,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27096,"internal_metadata":27563560},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30341,"internal_metadata":27560315},"hb_peers":[2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28392,"internal_metadata":27562264},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31648,"internal_metadata":27559008},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":47,"seq":201863462929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":48,"seq":206158430225,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":294299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25786,"internal_metadata":27564870},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":58,"seq":249108103186,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":60,"seq":257698037778,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26440,"internal_metadata":27564216},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:09:02.324 INFO:tasks.ceph.ceph_manager.ceph:PG 1.5 is not active+clean 2026-02-12T18:09:02.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.5', 'version': "0'0", 'reported_seq': 100, 'reported_epoch': 59, 'state': 'peering', 'last_fresh': '2026-02-12T18:08:59.806139+0000', 'last_change': '2026-02-12T18:09:00.678209+0000', 'last_active': '2026-02-12T18:09:00.678209+0000', 'last_peered': '2026-02-12T18:08:59.806139+0000', 'last_clean': '2026-02-12T18:08:55.527069+0000', 'last_became_active': '2026-02-12T18:08:56.530596+0000', 'last_became_peered': '2026-02-12T18:08:56.530596+0000', 'last_unstale': '2026-02-12T18:08:59.806139+0000', 'last_undegraded': '2026-02-12T18:08:59.806139+0000', 'last_fullsized': '2026-02-12T18:08:56.530387+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 48, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-12T18:07:50.669839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-12T18:07:50.669839+0000', 'last_clean_scrub_stamp': '2026-02-12T18:07:50.669839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.000304873, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 0], 'acting': [9, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2026-02-12T18:09:02.324 INFO:tasks.ceph.ceph_manager.ceph:PG 1.3 is not active+clean 2026-02-12T18:09:02.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.3', 'version': "17'1", 'reported_seq': 88, 'reported_epoch': 56, 'state': 'active+undersized+degraded', 'last_fresh': '2026-02-12T18:08:56.529573+0000', 'last_change': '2026-02-12T18:08:56.529454+0000', 'last_active': '2026-02-12T18:08:56.529573+0000', 'last_peered': '2026-02-12T18:08:56.529573+0000', 'last_clean': '2026-02-12T18:08:55.575083+0000', 'last_became_active': '2026-02-12T18:08:56.529454+0000', 'last_became_peered': '2026-02-12T18:08:56.529454+0000', 'last_unstale': '2026-02-12T18:08:56.529573+0000', 'last_undegraded': '2026-02-12T18:08:56.529206+0000', 'last_fullsized': '2026-02-12T18:08:56.529141+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 49, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-12T18:07:50.669839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-12T18:07:50.669839+0000', 'last_clean_scrub_stamp': '2026-02-12T18:07:50.669839+0000', 'objects_scrubbed': 0, 'log_size': 1, 'log_dups_size': 0, 'ondisk_log_size': 1, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-14T05:54:11.098464+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 2, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 1, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3], 'acting': [3], 'avail_no_missing': ['3'], 'object_location_counts': [{'shards': '3', 'objects': 1}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2026-02-12T18:09:02.325 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2026-02-12T18:09:02.513 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:02.513 INFO:teuthology.orchestra.run.trial060.stdout:{"fsid":"25fa2def-3287-4142-b1ac-e832bbd8bb26","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noout flag(s) set","count":5},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1/4 objects degraded (25.000%), 1 pg degraded","count":1},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":83,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":61,"num_osds":10,"num_up_osds":10,"osd_up_since":1770919740,"num_in_osds":10,"osd_in_since":1770919661,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":4},{"state_name":"peering","count":2},{"state_name":"active+undersized+degraded","count":1},{"state_name":"stale+active+clean","count":1}],"num_pgs":8,"num_pools":1,"num_objects":2,"data_bytes":19,"bytes_used":282148864,"bytes_avail":1073459675136,"bytes_total":1073741824000,"inactive_pgs_ratio":0.25,"degraded_objects":1,"degraded_total":4,"degraded_ratio":0.25},"fsmap":{"epoch":1,"btime":"2026-02-12T18:07:39:457388+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs"],"services":{}},"servicemap":{"epoch":3,"modified":"2026-02-12T18:08:47.664716+0000","services":{}},"progress_events":{}} 2026-02-12T18:09:02.526 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-12T18:09:02.526 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:09:02.694 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:02.695 INFO:teuthology.orchestra.run.trial060.stderr:dumped all 2026-02-12T18:09:02.706 INFO:teuthology.orchestra.run.trial060.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2026-02-12T18:09:01.666413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276160,"kb_used_data":6560,"kb_used_omap":278,"kb_used_meta":269161,"kb_avail":1048299840,"statfs":{"total":1073741824000,"available":1073459036160,"internally_reserved":0,"allocated":6717440,"data_stored":3222775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":285228,"internal_metadata":275621332},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000550"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":72,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-12T18:08:56.529107+0000","last_change":"2026-02-12T18:08:49.902326+0000","last_active":"2026-02-12T18:08:56.529107+0000","last_peered":"2026-02-12T18:08:56.529107+0000","last_clean":"2026-02-12T18:08:56.529107+0000","last_became_active":"2026-02-12T18:08:49.902123+0000","last_became_peered":"2026-02-12T18:08:49.902123+0000","last_unstale":"2026-02-12T18:08:56.529107+0000","last_undegraded":"2026-02-12T18:08:56.529107+0000","last_fullsized":"2026-02-12T18:08:56.529107+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:03:04.261206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027722199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713377+0000","last_change":"2026-02-12T18:08:48.510355+0000","last_active":"2026-02-12T18:08:59.713377+0000","last_peered":"2026-02-12T18:08:59.713377+0000","last_clean":"2026-02-12T18:08:59.713377+0000","last_became_active":"2026-02-12T18:08:48.509978+0000","last_became_peered":"2026-02-12T18:08:48.509978+0000","last_unstale":"2026-02-12T18:08:59.713377+0000","last_undegraded":"2026-02-12T18:08:59.713377+0000","last_fullsized":"2026-02-12T18:08:59.713377+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:15:49.558001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030204800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"peering","last_fresh":"2026-02-12T18:08:59.806139+0000","last_change":"2026-02-12T18:09:00.678209+0000","last_active":"2026-02-12T18:09:00.678209+0000","last_peered":"2026-02-12T18:08:59.806139+0000","last_clean":"2026-02-12T18:08:55.527069+0000","last_became_active":"2026-02-12T18:08:56.530596+0000","last_became_peered":"2026-02-12T18:08:56.530596+0000","last_unstale":"2026-02-12T18:08:59.806139+0000","last_undegraded":"2026-02-12T18:08:59.806139+0000","last_fullsized":"2026-02-12T18:08:56.530387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.714143+0000","last_change":"2026-02-12T18:08:59.714071+0000","last_active":"2026-02-12T18:08:59.714143+0000","last_peered":"2026-02-12T18:08:59.714143+0000","last_clean":"2026-02-12T18:08:59.714143+0000","last_became_active":"2026-02-12T18:08:59.713880+0000","last_became_peered":"2026-02-12T18:08:59.713880+0000","last_unstale":"2026-02-12T18:08:59.714143+0000","last_undegraded":"2026-02-12T18:08:59.714143+0000","last_fullsized":"2026-02-12T18:08:59.714143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:25:12.322281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":88,"reported_epoch":56,"state":"active+undersized+degraded","last_fresh":"2026-02-12T18:08:56.529573+0000","last_change":"2026-02-12T18:08:56.529454+0000","last_active":"2026-02-12T18:08:56.529573+0000","last_peered":"2026-02-12T18:08:56.529573+0000","last_clean":"2026-02-12T18:08:55.575083+0000","last_became_active":"2026-02-12T18:08:56.529454+0000","last_became_peered":"2026-02-12T18:08:56.529454+0000","last_unstale":"2026-02-12T18:08:56.529573+0000","last_undegraded":"2026-02-12T18:08:56.529206+0000","last_fullsized":"2026-02-12T18:08:56.529141+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:11.098464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541719+0000","last_change":"2026-02-12T18:08:59.541099+0000","last_active":"2026-02-12T18:09:00.541719+0000","last_peered":"2026-02-12T18:09:00.541719+0000","last_clean":"2026-02-12T18:09:00.541719+0000","last_became_active":"2026-02-12T18:08:59.540942+0000","last_became_peered":"2026-02-12T18:08:59.540942+0000","last_unstale":"2026-02-12T18:09:00.541719+0000","last_undegraded":"2026-02-12T18:09:00.541719+0000","last_fullsized":"2026-02-12T18:09:00.541719+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:45.164694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057906899999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541763+0000","last_change":"2026-02-12T18:08:49.511896+0000","last_active":"2026-02-12T18:09:00.541763+0000","last_peered":"2026-02-12T18:09:00.541763+0000","last_clean":"2026-02-12T18:09:00.541763+0000","last_became_active":"2026-02-12T18:08:49.511747+0000","last_became_peered":"2026-02-12T18:08:49.511747+0000","last_unstale":"2026-02-12T18:09:00.541763+0000","last_undegraded":"2026-02-12T18:09:00.541763+0000","last_fullsized":"2026-02-12T18:09:00.541763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:09:54.305249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028142899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713277+0000","last_change":"2026-02-12T18:08:48.509928+0000","last_active":"2026-02-12T18:08:59.713277+0000","last_peered":"2026-02-12T18:08:59.713277+0000","last_clean":"2026-02-12T18:08:59.713277+0000","last_became_active":"2026-02-12T18:08:48.509745+0000","last_became_peered":"2026-02-12T18:08:48.509745+0000","last_unstale":"2026-02-12T18:08:59.713277+0000","last_undegraded":"2026-02-12T18:08:59.713277+0000","last_fullsized":"2026-02-12T18:08:59.713277+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:54:40.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":40,"seq":171798691858,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27096,"internal_metadata":27563560},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30341,"internal_metadata":27560315},"hb_peers":[2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28392,"internal_metadata":27562264},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31648,"internal_metadata":27559008},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":47,"seq":201863462929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":48,"seq":206158430225,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":294299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25786,"internal_metadata":27564870},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":58,"seq":249108103186,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":60,"seq":257698037778,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26440,"internal_metadata":27564216},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:09:05.708 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:09:05.869 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:05.869 INFO:teuthology.orchestra.run.trial060.stderr:dumped all 2026-02-12T18:09:05.880 INFO:teuthology.orchestra.run.trial060.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2026-02-12T18:09:05.667036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276220,"kb_used_data":6620,"kb_used_omap":281,"kb_used_meta":269158,"kb_avail":1048299780,"statfs":{"total":1073741824000,"available":1073458974720,"internally_reserved":0,"allocated":6778880,"data_stored":3261891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":288483,"internal_metadata":275618077},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.128286"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":80,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541773+0000","last_change":"2026-02-12T18:08:49.902326+0000","last_active":"2026-02-12T18:09:00.541773+0000","last_peered":"2026-02-12T18:09:00.541773+0000","last_clean":"2026-02-12T18:09:00.541773+0000","last_became_active":"2026-02-12T18:08:49.902123+0000","last_became_peered":"2026-02-12T18:08:49.902123+0000","last_unstale":"2026-02-12T18:09:00.541773+0000","last_undegraded":"2026-02-12T18:09:00.541773+0000","last_fullsized":"2026-02-12T18:09:00.541773+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:03:04.261206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027722199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713377+0000","last_change":"2026-02-12T18:08:48.510355+0000","last_active":"2026-02-12T18:08:59.713377+0000","last_peered":"2026-02-12T18:08:59.713377+0000","last_clean":"2026-02-12T18:08:59.713377+0000","last_became_active":"2026-02-12T18:08:48.509978+0000","last_became_peered":"2026-02-12T18:08:48.509978+0000","last_unstale":"2026-02-12T18:08:59.713377+0000","last_undegraded":"2026-02-12T18:08:59.713377+0000","last_fullsized":"2026-02-12T18:08:59.713377+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:15:49.558001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030204800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"peering","last_fresh":"2026-02-12T18:08:59.806139+0000","last_change":"2026-02-12T18:09:00.678209+0000","last_active":"2026-02-12T18:09:00.678209+0000","last_peered":"2026-02-12T18:08:59.806139+0000","last_clean":"2026-02-12T18:08:55.527069+0000","last_became_active":"2026-02-12T18:08:56.530596+0000","last_became_peered":"2026-02-12T18:08:56.530596+0000","last_unstale":"2026-02-12T18:08:59.806139+0000","last_undegraded":"2026-02-12T18:08:59.806139+0000","last_fullsized":"2026-02-12T18:08:56.530387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.714143+0000","last_change":"2026-02-12T18:08:59.714071+0000","last_active":"2026-02-12T18:08:59.714143+0000","last_peered":"2026-02-12T18:08:59.714143+0000","last_clean":"2026-02-12T18:08:59.714143+0000","last_became_active":"2026-02-12T18:08:59.713880+0000","last_became_peered":"2026-02-12T18:08:59.713880+0000","last_unstale":"2026-02-12T18:08:59.714143+0000","last_undegraded":"2026-02-12T18:08:59.714143+0000","last_fullsized":"2026-02-12T18:08:59.714143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:25:12.322281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":102,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541768+0000","last_change":"2026-02-12T18:08:59.541277+0000","last_active":"2026-02-12T18:09:00.541768+0000","last_peered":"2026-02-12T18:09:00.541768+0000","last_clean":"2026-02-12T18:09:00.541768+0000","last_became_active":"2026-02-12T18:08:59.541119+0000","last_became_peered":"2026-02-12T18:08:59.541119+0000","last_unstale":"2026-02-12T18:09:00.541768+0000","last_undegraded":"2026-02-12T18:09:00.541768+0000","last_fullsized":"2026-02-12T18:09:00.541768+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:04:33.745464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541719+0000","last_change":"2026-02-12T18:08:59.541099+0000","last_active":"2026-02-12T18:09:00.541719+0000","last_peered":"2026-02-12T18:09:00.541719+0000","last_clean":"2026-02-12T18:09:00.541719+0000","last_became_active":"2026-02-12T18:08:59.540942+0000","last_became_peered":"2026-02-12T18:08:59.540942+0000","last_unstale":"2026-02-12T18:09:00.541719+0000","last_undegraded":"2026-02-12T18:09:00.541719+0000","last_fullsized":"2026-02-12T18:09:00.541719+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:45.164694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057906899999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541763+0000","last_change":"2026-02-12T18:08:49.511896+0000","last_active":"2026-02-12T18:09:00.541763+0000","last_peered":"2026-02-12T18:09:00.541763+0000","last_clean":"2026-02-12T18:09:00.541763+0000","last_became_active":"2026-02-12T18:08:49.511747+0000","last_became_peered":"2026-02-12T18:08:49.511747+0000","last_unstale":"2026-02-12T18:09:00.541763+0000","last_undegraded":"2026-02-12T18:09:00.541763+0000","last_fullsized":"2026-02-12T18:09:00.541763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:09:54.305249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028142899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713277+0000","last_change":"2026-02-12T18:08:48.509928+0000","last_active":"2026-02-12T18:08:59.713277+0000","last_peered":"2026-02-12T18:08:59.713277+0000","last_clean":"2026-02-12T18:08:59.713277+0000","last_became_active":"2026-02-12T18:08:48.509745+0000","last_became_peered":"2026-02-12T18:08:48.509745+0000","last_unstale":"2026-02-12T18:08:59.713277+0000","last_undegraded":"2026-02-12T18:08:59.713277+0000","last_fullsized":"2026-02-12T18:08:59.713277+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:54:40.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":40,"seq":171798691858,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27096,"internal_metadata":27563560},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30341,"internal_metadata":27560315},"hb_peers":[2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28392,"internal_metadata":27562264},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31648,"internal_metadata":27559008},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":47,"seq":201863462929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":48,"seq":206158430226,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":333415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29041,"internal_metadata":27561615},"hb_peers":[1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":58,"seq":249108103186,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":60,"seq":257698037778,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26440,"internal_metadata":27564216},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:09:05.883 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:09:06.037 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:06.037 INFO:teuthology.orchestra.run.trial060.stderr:dumped all 2026-02-12T18:09:06.048 INFO:teuthology.orchestra.run.trial060.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2026-02-12T18:09:05.667036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276220,"kb_used_data":6620,"kb_used_omap":281,"kb_used_meta":269158,"kb_avail":1048299780,"statfs":{"total":1073741824000,"available":1073458974720,"internally_reserved":0,"allocated":6778880,"data_stored":3261891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":288483,"internal_metadata":275618077},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.128286"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":80,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541773+0000","last_change":"2026-02-12T18:08:49.902326+0000","last_active":"2026-02-12T18:09:00.541773+0000","last_peered":"2026-02-12T18:09:00.541773+0000","last_clean":"2026-02-12T18:09:00.541773+0000","last_became_active":"2026-02-12T18:08:49.902123+0000","last_became_peered":"2026-02-12T18:08:49.902123+0000","last_unstale":"2026-02-12T18:09:00.541773+0000","last_undegraded":"2026-02-12T18:09:00.541773+0000","last_fullsized":"2026-02-12T18:09:00.541773+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:03:04.261206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027722199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713377+0000","last_change":"2026-02-12T18:08:48.510355+0000","last_active":"2026-02-12T18:08:59.713377+0000","last_peered":"2026-02-12T18:08:59.713377+0000","last_clean":"2026-02-12T18:08:59.713377+0000","last_became_active":"2026-02-12T18:08:48.509978+0000","last_became_peered":"2026-02-12T18:08:48.509978+0000","last_unstale":"2026-02-12T18:08:59.713377+0000","last_undegraded":"2026-02-12T18:08:59.713377+0000","last_fullsized":"2026-02-12T18:08:59.713377+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:15:49.558001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030204800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"peering","last_fresh":"2026-02-12T18:08:59.806139+0000","last_change":"2026-02-12T18:09:00.678209+0000","last_active":"2026-02-12T18:09:00.678209+0000","last_peered":"2026-02-12T18:08:59.806139+0000","last_clean":"2026-02-12T18:08:55.527069+0000","last_became_active":"2026-02-12T18:08:56.530596+0000","last_became_peered":"2026-02-12T18:08:56.530596+0000","last_unstale":"2026-02-12T18:08:59.806139+0000","last_undegraded":"2026-02-12T18:08:59.806139+0000","last_fullsized":"2026-02-12T18:08:56.530387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.714143+0000","last_change":"2026-02-12T18:08:59.714071+0000","last_active":"2026-02-12T18:08:59.714143+0000","last_peered":"2026-02-12T18:08:59.714143+0000","last_clean":"2026-02-12T18:08:59.714143+0000","last_became_active":"2026-02-12T18:08:59.713880+0000","last_became_peered":"2026-02-12T18:08:59.713880+0000","last_unstale":"2026-02-12T18:08:59.714143+0000","last_undegraded":"2026-02-12T18:08:59.714143+0000","last_fullsized":"2026-02-12T18:08:59.714143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:25:12.322281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":102,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541768+0000","last_change":"2026-02-12T18:08:59.541277+0000","last_active":"2026-02-12T18:09:00.541768+0000","last_peered":"2026-02-12T18:09:00.541768+0000","last_clean":"2026-02-12T18:09:00.541768+0000","last_became_active":"2026-02-12T18:08:59.541119+0000","last_became_peered":"2026-02-12T18:08:59.541119+0000","last_unstale":"2026-02-12T18:09:00.541768+0000","last_undegraded":"2026-02-12T18:09:00.541768+0000","last_fullsized":"2026-02-12T18:09:00.541768+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:04:33.745464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541719+0000","last_change":"2026-02-12T18:08:59.541099+0000","last_active":"2026-02-12T18:09:00.541719+0000","last_peered":"2026-02-12T18:09:00.541719+0000","last_clean":"2026-02-12T18:09:00.541719+0000","last_became_active":"2026-02-12T18:08:59.540942+0000","last_became_peered":"2026-02-12T18:08:59.540942+0000","last_unstale":"2026-02-12T18:09:00.541719+0000","last_undegraded":"2026-02-12T18:09:00.541719+0000","last_fullsized":"2026-02-12T18:09:00.541719+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:45.164694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057906899999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541763+0000","last_change":"2026-02-12T18:08:49.511896+0000","last_active":"2026-02-12T18:09:00.541763+0000","last_peered":"2026-02-12T18:09:00.541763+0000","last_clean":"2026-02-12T18:09:00.541763+0000","last_became_active":"2026-02-12T18:08:49.511747+0000","last_became_peered":"2026-02-12T18:08:49.511747+0000","last_unstale":"2026-02-12T18:09:00.541763+0000","last_undegraded":"2026-02-12T18:09:00.541763+0000","last_fullsized":"2026-02-12T18:09:00.541763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:09:54.305249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028142899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713277+0000","last_change":"2026-02-12T18:08:48.509928+0000","last_active":"2026-02-12T18:08:59.713277+0000","last_peered":"2026-02-12T18:08:59.713277+0000","last_clean":"2026-02-12T18:08:59.713277+0000","last_became_active":"2026-02-12T18:08:48.509745+0000","last_became_peered":"2026-02-12T18:08:48.509745+0000","last_unstale":"2026-02-12T18:08:59.713277+0000","last_undegraded":"2026-02-12T18:08:59.713277+0000","last_fullsized":"2026-02-12T18:08:59.713277+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:54:40.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":40,"seq":171798691858,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27096,"internal_metadata":27563560},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30341,"internal_metadata":27560315},"hb_peers":[2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28392,"internal_metadata":27562264},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31648,"internal_metadata":27559008},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":47,"seq":201863462929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":48,"seq":206158430226,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":333415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29041,"internal_metadata":27561615},"hb_peers":[1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":58,"seq":249108103186,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":60,"seq":257698037778,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26440,"internal_metadata":27564216},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:09:06.050 INFO:tasks.ceph.ceph_manager.ceph:PG 1.5 is not active+clean 2026-02-12T18:09:06.050 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.5', 'version': "0'0", 'reported_seq': 100, 'reported_epoch': 59, 'state': 'peering', 'last_fresh': '2026-02-12T18:08:59.806139+0000', 'last_change': '2026-02-12T18:09:00.678209+0000', 'last_active': '2026-02-12T18:09:00.678209+0000', 'last_peered': '2026-02-12T18:08:59.806139+0000', 'last_clean': '2026-02-12T18:08:55.527069+0000', 'last_became_active': '2026-02-12T18:08:56.530596+0000', 'last_became_peered': '2026-02-12T18:08:56.530596+0000', 'last_unstale': '2026-02-12T18:08:59.806139+0000', 'last_undegraded': '2026-02-12T18:08:59.806139+0000', 'last_fullsized': '2026-02-12T18:08:56.530387+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 48, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-12T18:07:50.669839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-12T18:07:50.669839+0000', 'last_clean_scrub_stamp': '2026-02-12T18:07:50.669839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.000304873, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 0], 'acting': [9, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2026-02-12T18:09:06.050 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2026-02-12T18:09:06.244 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:06.244 INFO:teuthology.orchestra.run.trial060.stdout:{"fsid":"25fa2def-3287-4142-b1ac-e832bbd8bb26","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noout flag(s) set","count":5},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":86,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":61,"num_osds":10,"num_up_osds":10,"osd_up_since":1770919740,"num_in_osds":10,"osd_in_since":1770919661,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":7},{"state_name":"peering","count":1}],"num_pgs":8,"num_pools":1,"num_objects":2,"data_bytes":19,"bytes_used":282849280,"bytes_avail":1073458974720,"bytes_total":1073741824000,"inactive_pgs_ratio":0.125},"fsmap":{"epoch":1,"btime":"2026-02-12T18:07:39:457388+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs"],"services":{}},"servicemap":{"epoch":3,"modified":"2026-02-12T18:08:47.664716+0000","services":{}},"progress_events":{}} 2026-02-12T18:09:06.255 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-12T18:09:06.256 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:09:06.416 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:06.417 INFO:teuthology.orchestra.run.trial060.stderr:dumped all 2026-02-12T18:09:06.428 INFO:teuthology.orchestra.run.trial060.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2026-02-12T18:09:05.667036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276220,"kb_used_data":6620,"kb_used_omap":281,"kb_used_meta":269158,"kb_avail":1048299780,"statfs":{"total":1073741824000,"available":1073458974720,"internally_reserved":0,"allocated":6778880,"data_stored":3261891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":288483,"internal_metadata":275618077},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.128286"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":80,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541773+0000","last_change":"2026-02-12T18:08:49.902326+0000","last_active":"2026-02-12T18:09:00.541773+0000","last_peered":"2026-02-12T18:09:00.541773+0000","last_clean":"2026-02-12T18:09:00.541773+0000","last_became_active":"2026-02-12T18:08:49.902123+0000","last_became_peered":"2026-02-12T18:08:49.902123+0000","last_unstale":"2026-02-12T18:09:00.541773+0000","last_undegraded":"2026-02-12T18:09:00.541773+0000","last_fullsized":"2026-02-12T18:09:00.541773+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:03:04.261206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027722199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713377+0000","last_change":"2026-02-12T18:08:48.510355+0000","last_active":"2026-02-12T18:08:59.713377+0000","last_peered":"2026-02-12T18:08:59.713377+0000","last_clean":"2026-02-12T18:08:59.713377+0000","last_became_active":"2026-02-12T18:08:48.509978+0000","last_became_peered":"2026-02-12T18:08:48.509978+0000","last_unstale":"2026-02-12T18:08:59.713377+0000","last_undegraded":"2026-02-12T18:08:59.713377+0000","last_fullsized":"2026-02-12T18:08:59.713377+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:15:49.558001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030204800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":59,"state":"peering","last_fresh":"2026-02-12T18:08:59.806139+0000","last_change":"2026-02-12T18:09:00.678209+0000","last_active":"2026-02-12T18:09:00.678209+0000","last_peered":"2026-02-12T18:08:59.806139+0000","last_clean":"2026-02-12T18:08:55.527069+0000","last_became_active":"2026-02-12T18:08:56.530596+0000","last_became_peered":"2026-02-12T18:08:56.530596+0000","last_unstale":"2026-02-12T18:08:59.806139+0000","last_undegraded":"2026-02-12T18:08:59.806139+0000","last_fullsized":"2026-02-12T18:08:56.530387+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.714143+0000","last_change":"2026-02-12T18:08:59.714071+0000","last_active":"2026-02-12T18:08:59.714143+0000","last_peered":"2026-02-12T18:08:59.714143+0000","last_clean":"2026-02-12T18:08:59.714143+0000","last_became_active":"2026-02-12T18:08:59.713880+0000","last_became_peered":"2026-02-12T18:08:59.713880+0000","last_unstale":"2026-02-12T18:08:59.714143+0000","last_undegraded":"2026-02-12T18:08:59.714143+0000","last_fullsized":"2026-02-12T18:08:59.714143+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:25:12.322281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":102,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541768+0000","last_change":"2026-02-12T18:08:59.541277+0000","last_active":"2026-02-12T18:09:00.541768+0000","last_peered":"2026-02-12T18:09:00.541768+0000","last_clean":"2026-02-12T18:09:00.541768+0000","last_became_active":"2026-02-12T18:08:59.541119+0000","last_became_peered":"2026-02-12T18:08:59.541119+0000","last_unstale":"2026-02-12T18:09:00.541768+0000","last_undegraded":"2026-02-12T18:09:00.541768+0000","last_fullsized":"2026-02-12T18:09:00.541768+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:04:33.745464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541719+0000","last_change":"2026-02-12T18:08:59.541099+0000","last_active":"2026-02-12T18:09:00.541719+0000","last_peered":"2026-02-12T18:09:00.541719+0000","last_clean":"2026-02-12T18:09:00.541719+0000","last_became_active":"2026-02-12T18:08:59.540942+0000","last_became_peered":"2026-02-12T18:08:59.540942+0000","last_unstale":"2026-02-12T18:09:00.541719+0000","last_undegraded":"2026-02-12T18:09:00.541719+0000","last_fullsized":"2026-02-12T18:09:00.541719+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:45.164694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057906899999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":82,"reported_epoch":60,"state":"active+clean","last_fresh":"2026-02-12T18:09:00.541763+0000","last_change":"2026-02-12T18:08:49.511896+0000","last_active":"2026-02-12T18:09:00.541763+0000","last_peered":"2026-02-12T18:09:00.541763+0000","last_clean":"2026-02-12T18:09:00.541763+0000","last_became_active":"2026-02-12T18:08:49.511747+0000","last_became_peered":"2026-02-12T18:08:49.511747+0000","last_unstale":"2026-02-12T18:09:00.541763+0000","last_undegraded":"2026-02-12T18:09:00.541763+0000","last_fullsized":"2026-02-12T18:09:00.541763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:09:54.305249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028142899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-12T18:08:59.713277+0000","last_change":"2026-02-12T18:08:48.509928+0000","last_active":"2026-02-12T18:08:59.713277+0000","last_peered":"2026-02-12T18:08:59.713277+0000","last_clean":"2026-02-12T18:08:59.713277+0000","last_became_active":"2026-02-12T18:08:48.509745+0000","last_became_peered":"2026-02-12T18:08:48.509745+0000","last_unstale":"2026-02-12T18:08:59.713277+0000","last_undegraded":"2026-02-12T18:08:59.713277+0000","last_fullsized":"2026-02-12T18:08:59.713277+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:54:40.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":40,"seq":171798691858,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27096,"internal_metadata":27563560},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30341,"internal_metadata":27560315},"hb_peers":[2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28392,"internal_metadata":27562264},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31648,"internal_metadata":27559008},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":47,"seq":201863462929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":48,"seq":206158430226,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27632,"kb_used_data":672,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829968,"statfs":{"total":107374182400,"available":107345887232,"internally_reserved":0,"allocated":688128,"data_stored":333415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29041,"internal_metadata":27561615},"hb_peers":[1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":58,"seq":249108103186,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27624,"kb_used_data":664,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829976,"statfs":{"total":107374182400,"available":107345895424,"internally_reserved":0,"allocated":679936,"data_stored":325401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29044,"internal_metadata":27561612},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":60,"seq":257698037778,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27620,"kb_used_data":660,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104829980,"statfs":{"total":107374182400,"available":107345899520,"internally_reserved":0,"allocated":675840,"data_stored":325382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26440,"internal_metadata":27564216},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:09:09.430 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:09:09.592 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:09.592 INFO:teuthology.orchestra.run.trial060.stderr:dumped all 2026-02-12T18:09:09.604 INFO:teuthology.orchestra.run.trial060.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2026-02-12T18:09:07.667289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276448,"kb_used_data":6848,"kb_used_omap":293,"kb_used_meta":269146,"kb_avail":1048299552,"statfs":{"total":1073741824000,"available":1073458741248,"internally_reserved":0,"allocated":7012352,"data_stored":3410608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":300852,"internal_metadata":275605708},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001165"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:03.118047+0000","last_change":"2026-02-12T18:08:49.902326+0000","last_active":"2026-02-12T18:09:03.118047+0000","last_peered":"2026-02-12T18:09:03.118047+0000","last_clean":"2026-02-12T18:09:03.118047+0000","last_became_active":"2026-02-12T18:08:49.902123+0000","last_became_peered":"2026-02-12T18:08:49.902123+0000","last_unstale":"2026-02-12T18:09:03.118047+0000","last_undegraded":"2026-02-12T18:09:03.118047+0000","last_fullsized":"2026-02-12T18:09:03.118047+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:03:04.261206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027722199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":104,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:03.117871+0000","last_change":"2026-02-12T18:08:48.510355+0000","last_active":"2026-02-12T18:09:03.117871+0000","last_peered":"2026-02-12T18:09:03.117871+0000","last_clean":"2026-02-12T18:09:03.117871+0000","last_became_active":"2026-02-12T18:08:48.509978+0000","last_became_peered":"2026-02-12T18:08:48.509978+0000","last_unstale":"2026-02-12T18:09:03.117871+0000","last_undegraded":"2026-02-12T18:09:03.117871+0000","last_fullsized":"2026-02-12T18:09:03.117871+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:15:49.558001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030204800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":109,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:01.826082+0000","last_change":"2026-02-12T18:09:01.826014+0000","last_active":"2026-02-12T18:09:01.826082+0000","last_peered":"2026-02-12T18:09:01.826082+0000","last_clean":"2026-02-12T18:09:01.826082+0000","last_became_active":"2026-02-12T18:09:01.825826+0000","last_became_peered":"2026-02-12T18:09:01.825826+0000","last_unstale":"2026-02-12T18:09:01.826082+0000","last_undegraded":"2026-02-12T18:09:01.826082+0000","last_fullsized":"2026-02-12T18:09:01.826082+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:41:53.779357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:01.933586+0000","last_change":"2026-02-12T18:08:59.714071+0000","last_active":"2026-02-12T18:09:01.933586+0000","last_peered":"2026-02-12T18:09:01.933586+0000","last_clean":"2026-02-12T18:09:01.933586+0000","last_became_active":"2026-02-12T18:08:59.713880+0000","last_became_peered":"2026-02-12T18:08:59.713880+0000","last_unstale":"2026-02-12T18:09:01.933586+0000","last_undegraded":"2026-02-12T18:09:01.933586+0000","last_fullsized":"2026-02-12T18:09:01.933586+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:25:12.322281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":104,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:03.118039+0000","last_change":"2026-02-12T18:08:59.541277+0000","last_active":"2026-02-12T18:09:03.118039+0000","last_peered":"2026-02-12T18:09:03.118039+0000","last_clean":"2026-02-12T18:09:03.118039+0000","last_became_active":"2026-02-12T18:08:59.541119+0000","last_became_peered":"2026-02-12T18:08:59.541119+0000","last_unstale":"2026-02-12T18:09:03.118039+0000","last_undegraded":"2026-02-12T18:09:03.118039+0000","last_fullsized":"2026-02-12T18:09:03.118039+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:04:33.745464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":107,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:02.346232+0000","last_change":"2026-02-12T18:08:59.541099+0000","last_active":"2026-02-12T18:09:02.346232+0000","last_peered":"2026-02-12T18:09:02.346232+0000","last_clean":"2026-02-12T18:09:02.346232+0000","last_became_active":"2026-02-12T18:08:59.540942+0000","last_became_peered":"2026-02-12T18:08:59.540942+0000","last_unstale":"2026-02-12T18:09:02.346232+0000","last_undegraded":"2026-02-12T18:09:02.346232+0000","last_fullsized":"2026-02-12T18:09:02.346232+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:45.164694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057906899999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:03.118273+0000","last_change":"2026-02-12T18:08:49.511896+0000","last_active":"2026-02-12T18:09:03.118273+0000","last_peered":"2026-02-12T18:09:03.118273+0000","last_clean":"2026-02-12T18:09:03.118273+0000","last_became_active":"2026-02-12T18:08:49.511747+0000","last_became_peered":"2026-02-12T18:08:49.511747+0000","last_unstale":"2026-02-12T18:09:03.118273+0000","last_undegraded":"2026-02-12T18:09:03.118273+0000","last_fullsized":"2026-02-12T18:09:03.118273+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:09:54.305249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028142899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:02.716855+0000","last_change":"2026-02-12T18:08:48.509928+0000","last_active":"2026-02-12T18:09:02.716855+0000","last_peered":"2026-02-12T18:09:02.716855+0000","last_clean":"2026-02-12T18:09:02.716855+0000","last_became_active":"2026-02-12T18:08:48.509745+0000","last_became_peered":"2026-02-12T18:08:48.509745+0000","last_unstale":"2026-02-12T18:09:02.716855+0000","last_undegraded":"2026-02-12T18:09:02.716855+0000","last_fullsized":"2026-02-12T18:09:02.716855+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:54:40.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":40,"seq":171798691859,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28398,"internal_metadata":27562258},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31643,"internal_metadata":27559013},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462930,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29694,"internal_metadata":27560962},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32950,"internal_metadata":27557706},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":47,"seq":201863462930,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27648,"kb_used_data":688,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829952,"statfs":{"total":107374182400,"available":107345870848,"internally_reserved":0,"allocated":704512,"data_stored":341076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30997,"internal_metadata":27559659},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":48,"seq":206158430227,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29692,"internal_metadata":27560964},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":58,"seq":249108103187,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27648,"kb_used_data":688,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829952,"statfs":{"total":107374182400,"available":107345870848,"internally_reserved":0,"allocated":704512,"data_stored":341076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30346,"internal_metadata":27560310},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":60,"seq":257698037779,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:09:09.606 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T18:09:09.606 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:09:09.760 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:09.760 INFO:teuthology.orchestra.run.trial060.stderr:dumped all 2026-02-12T18:09:09.772 INFO:teuthology.orchestra.run.trial060.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2026-02-12T18:09:09.667601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276448,"kb_used_data":6848,"kb_used_omap":293,"kb_used_meta":269146,"kb_avail":1048299552,"statfs":{"total":1073741824000,"available":1073458741248,"internally_reserved":0,"allocated":7012352,"data_stored":3410608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":300852,"internal_metadata":275605708},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.126515"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:03.118047+0000","last_change":"2026-02-12T18:08:49.902326+0000","last_active":"2026-02-12T18:09:03.118047+0000","last_peered":"2026-02-12T18:09:03.118047+0000","last_clean":"2026-02-12T18:09:03.118047+0000","last_became_active":"2026-02-12T18:08:49.902123+0000","last_became_peered":"2026-02-12T18:08:49.902123+0000","last_unstale":"2026-02-12T18:09:03.118047+0000","last_undegraded":"2026-02-12T18:09:03.118047+0000","last_fullsized":"2026-02-12T18:09:03.118047+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:03:04.261206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027722199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":104,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:03.117871+0000","last_change":"2026-02-12T18:08:48.510355+0000","last_active":"2026-02-12T18:09:03.117871+0000","last_peered":"2026-02-12T18:09:03.117871+0000","last_clean":"2026-02-12T18:09:03.117871+0000","last_became_active":"2026-02-12T18:08:48.509978+0000","last_became_peered":"2026-02-12T18:08:48.509978+0000","last_unstale":"2026-02-12T18:09:03.117871+0000","last_undegraded":"2026-02-12T18:09:03.117871+0000","last_fullsized":"2026-02-12T18:09:03.117871+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:15:49.558001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030204800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":109,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:01.826082+0000","last_change":"2026-02-12T18:09:01.826014+0000","last_active":"2026-02-12T18:09:01.826082+0000","last_peered":"2026-02-12T18:09:01.826082+0000","last_clean":"2026-02-12T18:09:01.826082+0000","last_became_active":"2026-02-12T18:09:01.825826+0000","last_became_peered":"2026-02-12T18:09:01.825826+0000","last_unstale":"2026-02-12T18:09:01.826082+0000","last_undegraded":"2026-02-12T18:09:01.826082+0000","last_fullsized":"2026-02-12T18:09:01.826082+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:41:53.779357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:01.933586+0000","last_change":"2026-02-12T18:08:59.714071+0000","last_active":"2026-02-12T18:09:01.933586+0000","last_peered":"2026-02-12T18:09:01.933586+0000","last_clean":"2026-02-12T18:09:01.933586+0000","last_became_active":"2026-02-12T18:08:59.713880+0000","last_became_peered":"2026-02-12T18:08:59.713880+0000","last_unstale":"2026-02-12T18:09:01.933586+0000","last_undegraded":"2026-02-12T18:09:01.933586+0000","last_fullsized":"2026-02-12T18:09:01.933586+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:25:12.322281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":104,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:03.118039+0000","last_change":"2026-02-12T18:08:59.541277+0000","last_active":"2026-02-12T18:09:03.118039+0000","last_peered":"2026-02-12T18:09:03.118039+0000","last_clean":"2026-02-12T18:09:03.118039+0000","last_became_active":"2026-02-12T18:08:59.541119+0000","last_became_peered":"2026-02-12T18:08:59.541119+0000","last_unstale":"2026-02-12T18:09:03.118039+0000","last_undegraded":"2026-02-12T18:09:03.118039+0000","last_fullsized":"2026-02-12T18:09:03.118039+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:04:33.745464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":107,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:02.346232+0000","last_change":"2026-02-12T18:08:59.541099+0000","last_active":"2026-02-12T18:09:02.346232+0000","last_peered":"2026-02-12T18:09:02.346232+0000","last_clean":"2026-02-12T18:09:02.346232+0000","last_became_active":"2026-02-12T18:08:59.540942+0000","last_became_peered":"2026-02-12T18:08:59.540942+0000","last_unstale":"2026-02-12T18:09:02.346232+0000","last_undegraded":"2026-02-12T18:09:02.346232+0000","last_fullsized":"2026-02-12T18:09:02.346232+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:45.164694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057906899999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:03.118273+0000","last_change":"2026-02-12T18:08:49.511896+0000","last_active":"2026-02-12T18:09:03.118273+0000","last_peered":"2026-02-12T18:09:03.118273+0000","last_clean":"2026-02-12T18:09:03.118273+0000","last_became_active":"2026-02-12T18:08:49.511747+0000","last_became_peered":"2026-02-12T18:08:49.511747+0000","last_unstale":"2026-02-12T18:09:03.118273+0000","last_undegraded":"2026-02-12T18:09:03.118273+0000","last_fullsized":"2026-02-12T18:09:03.118273+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:09:54.305249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028142899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:02.716855+0000","last_change":"2026-02-12T18:08:48.509928+0000","last_active":"2026-02-12T18:09:02.716855+0000","last_peered":"2026-02-12T18:09:02.716855+0000","last_clean":"2026-02-12T18:09:02.716855+0000","last_became_active":"2026-02-12T18:08:48.509745+0000","last_became_peered":"2026-02-12T18:08:48.509745+0000","last_unstale":"2026-02-12T18:09:02.716855+0000","last_undegraded":"2026-02-12T18:09:02.716855+0000","last_fullsized":"2026-02-12T18:09:02.716855+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:54:40.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":40,"seq":171798691859,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28398,"internal_metadata":27562258},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31643,"internal_metadata":27559013},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462930,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29694,"internal_metadata":27560962},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32950,"internal_metadata":27557706},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":47,"seq":201863462930,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27648,"kb_used_data":688,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829952,"statfs":{"total":107374182400,"available":107345870848,"internally_reserved":0,"allocated":704512,"data_stored":341076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30997,"internal_metadata":27559659},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":48,"seq":206158430227,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29692,"internal_metadata":27560964},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":58,"seq":249108103187,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27648,"kb_used_data":688,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829952,"statfs":{"total":107374182400,"available":107345870848,"internally_reserved":0,"allocated":704512,"data_stored":341076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30346,"internal_metadata":27560310},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":60,"seq":257698037779,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:09:09.774 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T18:09:09.930 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:09.931 INFO:teuthology.orchestra.run.trial060.stdout:{"epoch":61,"fsid":"25fa2def-3287-4142-b1ac-e832bbd8bb26","created":"2026-02-12T18:07:39.457591+0000","modified":"2026-02-12T18:09:01.541021+0000","last_up_change":"2026-02-12T18:09:00.538727+0000","last_in_change":"2026-02-12T18:07:41.295407+0000","flags":"noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800064,"flags_set":["noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-12T18:07:49.856623+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.80000001192092896,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ad3e842-c1f9-4b56-9d5c-97cd470a6929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":59,"up_from":60,"up_thru":35,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6842","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6843","nonce":3591020635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6820","nonce":3594020635},{"type":"v1","addr":"10.20.193.60:6823","nonce":3594020635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6848","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6849","nonce":3591020635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6846","nonce":3591020635},{"type":"v1","addr":"10.20.193.60:6847","nonce":3591020635}]},"public_addr":"10.20.193.60:6843/3591020635","cluster_addr":"10.20.193.60:6823/3594020635","heartbeat_back_addr":"10.20.193.60:6849/3591020635","heartbeat_front_addr":"10.20.193.60:6847/3591020635","state":["exists","up"]},{"osd":1,"uuid":"bfa10ffc-c863-4cf1-8c88-0a779cfc73fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":57,"up_from":58,"up_thru":58,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6810","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6811","nonce":1953903305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6844","nonce":1956903305},{"type":"v1","addr":"10.20.193.60:6845","nonce":1956903305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6825","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6828","nonce":1953903305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6819","nonce":1953903305},{"type":"v1","addr":"10.20.193.60:6822","nonce":1953903305}]},"public_addr":"10.20.193.60:6811/1953903305","cluster_addr":"10.20.193.60:6845/1956903305","heartbeat_back_addr":"10.20.193.60:6828/1953903305","heartbeat_front_addr":"10.20.193.60:6822/1953903305","state":["exists","up"]},{"osd":2,"uuid":"97e2a94a-d5b2-4254-ace1-f21d76a702a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":46,"up_from":47,"up_thru":0,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6813","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6817","nonce":1093602441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6836","nonce":1094602441},{"type":"v1","addr":"10.20.193.60:6837","nonce":1094602441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6832","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6833","nonce":1093602441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6827","nonce":1093602441},{"type":"v1","addr":"10.20.193.60:6830","nonce":1093602441}]},"public_addr":"10.20.193.60:6817/1093602441","cluster_addr":"10.20.193.60:6837/1094602441","heartbeat_back_addr":"10.20.193.60:6833/1093602441","heartbeat_front_addr":"10.20.193.60:6830/1093602441","state":["exists","up"]},{"osd":3,"uuid":"49826740-fd2f-46b7-b6ab-ff968ce54201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":47,"up_from":48,"up_thru":58,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6802","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6803","nonce":3027881260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6860","nonce":3028881260},{"type":"v1","addr":"10.20.193.60:6861","nonce":3028881260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6808","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6809","nonce":3027881260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6806","nonce":3027881260},{"type":"v1","addr":"10.20.193.60:6807","nonce":3027881260}]},"public_addr":"10.20.193.60:6803/3027881260","cluster_addr":"10.20.193.60:6861/3028881260","heartbeat_back_addr":"10.20.193.60:6809/3027881260","heartbeat_front_addr":"10.20.193.60:6807/3027881260","state":["exists","up"]},{"osd":4,"uuid":"98c28f51-3a65-4387-bc9a-072addee6349","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":46,"up_from":47,"up_thru":58,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6834","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6835","nonce":1082935684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6814","nonce":1083935684},{"type":"v1","addr":"10.20.193.60:6816","nonce":1083935684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6840","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6841","nonce":1082935684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6838","nonce":1082935684},{"type":"v1","addr":"10.20.193.60:6839","nonce":1082935684}]},"public_addr":"10.20.193.60:6835/1082935684","cluster_addr":"10.20.193.60:6816/1083935684","heartbeat_back_addr":"10.20.193.60:6841/1082935684","heartbeat_front_addr":"10.20.193.60:6839/1082935684","state":["exists","up"]},{"osd":5,"uuid":"282e5382-9f9e-41fe-9620-40fb2b9ea2a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":46,"up_from":47,"up_thru":47,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6866","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6867","nonce":3686635770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6882","nonce":3687635770},{"type":"v1","addr":"10.20.193.60:6883","nonce":3687635770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6872","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6873","nonce":3686635770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6870","nonce":3686635770},{"type":"v1","addr":"10.20.193.60:6871","nonce":3686635770}]},"public_addr":"10.20.193.60:6867/3686635770","cluster_addr":"10.20.193.60:6883/3687635770","heartbeat_back_addr":"10.20.193.60:6873/3686635770","heartbeat_front_addr":"10.20.193.60:6871/3686635770","state":["exists","up"]},{"osd":6,"uuid":"f72c16d3-3504-4ea0-8566-4ff600674ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":46,"up_from":47,"up_thru":55,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6858","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6859","nonce":4090637263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6868","nonce":4091637263},{"type":"v1","addr":"10.20.193.60:6869","nonce":4091637263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6864","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6865","nonce":4090637263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6862","nonce":4090637263},{"type":"v1","addr":"10.20.193.60:6863","nonce":4090637263}]},"public_addr":"10.20.193.60:6859/4090637263","cluster_addr":"10.20.193.60:6869/4091637263","heartbeat_back_addr":"10.20.193.60:6865/4090637263","heartbeat_front_addr":"10.20.193.60:6863/4090637263","state":["exists","up"]},{"osd":7,"uuid":"40b9cbfa-b547-4bdf-8138-8a153fcdc783","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":46,"up_from":47,"up_thru":48,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6812","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6815","nonce":2933518250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6852","nonce":2934518250},{"type":"v1","addr":"10.20.193.60:6853","nonce":2934518250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6829","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6831","nonce":2933518250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6824","nonce":2933518250},{"type":"v1","addr":"10.20.193.60:6826","nonce":2933518250}]},"public_addr":"10.20.193.60:6815/2933518250","cluster_addr":"10.20.193.60:6853/2934518250","heartbeat_back_addr":"10.20.193.60:6831/2933518250","heartbeat_front_addr":"10.20.193.60:6826/2933518250","state":["exists","up"]},{"osd":8,"uuid":"5fc057b6-c560-4963-bcd8-53d743e23ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":46,"up_from":47,"up_thru":16,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6874","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6875","nonce":1343250244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6804","nonce":1345250244},{"type":"v1","addr":"10.20.193.60:6805","nonce":1345250244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6880","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6881","nonce":1343250244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6878","nonce":1343250244},{"type":"v1","addr":"10.20.193.60:6879","nonce":1343250244}]},"public_addr":"10.20.193.60:6875/1343250244","cluster_addr":"10.20.193.60:6805/1345250244","heartbeat_back_addr":"10.20.193.60:6881/1343250244","heartbeat_front_addr":"10.20.193.60:6879/1343250244","state":["exists","up"]},{"osd":9,"uuid":"4aeac3b5-484a-4c74-93f6-0e4244fefcb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":39,"up_from":40,"up_thru":60,"down_at":35,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6850","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6851","nonce":2786579016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6876","nonce":2787579016},{"type":"v1","addr":"10.20.193.60:6877","nonce":2787579016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6856","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6857","nonce":2786579016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6854","nonce":2786579016},{"type":"v1","addr":"10.20.193.60:6855","nonce":2786579016}]},"public_addr":"10.20.193.60:6851/2786579016","cluster_addr":"10.20.193.60:6877/2787579016","heartbeat_back_addr":"10.20.193.60:6857/2786579016","heartbeat_front_addr":"10.20.193.60:6855/2786579016","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2026-02-12T18:08:55.521918+0000","laggy_probability":0.65700000524520874,"laggy_interval":2,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":59},{"osd":1,"down_stamp":"2026-02-12T18:08:55.521918+0000","laggy_probability":0.65700000524520874,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":55},{"osd":2,"down_stamp":"2026-02-12T18:08:44.493303+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":44},{"osd":3,"down_stamp":"2026-02-12T18:08:44.493303+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":46},{"osd":4,"down_stamp":"2026-02-12T18:08:44.493303+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":44},{"osd":5,"down_stamp":"2026-02-12T18:08:44.493303+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":45},{"osd":6,"down_stamp":"2026-02-12T18:08:44.493303+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":45},{"osd":7,"down_stamp":"2026-02-12T18:08:44.493303+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":44},{"osd":8,"down_stamp":"2026-02-12T18:08:44.493303+0000","laggy_probability":0.50999999046325684,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":46},{"osd":9,"down_stamp":"2026-02-12T18:08:33.466972+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":38}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T18:09:10.943 INFO:tasks.ceph:Scrubbing osd.0 2026-02-12T18:09:10.943 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:09:11.020 INFO:teuthology.orchestra.run.trial060.stdout:{ 2026-02-12T18:09:11.020 INFO:teuthology.orchestra.run.trial060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:09:11.020 INFO:teuthology.orchestra.run.trial060.stdout:} 2026-02-12T18:09:11.030 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-12T18:09:11.185 INFO:teuthology.orchestra.run.trial060.stderr:instructed osd(s) 0 to deep-scrub 2026-02-12T18:09:11.196 INFO:tasks.ceph:Scrubbing osd.1 2026-02-12T18:09:11.197 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:09:11.272 INFO:teuthology.orchestra.run.trial060.stdout:{ 2026-02-12T18:09:11.272 INFO:teuthology.orchestra.run.trial060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:09:11.272 INFO:teuthology.orchestra.run.trial060.stdout:} 2026-02-12T18:09:11.284 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-12T18:09:11.447 INFO:teuthology.orchestra.run.trial060.stderr:instructed osd(s) 1 to deep-scrub 2026-02-12T18:09:11.458 INFO:tasks.ceph:Scrubbing osd.2 2026-02-12T18:09:11.458 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:09:11.535 INFO:teuthology.orchestra.run.trial060.stdout:{ 2026-02-12T18:09:11.536 INFO:teuthology.orchestra.run.trial060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:09:11.536 INFO:teuthology.orchestra.run.trial060.stdout:} 2026-02-12T18:09:11.545 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-12T18:09:11.709 INFO:teuthology.orchestra.run.trial060.stderr:instructed osd(s) 2 to deep-scrub 2026-02-12T18:09:11.720 INFO:tasks.ceph:Scrubbing osd.3 2026-02-12T18:09:11.720 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:09:11.796 INFO:teuthology.orchestra.run.trial060.stdout:{ 2026-02-12T18:09:11.796 INFO:teuthology.orchestra.run.trial060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:09:11.796 INFO:teuthology.orchestra.run.trial060.stdout:} 2026-02-12T18:09:11.805 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-12T18:09:11.962 INFO:teuthology.orchestra.run.trial060.stderr:instructed osd(s) 3 to deep-scrub 2026-02-12T18:09:11.974 INFO:tasks.ceph:Scrubbing osd.4 2026-02-12T18:09:11.974 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:09:12.050 INFO:teuthology.orchestra.run.trial060.stdout:{ 2026-02-12T18:09:12.050 INFO:teuthology.orchestra.run.trial060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:09:12.050 INFO:teuthology.orchestra.run.trial060.stdout:} 2026-02-12T18:09:12.059 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-12T18:09:12.213 INFO:teuthology.orchestra.run.trial060.stderr:instructed osd(s) 4 to deep-scrub 2026-02-12T18:09:12.226 INFO:tasks.ceph:Scrubbing osd.5 2026-02-12T18:09:12.226 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:09:12.309 INFO:teuthology.orchestra.run.trial060.stdout:{ 2026-02-12T18:09:12.309 INFO:teuthology.orchestra.run.trial060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:09:12.309 INFO:teuthology.orchestra.run.trial060.stdout:} 2026-02-12T18:09:12.318 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-12T18:09:12.473 INFO:teuthology.orchestra.run.trial060.stderr:instructed osd(s) 5 to deep-scrub 2026-02-12T18:09:12.485 INFO:tasks.ceph:Scrubbing osd.6 2026-02-12T18:09:12.485 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:09:12.570 INFO:teuthology.orchestra.run.trial060.stdout:{ 2026-02-12T18:09:12.571 INFO:teuthology.orchestra.run.trial060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:09:12.571 INFO:teuthology.orchestra.run.trial060.stdout:} 2026-02-12T18:09:12.583 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-12T18:09:12.744 INFO:teuthology.orchestra.run.trial060.stderr:instructed osd(s) 6 to deep-scrub 2026-02-12T18:09:12.757 INFO:tasks.ceph:Scrubbing osd.7 2026-02-12T18:09:12.757 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:09:12.842 INFO:teuthology.orchestra.run.trial060.stdout:{ 2026-02-12T18:09:12.842 INFO:teuthology.orchestra.run.trial060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:09:12.843 INFO:teuthology.orchestra.run.trial060.stdout:} 2026-02-12T18:09:12.854 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-12T18:09:13.022 INFO:teuthology.orchestra.run.trial060.stderr:instructed osd(s) 7 to deep-scrub 2026-02-12T18:09:13.034 INFO:tasks.ceph:Scrubbing osd.8 2026-02-12T18:09:13.034 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:09:13.110 INFO:teuthology.orchestra.run.trial060.stdout:{ 2026-02-12T18:09:13.110 INFO:teuthology.orchestra.run.trial060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:09:13.110 INFO:teuthology.orchestra.run.trial060.stdout:} 2026-02-12T18:09:13.120 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-12T18:09:13.280 INFO:teuthology.orchestra.run.trial060.stderr:instructed osd(s) 8 to deep-scrub 2026-02-12T18:09:13.292 INFO:tasks.ceph:Scrubbing osd.9 2026-02-12T18:09:13.292 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:09:13.374 INFO:teuthology.orchestra.run.trial060.stdout:{ 2026-02-12T18:09:13.374 INFO:teuthology.orchestra.run.trial060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:09:13.375 INFO:teuthology.orchestra.run.trial060.stdout:} 2026-02-12T18:09:13.386 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-12T18:09:13.542 INFO:teuthology.orchestra.run.trial060.stderr:instructed osd(s) 9 to deep-scrub 2026-02-12T18:09:13.553 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:09:13.708 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:13.709 INFO:teuthology.orchestra.run.trial060.stderr:dumped all 2026-02-12T18:09:13.719 INFO:teuthology.orchestra.run.trial060.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2026-02-12T18:09:13.668116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276448,"kb_used_data":6848,"kb_used_omap":293,"kb_used_meta":269146,"kb_avail":1048299552,"statfs":{"total":1073741824000,"available":1073458741248,"internally_reserved":0,"allocated":7012352,"data_stored":3410608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":300852,"internal_metadata":275605708},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001702"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":82,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:03.118047+0000","last_change":"2026-02-12T18:08:49.902326+0000","last_active":"2026-02-12T18:09:03.118047+0000","last_peered":"2026-02-12T18:09:03.118047+0000","last_clean":"2026-02-12T18:09:03.118047+0000","last_became_active":"2026-02-12T18:08:49.902123+0000","last_became_peered":"2026-02-12T18:08:49.902123+0000","last_unstale":"2026-02-12T18:09:03.118047+0000","last_undegraded":"2026-02-12T18:09:03.118047+0000","last_fullsized":"2026-02-12T18:09:03.118047+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:03:04.261206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027722199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":104,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:03.117871+0000","last_change":"2026-02-12T18:08:48.510355+0000","last_active":"2026-02-12T18:09:03.117871+0000","last_peered":"2026-02-12T18:09:03.117871+0000","last_clean":"2026-02-12T18:09:03.117871+0000","last_became_active":"2026-02-12T18:08:48.509978+0000","last_became_peered":"2026-02-12T18:08:48.509978+0000","last_unstale":"2026-02-12T18:09:03.117871+0000","last_undegraded":"2026-02-12T18:09:03.117871+0000","last_fullsized":"2026-02-12T18:09:03.117871+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:15:49.558001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030204800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":109,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:01.826082+0000","last_change":"2026-02-12T18:09:01.826014+0000","last_active":"2026-02-12T18:09:01.826082+0000","last_peered":"2026-02-12T18:09:01.826082+0000","last_clean":"2026-02-12T18:09:01.826082+0000","last_became_active":"2026-02-12T18:09:01.825826+0000","last_became_peered":"2026-02-12T18:09:01.825826+0000","last_unstale":"2026-02-12T18:09:01.826082+0000","last_undegraded":"2026-02-12T18:09:01.826082+0000","last_fullsized":"2026-02-12T18:09:01.826082+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:41:53.779357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":88,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:01.933586+0000","last_change":"2026-02-12T18:08:59.714071+0000","last_active":"2026-02-12T18:09:01.933586+0000","last_peered":"2026-02-12T18:09:01.933586+0000","last_clean":"2026-02-12T18:09:01.933586+0000","last_became_active":"2026-02-12T18:08:59.713880+0000","last_became_peered":"2026-02-12T18:08:59.713880+0000","last_unstale":"2026-02-12T18:09:01.933586+0000","last_undegraded":"2026-02-12T18:09:01.933586+0000","last_fullsized":"2026-02-12T18:09:01.933586+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:25:12.322281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":104,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:03.118039+0000","last_change":"2026-02-12T18:08:59.541277+0000","last_active":"2026-02-12T18:09:03.118039+0000","last_peered":"2026-02-12T18:09:03.118039+0000","last_clean":"2026-02-12T18:09:03.118039+0000","last_became_active":"2026-02-12T18:08:59.541119+0000","last_became_peered":"2026-02-12T18:08:59.541119+0000","last_unstale":"2026-02-12T18:09:03.118039+0000","last_undegraded":"2026-02-12T18:09:03.118039+0000","last_fullsized":"2026-02-12T18:09:03.118039+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:04:33.745464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":107,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:02.346232+0000","last_change":"2026-02-12T18:08:59.541099+0000","last_active":"2026-02-12T18:09:02.346232+0000","last_peered":"2026-02-12T18:09:02.346232+0000","last_clean":"2026-02-12T18:09:02.346232+0000","last_became_active":"2026-02-12T18:08:59.540942+0000","last_became_peered":"2026-02-12T18:08:59.540942+0000","last_unstale":"2026-02-12T18:09:02.346232+0000","last_undegraded":"2026-02-12T18:09:02.346232+0000","last_fullsized":"2026-02-12T18:09:02.346232+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:45.164694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057906899999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":84,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:03.118273+0000","last_change":"2026-02-12T18:08:49.511896+0000","last_active":"2026-02-12T18:09:03.118273+0000","last_peered":"2026-02-12T18:09:03.118273+0000","last_clean":"2026-02-12T18:09:03.118273+0000","last_became_active":"2026-02-12T18:08:49.511747+0000","last_became_peered":"2026-02-12T18:08:49.511747+0000","last_unstale":"2026-02-12T18:09:03.118273+0000","last_undegraded":"2026-02-12T18:09:03.118273+0000","last_fullsized":"2026-02-12T18:09:03.118273+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:09:54.305249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028142899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:02.716855+0000","last_change":"2026-02-12T18:08:48.509928+0000","last_active":"2026-02-12T18:09:02.716855+0000","last_peered":"2026-02-12T18:09:02.716855+0000","last_clean":"2026-02-12T18:09:02.716855+0000","last_became_active":"2026-02-12T18:08:48.509745+0000","last_became_peered":"2026-02-12T18:08:48.509745+0000","last_unstale":"2026-02-12T18:09:02.716855+0000","last_undegraded":"2026-02-12T18:09:02.716855+0000","last_fullsized":"2026-02-12T18:09:02.716855+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:07:50.669839+0000","last_clean_scrub_stamp":"2026-02-12T18:07:50.669839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:54:40.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":40,"seq":171798691860,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28398,"internal_metadata":27562258},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462932,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462931,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31643,"internal_metadata":27559013},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462931,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29694,"internal_metadata":27560962},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462931,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32950,"internal_metadata":27557706},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":47,"seq":201863462931,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27648,"kb_used_data":688,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829952,"statfs":{"total":107374182400,"available":107345870848,"internally_reserved":0,"allocated":704512,"data_stored":341076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30997,"internal_metadata":27559659},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":48,"seq":206158430228,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29692,"internal_metadata":27560964},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":58,"seq":249108103188,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27648,"kb_used_data":688,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829952,"statfs":{"total":107374182400,"available":107345870848,"internally_reserved":0,"allocated":704512,"data_stored":341076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30346,"internal_metadata":27560310},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":60,"seq":257698037780,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:09:13.725 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-12T18:07:50.669839+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=7, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=9, tm_sec=9, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:09:13.726 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-12T18:07:50.669839+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=7, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=9, tm_sec=9, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:09:13.726 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-12T18:07:50.669839+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=7, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=9, tm_sec=9, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:09:13.726 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-12T18:07:50.669839+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=7, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=9, tm_sec=9, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:09:13.726 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-12T18:07:50.669839+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=7, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=9, tm_sec=9, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:09:13.726 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-12T18:07:50.669839+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=7, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=9, tm_sec=9, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:09:13.727 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-12T18:07:50.669839+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=7, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=9, tm_sec=9, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:09:13.727 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-12T18:07:50.669839+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=7, tm_sec=50, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=9, tm_sec=9, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:09:13.727 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-12T18:09:33.727 DEBUG:teuthology.orchestra.run.trial060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:09:33.883 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-12T18:09:33.883 INFO:teuthology.orchestra.run.trial060.stderr:dumped all 2026-02-12T18:09:33.893 INFO:teuthology.orchestra.run.trial060.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2026-02-12T18:09:33.669964+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":276448,"kb_used_data":6848,"kb_used_omap":293,"kb_used_meta":269146,"kb_avail":1048299552,"statfs":{"total":1073741824000,"available":1073458741248,"internally_reserved":0,"allocated":7012352,"data_stored":3410608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":300852,"internal_metadata":275605708},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001063"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:13.266079+0000","last_change":"2026-02-12T18:09:13.266079+0000","last_active":"2026-02-12T18:09:13.266079+0000","last_peered":"2026-02-12T18:09:13.266079+0000","last_clean":"2026-02-12T18:09:13.266079+0000","last_became_active":"2026-02-12T18:08:49.902123+0000","last_became_peered":"2026-02-12T18:08:49.902123+0000","last_unstale":"2026-02-12T18:09:13.266079+0000","last_undegraded":"2026-02-12T18:09:13.266079+0000","last_fullsized":"2026-02-12T18:09:13.266079+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:09:13.266011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:09:13.266011+0000","last_clean_scrub_stamp":"2026-02-12T18:09:13.266011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:35:18.124387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027722199999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":112,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:12.855175+0000","last_change":"2026-02-12T18:09:12.855175+0000","last_active":"2026-02-12T18:09:12.855175+0000","last_peered":"2026-02-12T18:09:12.855175+0000","last_clean":"2026-02-12T18:09:12.855175+0000","last_became_active":"2026-02-12T18:08:48.509978+0000","last_became_peered":"2026-02-12T18:08:48.509978+0000","last_unstale":"2026-02-12T18:09:12.855175+0000","last_undegraded":"2026-02-12T18:09:12.855175+0000","last_fullsized":"2026-02-12T18:09:12.855175+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:09:12.855137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:09:12.855137+0000","last_clean_scrub_stamp":"2026-02-12T18:09:12.855137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:13:09.657244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030204800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":117,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:13.587879+0000","last_change":"2026-02-12T18:09:13.587879+0000","last_active":"2026-02-12T18:09:13.587879+0000","last_peered":"2026-02-12T18:09:13.587879+0000","last_clean":"2026-02-12T18:09:13.587879+0000","last_became_active":"2026-02-12T18:09:01.825826+0000","last_became_peered":"2026-02-12T18:09:01.825826+0000","last_unstale":"2026-02-12T18:09:13.587879+0000","last_undegraded":"2026-02-12T18:09:13.587879+0000","last_fullsized":"2026-02-12T18:09:13.587879+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:09:13.587833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:09:13.587833+0000","last_clean_scrub_stamp":"2026-02-12T18:09:13.587833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:23:46.817943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030487299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:11.888616+0000","last_change":"2026-02-12T18:09:11.888616+0000","last_active":"2026-02-12T18:09:11.888616+0000","last_peered":"2026-02-12T18:09:11.888616+0000","last_clean":"2026-02-12T18:09:11.888616+0000","last_became_active":"2026-02-12T18:08:59.713880+0000","last_became_peered":"2026-02-12T18:08:59.713880+0000","last_unstale":"2026-02-12T18:09:11.888616+0000","last_undegraded":"2026-02-12T18:09:11.888616+0000","last_fullsized":"2026-02-12T18:09:11.888616+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:09:11.888572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:09:11.888572+0000","last_clean_scrub_stamp":"2026-02-12T18:09:11.888572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:05:54.964198+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"61'2","reported_seq":113,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:12.314598+0000","last_change":"2026-02-12T18:09:12.314598+0000","last_active":"2026-02-12T18:09:12.314598+0000","last_peered":"2026-02-12T18:09:12.314598+0000","last_clean":"2026-02-12T18:09:12.314598+0000","last_became_active":"2026-02-12T18:08:59.541119+0000","last_became_peered":"2026-02-12T18:08:59.541119+0000","last_unstale":"2026-02-12T18:09:12.314598+0000","last_undegraded":"2026-02-12T18:09:12.314598+0000","last_fullsized":"2026-02-12T18:09:12.314598+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2026-02-12T18:09:12.314561+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2026-02-12T18:09:12.314561+0000","last_clean_scrub_stamp":"2026-02-12T18:09:12.314561+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:39:16.475935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"61'3","reported_seq":116,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:12.842835+0000","last_change":"2026-02-12T18:09:12.842835+0000","last_active":"2026-02-12T18:09:12.842835+0000","last_peered":"2026-02-12T18:09:12.842835+0000","last_clean":"2026-02-12T18:09:12.842835+0000","last_became_active":"2026-02-12T18:08:59.540942+0000","last_became_peered":"2026-02-12T18:08:59.540942+0000","last_unstale":"2026-02-12T18:09:12.842835+0000","last_undegraded":"2026-02-12T18:09:12.842835+0000","last_fullsized":"2026-02-12T18:09:12.842835+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'3","last_scrub_stamp":"2026-02-12T18:09:12.842788+0000","last_deep_scrub":"61'3","last_deep_scrub_stamp":"2026-02-12T18:09:12.842788+0000","last_clean_scrub_stamp":"2026-02-12T18:09:12.842788+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:34:51.080484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057906899999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:13.277041+0000","last_change":"2026-02-12T18:09:13.277041+0000","last_active":"2026-02-12T18:09:13.277041+0000","last_peered":"2026-02-12T18:09:13.277041+0000","last_clean":"2026-02-12T18:09:13.277041+0000","last_became_active":"2026-02-12T18:08:49.511747+0000","last_became_peered":"2026-02-12T18:08:49.511747+0000","last_unstale":"2026-02-12T18:09:13.277041+0000","last_undegraded":"2026-02-12T18:09:13.277041+0000","last_fullsized":"2026-02-12T18:09:13.277041+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:09:13.277004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:09:13.277004+0000","last_clean_scrub_stamp":"2026-02-12T18:09:13.277004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:12:02.214773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028142899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":108,"reported_epoch":61,"state":"active+clean","last_fresh":"2026-02-12T18:09:12.979923+0000","last_change":"2026-02-12T18:09:12.979923+0000","last_active":"2026-02-12T18:09:12.979923+0000","last_peered":"2026-02-12T18:09:12.979923+0000","last_clean":"2026-02-12T18:09:12.979923+0000","last_became_active":"2026-02-12T18:08:48.509745+0000","last_became_peered":"2026-02-12T18:08:48.509745+0000","last_unstale":"2026-02-12T18:09:12.979923+0000","last_undegraded":"2026-02-12T18:09:12.979923+0000","last_fullsized":"2026-02-12T18:09:12.979923+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:09:12.979878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:09:12.979878+0000","last_clean_scrub_stamp":"2026-02-12T18:09:12.979878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:27:04.134551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":40,"seq":171798691864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28398,"internal_metadata":27562258},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":47,"seq":201863462936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31643,"internal_metadata":27559013},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462935,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29694,"internal_metadata":27560962},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":47,"seq":201863462935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32950,"internal_metadata":27557706},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":47,"seq":201863462935,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27648,"kb_used_data":688,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":104829952,"statfs":{"total":107374182400,"available":107345870848,"internally_reserved":0,"allocated":704512,"data_stored":341076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30997,"internal_metadata":27559659},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":48,"seq":206158430232,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29692,"internal_metadata":27560964},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":47,"seq":201863462935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29695,"internal_metadata":27560961},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":58,"seq":249108103192,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27648,"kb_used_data":688,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":104829952,"statfs":{"total":107374182400,"available":107345870848,"internally_reserved":0,"allocated":704512,"data_stored":341076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30346,"internal_metadata":27560310},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":60,"seq":257698037784,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27644,"kb_used_data":684,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104829956,"statfs":{"total":107374182400,"available":107345874944,"internally_reserved":0,"allocated":700416,"data_stored":341057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27742,"internal_metadata":27562914},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:09:33.895 DEBUG:teuthology.orchestra.run.trial060:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-12T18:09:34.058 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-12T18:09:34.058 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-12T18:09:34.058 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-12T18:09:34.058 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:09:34.135 INFO:tasks.ceph.osd.0:Stopped 2026-02-12T18:09:34.136 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-12T18:09:34.136 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:09:34.219 INFO:tasks.ceph.osd.1:Stopped 2026-02-12T18:09:34.219 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-12T18:09:34.220 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:09:34.298 INFO:tasks.ceph.osd.2:Stopped 2026-02-12T18:09:34.298 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-12T18:09:34.299 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:09:39.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-12T18:09:40.400 INFO:tasks.ceph.osd.3:Stopped 2026-02-12T18:09:40.400 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-12T18:09:40.400 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:09:40.455 INFO:tasks.ceph.osd.4:Stopped 2026-02-12T18:09:40.456 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-12T18:09:40.456 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:09:40.527 INFO:tasks.ceph.osd.5:Stopped 2026-02-12T18:09:40.527 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-12T18:09:40.527 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:09:40.599 INFO:tasks.ceph.osd.6:Stopped 2026-02-12T18:09:40.599 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-12T18:09:40.599 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:09:40.690 INFO:tasks.ceph.osd.7:Stopped 2026-02-12T18:09:40.690 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-12T18:09:40.691 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:09:40.778 INFO:tasks.ceph.osd.8:Stopped 2026-02-12T18:09:40.778 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-12T18:09:40.778 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:09:45.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 is failed for ~0s 2026-02-12T18:09:45.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2026-02-12T18:09:46.880 INFO:tasks.ceph.osd.9:Stopped 2026-02-12T18:09:46.880 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-12T18:09:46.881 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-12T18:09:46.881 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:09:46.922 INFO:tasks.ceph.mgr.x:Stopped 2026-02-12T18:09:46.922 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-12T18:09:46.923 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-12T18:09:46.923 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:09:46.936 INFO:tasks.ceph.mon.a:Stopped 2026-02-12T18:09:46.936 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-12T18:09:46.937 DEBUG:teuthology.orchestra.run.trial060:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v 'but it is still running' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2026-02-12T18:09:46.988 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial060.front.sepia.ceph.com 2026-02-12T18:09:46.989 DEBUG:teuthology.orchestra.run.trial060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-12T18:09:47.042 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial060.front.sepia.ceph.com 2026-02-12T18:09:47.042 DEBUG:teuthology.orchestra.run.trial060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-12T18:09:47.098 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial060.front.sepia.ceph.com 2026-02-12T18:09:47.099 DEBUG:teuthology.orchestra.run.trial060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-12T18:09:47.149 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial060.front.sepia.ceph.com 2026-02-12T18:09:47.149 DEBUG:teuthology.orchestra.run.trial060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-12T18:09:47.205 INFO:tasks.ceph:Archiving mon data... 2026-02-12T18:09:47.207 DEBUG:teuthology.misc:Transferring archived files from trial060:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46509/data/mon.a.tgz 2026-02-12T18:09:47.207 DEBUG:teuthology.orchestra.run.trial060:> mktemp 2026-02-12T18:09:47.251 INFO:teuthology.orchestra.run.trial060.stdout:/tmp/tmp.OAAxT8Nup0 2026-02-12T18:09:47.251 DEBUG:teuthology.orchestra.run.trial060:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OAAxT8Nup0 2026-02-12T18:09:47.328 DEBUG:teuthology.orchestra.run.trial060:> sudo chmod 0666 /tmp/tmp.OAAxT8Nup0 2026-02-12T18:09:47.424 DEBUG:teuthology.orchestra.remote:trial060:/tmp/tmp.OAAxT8Nup0 is 224KB 2026-02-12T18:09:47.481 DEBUG:teuthology.orchestra.run.trial060:> rm -fr /tmp/tmp.OAAxT8Nup0 2026-02-12T18:09:47.485 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-12T18:09:47.485 DEBUG:teuthology.orchestra.run.trial060:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T18:09:47.582 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T18:09:47.583 INFO:tasks.ceph:Archiving crash dumps... 2026-02-12T18:09:47.585 DEBUG:teuthology.misc:Transferring archived files from trial060:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46509/remote/trial060/crash 2026-02-12T18:09:47.586 DEBUG:teuthology.orchestra.run.trial060:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T18:09:47.631 INFO:tasks.ceph:Compressing logs... 2026-02-12T18:09:47.631 DEBUG:teuthology.orchestra.run.trial060:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T18:09:47.683 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21201.log 2026-02-12T18:09:47.687 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20794.log 2026-02-12T18:09:47.687 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20722.log 2026-02-12T18:09:47.687 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21201.log.gz 2026-02-12T18:09:47.688 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20794.log.gz 2026-02-12T18:09:47.688 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20880.log 2026-02-12T18:09:47.688 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23974.log 2026-02-12T18:09:47.688 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20722.log: /var/log/ceph/ceph-client.admin.20880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20722.log.gz 2026-02-12T18:09:47.688 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20880.log.gz 2026-02-12T18:09:47.688 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21862.log 2026-02-12T18:09:47.688 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23116.log 2026-02-12T18:09:47.689 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23974.log: /var/log/ceph/ceph-client.admin.21862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23974.log.gz 2026-02-12T18:09:47.689 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21862.log.gz 2026-02-12T18:09:47.689 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22979.log 2026-02-12T18:09:47.689 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23870.log 2026-02-12T18:09:47.689 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23116.log.gz 2026-02-12T18:09:47.689 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22979.log.gz 2026-02-12T18:09:47.689 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21652.log 2026-02-12T18:09:47.689 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23870.log.gz 2026-02-12T18:09:47.689 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22929.log 2026-02-12T18:09:47.689 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23998.log 2026-02-12T18:09:47.689 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21652.log.gz 2026-02-12T18:09:47.689 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23506.log 2026-02-12T18:09:47.690 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22929.log: /var/log/ceph/ceph-client.admin.23998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23998.log.gz 2026-02-12T18:09:47.690 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.21984.log 2026-02-12T18:09:47.690 INFO:teuthology.orchestra.run.trial060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.22929.log.gz 2026-02-12T18:09:47.690 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23506.log.gz 2026-02-12T18:09:47.690 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21758.log 2026-02-12T18:09:47.701 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16463.log 2026-02-12T18:09:47.701 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21984.log.gz 2026-02-12T18:09:47.701 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21758.log.gz 2026-02-12T18:09:47.702 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22880.log 2026-02-12T18:09:47.702 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22633.log 2026-02-12T18:09:47.702 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.16463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.16463.log.gz 2026-02-12T18:09:47.702 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22880.log.gz 2026-02-12T18:09:47.702 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23844.log 2026-02-12T18:09:47.702 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23948.log 2026-02-12T18:09:47.702 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22633.log.gz 2026-02-12T18:09:47.702 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23246.log 2026-02-12T18:09:47.702 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23844.log.gz 2026-02-12T18:09:47.702 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21420.log 2026-02-12T18:09:47.702 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23948.log.gz 2026-02-12T18:09:47.703 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21418.log 2026-02-12T18:09:47.703 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23246.log.gz 2026-02-12T18:09:47.703 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21420.log.gz 2026-02-12T18:09:47.703 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-12T18:09:47.703 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22009.log 2026-02-12T18:09:47.703 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21418.log.gz 2026-02-12T18:09:47.703 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23766.log 2026-02-12T18:09:47.703 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20864.log 2026-02-12T18:09:47.703 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22009.log.gz 2026-02-12T18:09:47.703 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20820.log 2026-02-12T18:09:47.704 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23766.log.gz 2026-02-12T18:09:47.704 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22954.log 2026-02-12T18:09:47.704 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20864.log.gz 2026-02-12T18:09:47.704 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23055.log 2026-02-12T18:09:47.704 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20820.log.gz 2026-02-12T18:09:47.704 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22954.log.gz 2026-02-12T18:09:47.704 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21199.log 2026-02-12T18:09:47.704 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22683.log 2026-02-12T18:09:47.704 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23055.log: /var/log/ceph/ceph-client.admin.21199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23055.log.gz 2026-02-12T18:09:47.704 INFO:teuthology.orchestra.run.trial060.stderr:gzip 0.0% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.21199.log.gz /var/log/ceph/ceph-client.admin.23081.log 2026-02-12T18:09:47.704 INFO:teuthology.orchestra.run.trial060.stderr: 2026-02-12T18:09:47.705 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22708.log 2026-02-12T18:09:47.705 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22683.log: /var/log/ceph/ceph-client.admin.23081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22683.log.gz 2026-02-12T18:09:47.705 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23081.log.gz 2026-02-12T18:09:47.705 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23272.log 2026-02-12T18:09:47.705 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21108.log 2026-02-12T18:09:47.705 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22708.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-12T18:09:47.705 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22708.log.gz 2026-02-12T18:09:47.705 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23272.log: /var/log/ceph/ceph-client.admin.21108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23272.log.gz 2026-02-12T18:09:47.705 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22856.log 2026-02-12T18:09:47.705 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21108.log.gz 2026-02-12T18:09:47.705 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20871.log 2026-02-12T18:09:47.705 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-12T18:09:47.705 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22856.log.gz 2026-02-12T18:09:47.706 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20871.log.gz 2026-02-12T18:09:47.706 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-12T18:09:47.706 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20865.log 2026-02-12T18:09:47.706 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-12T18:09:47.706 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20876.log 2026-02-12T18:09:47.706 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20865.log.gz 2026-02-12T18:09:47.706 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22832.log 2026-02-12T18:09:47.706 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20876.log.gz 2026-02-12T18:09:47.706 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22083.log 2026-02-12T18:09:47.706 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22808.log 2026-02-12T18:09:47.706 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22832.log.gz 2026-02-12T18:09:47.706 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22083.log.gz 2026-02-12T18:09:47.706 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21196.log 2026-02-12T18:09:47.707 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23194.log 2026-02-12T18:09:47.707 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22808.log.gz 2026-02-12T18:09:47.707 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22658.log 2026-02-12T18:09:47.707 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21196.log.gz 2026-02-12T18:09:47.707 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23194.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-12T18:09:47.707 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23194.log.gz 2026-02-12T18:09:47.707 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21419.log 2026-02-12T18:09:47.707 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22658.log.gz 2026-02-12T18:09:47.707 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23428.log 2026-02-12T18:09:47.707 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23376.log 2026-02-12T18:09:47.707 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21419.log.gz 2026-02-12T18:09:47.707 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23896.log 2026-02-12T18:09:47.707 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23428.log.gz 2026-02-12T18:09:47.708 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23376.log.gz 2026-02-12T18:09:47.708 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-12T18:09:47.708 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22433.log 2026-02-12T18:09:47.708 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23896.log.gz 2026-02-12T18:09:47.708 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21198.log 2026-02-12T18:09:47.722 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22584.log 2026-02-12T18:09:47.722 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22433.log.gz 2026-02-12T18:09:47.722 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21810.log 2026-02-12T18:09:47.722 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21198.log.gz 2026-02-12T18:09:47.722 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22584.log.gz 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23636.log 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15858.log 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21810.log.gz 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23636.log.gz 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21935.log 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20882.log 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15858.log.gz 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21935.log.gz 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22904.log 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15916.log 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20882.log.gz 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22904.log.gz 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21886.log 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20742.log 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15916.log.gz 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21886.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.21886.log.gz --verbose 2026-02-12T18:09:47.723 INFO:teuthology.orchestra.run.trial060.stderr: -- /var/log/ceph/ceph-client.admin.20672.log 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21417.log 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20742.log.gz 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22759.log 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20672.log.gz 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15834.log 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21417.log.gz 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22759.log.gz 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22034.log 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22560.log 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15834.log.gz 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22034.log: /var/log/ceph/ceph-client.admin.22560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22034.log.gz 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22560.log.gz 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22208.log 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21379.log 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23818.log 2026-02-12T18:09:47.724 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22208.log.gz 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22485.log 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21379.log.gz 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23818.log.gz 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23298.log 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.22485.log: /var/log/ceph/ceph-client.admin.23558.log 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22485.log.gz 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23298.log.gz 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23714.log 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15762.log 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23558.log.gz 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23324.log 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23714.log.gz 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21376.log 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15762.log: 0.0%/var/log/ceph/ceph-client.admin.23324.log: -- replaced with /var/log/ceph/ceph-client.admin.15762.log.gz 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23324.log.gz 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15690.log 2026-02-12T18:09:47.725 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22059.log 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21376.log.gz 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15690.log.gz 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21114.log 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23220.log 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22059.log.gz 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21114.log.gz 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15641.log 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21118.log 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23220.log.gz 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15641.log.gz 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22333.log 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21118.log.gz 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21222.log 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23168.log 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22333.log.gz 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21222.log.gz 2026-02-12T18:09:47.726 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23168.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23168.log.gz 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20879.log 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22535.log 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20768.log 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20879.log.gz 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22459.log 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22535.log.gz 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20768.log.gz 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23350.log 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22459.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22459.log.gz 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23350.log.gz 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23792.log 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22184.log 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22135.log 2026-02-12T18:09:47.727 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23792.log.gz 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22184.log.gz 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21366.log 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23922.log 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22135.log.gz 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21366.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.21366.log.gz --verbose 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr: -- /var/log/ceph/ceph-client.admin.21197.log 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23922.log.gz 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21786.log 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21197.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21197.log.gz 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20697.log 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21786.log: /var/log/ceph/ceph-osd.4.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21786.log.gz 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22733.log 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22358.log 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20697.log.gz 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20867.log 2026-02-12T18:09:47.728 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22733.log.gz 2026-02-12T18:09:47.729 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22358.log.gz 2026-02-12T18:09:47.729 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15714.log 2026-02-12T18:09:47.737 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15483.log 2026-02-12T18:09:47.737 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20867.log.gz 2026-02-12T18:09:47.737 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15714.log.gz 2026-02-12T18:09:47.737 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21113.log 2026-02-12T18:09:47.737 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15483.log.gz 2026-02-12T18:09:47.737 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23662.log 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21482.log 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21113.log.gz 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23402.log 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23662.log.gz 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23454.log 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21482.log.gz 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22258.log 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23402.log.gz 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23454.log.gz 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21678.log 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23028.log 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22258.log.gz 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21678.log.gz 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23688.log 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23028.log.gz 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23142.log 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5/var/log/ceph/ceph-client.admin.23688.log: --verbose -- /var/log/ceph/ceph-client.admin.15665.log 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23688.log.gz 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23142.log.gz 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20869.log 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20881.log 2026-02-12T18:09:47.738 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15665.log.gz 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20869.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20869.log.gz 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.20881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20881.log.gz 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21378.log 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23004.log 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22608.log 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21378.log.gz 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23004.log.gz 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22407.log 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21421.log 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22608.log.gz 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22407.log.gz 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22308.log 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21421.log.gz 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21626.log 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22308.log.gz 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22784.log 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21626.log.gz 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15597.log 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22784.log.gz 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22160.log 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15597.log.gz 2026-02-12T18:09:47.739 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21959.log 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22232.log 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22160.log.gz 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21959.log.gz 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15738.log 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15549.log 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22232.log.gz 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15810.log 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15738.log.gz 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23584.log 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15549.log.gz 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15810.log.gz 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21911.log 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23584.log.gz 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22383.log 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.21911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21911.log.gz 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15786.log 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23740.log 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22383.log.gz 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.15786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23610.log 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.15786.log.gz 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23740.log.gz 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22510.log 2026-02-12T18:09:47.740 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23480.log 2026-02-12T18:09:47.741 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23610.log.gz 2026-02-12T18:09:47.741 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22510.log.gz 2026-02-12T18:09:47.741 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22283.log 2026-02-12T18:09:47.741 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23532.log 2026-02-12T18:09:47.741 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23480.log.gz 2026-02-12T18:09:47.741 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22109.log 2026-02-12T18:09:47.741 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22283.log.gz 2026-02-12T18:09:47.741 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.23532.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.7542.log 2026-02-12T18:09:47.741 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23532.log.gz 2026-02-12T18:09:47.741 INFO:teuthology.orchestra.run.trial060.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-12T18:09:47.741 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph-client.admin.22109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22109.log.gz 2026-02-12T18:09:47.741 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/ceph.tmp-client.admin.7542.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.7542.log.gz 2026-02-12T18:09:47.742 INFO:teuthology.orchestra.run.trial060.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-12T18:09:47.756 INFO:teuthology.orchestra.run.trial060.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-12T18:09:47.769 INFO:teuthology.orchestra.run.trial060.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-12T18:09:47.769 INFO:teuthology.orchestra.run.trial060.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-12T18:09:47.793 INFO:teuthology.orchestra.run.trial060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-12T18:09:47.794 INFO:teuthology.orchestra.run.trial060.stderr: 2026-02-12T18:09:47.794 INFO:teuthology.orchestra.run.trial060.stderr:real 0m0.117s 2026-02-12T18:09:47.794 INFO:teuthology.orchestra.run.trial060.stderr:user 0m0.528s 2026-02-12T18:09:47.794 INFO:teuthology.orchestra.run.trial060.stderr:sys 0m0.060s 2026-02-12T18:09:47.795 INFO:tasks.ceph:Archiving logs... 2026-02-12T18:09:47.795 DEBUG:teuthology.misc:Transferring archived files from trial060:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46509/remote/trial060/log 2026-02-12T18:09:47.796 DEBUG:teuthology.orchestra.run.trial060:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T18:09:47.993 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T18:09:48.005 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-12T18:09:48.005 DEBUG:teuthology.orchestra.run.trial060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T18:09:48.096 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-12T18:09:48.108 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-12T18:09:48.108 DEBUG:teuthology.orchestra.run.trial060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T18:09:48.116 INFO:teuthology.orchestra.run.trial060.stdout: remote refid st t when poll reach delay offset jitter 2026-02-12T18:09:48.116 INFO:teuthology.orchestra.run.trial060.stdout:============================================================================== 2026-02-12T18:09:48.116 INFO:teuthology.orchestra.run.trial060.stdout: sushi.ruselabs. 2.148.140.233 2 u 62 64 7 73.114 +1.299 0.817 2026-02-12T18:09:48.116 INFO:teuthology.orchestra.run.trial060.stdout: dns-e.ns4v.icu 242.71.143.169 2 u 62 64 7 62.327 -1.530 1.493 2026-02-12T18:09:48.117 INFO:teuthology.orchestra.run.trial060.stdout: clock02.cymru.c 128.252.19.1 2 u 61 64 7 109.292 +10.427 1.673 2026-02-12T18:09:48.117 INFO:teuthology.orchestra.run.trial060.stdout: ntp1.wiktel.com .PPS. 1 u 65 64 7 38.772 +3.007 1.325 2026-02-12T18:09:48.117 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-12T18:09:48.128 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-12T18:09:48.129 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-12T18:09:48.142 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-12T18:09:48.154 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-12T18:09:48.168 INFO:teuthology.task.internal:Duration was 266.168244 seconds 2026-02-12T18:09:48.169 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-12T18:09:48.181 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-12T18:09:48.181 DEBUG:teuthology.orchestra.run.trial060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T18:09:48.205 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-12T18:09:48.205 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial060.front.sepia.ceph.com 2026-02-12T18:09:48.205 DEBUG:teuthology.orchestra.run.trial060:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T18:09:48.252 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-12T18:09:48.252 DEBUG:teuthology.orchestra.run.trial060:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T18:09:48.430 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-12T18:09:48.431 DEBUG:teuthology.orchestra.run.trial060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T18:09:48.439 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T18:09:48.439 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T18:09:48.439 INFO:teuthology.orchestra.run.trial060.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T18:09:48.439 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T18:09:48.440 INFO:teuthology.orchestra.run.trial060.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T18:09:48.481 INFO:teuthology.orchestra.run.trial060.stderr: 82.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T18:09:48.483 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-12T18:09:48.498 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-12T18:09:48.499 DEBUG:teuthology.orchestra.run.trial060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T18:09:48.531 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-12T18:09:48.543 DEBUG:teuthology.orchestra.run.trial060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T18:09:48.582 INFO:teuthology.orchestra.run.trial060.stdout:kernel.core_pattern = core 2026-02-12T18:09:48.591 DEBUG:teuthology.orchestra.run.trial060:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T18:09:48.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T18:09:48.638 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-12T18:09:48.653 INFO:teuthology.task.internal:Transferring archived files... 2026-02-12T18:09:48.654 DEBUG:teuthology.misc:Transferring archived files from trial060:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46509/remote/trial060 2026-02-12T18:09:48.654 DEBUG:teuthology.orchestra.run.trial060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T18:09:48.705 INFO:teuthology.task.internal:Removing archive directory... 2026-02-12T18:09:48.705 DEBUG:teuthology.orchestra.run.trial060:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T18:09:48.739 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-12T18:09:48.756 INFO:teuthology.task.internal:Not uploading archives. 2026-02-12T18:09:48.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-12T18:09:48.773 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-12T18:09:48.774 DEBUG:teuthology.orchestra.run.trial060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T18:09:48.787 INFO:teuthology.orchestra.run.trial060.stdout: 1180220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 18:09 /home/ubuntu/cephtest 2026-02-12T18:09:48.788 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T18:09:48.805 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T18:09:48.835 INFO:teuthology.run:Summary data: description: rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} duration: 266.1682438850403 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-12T18:09:48.835 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:09:48.944 INFO:teuthology.run:pass