2026-02-17T00:29:59.590 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-17T00:29:59.605 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T00:29:59.682 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48611 branch: wip-ifed-fix-vselector-in-envmode_index_file description: rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} email: akupczyk@ibm.com first_in_suite: false flavor: default job_id: '48611' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-ifed-fix-vselector-in-envmode_index_file ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 30 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd debug verify cached snaps: true osd debug verify missing on start: true osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd op queue: debug_random osd op queue cut off: debug_random flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 03ef619e79a56cd363b087a5c6f19a1a09b49040 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 03ef619e79a56cd363b087a5c6f19a1a09b49040 workunit: branch: wip-ifed-fix-vselector-in-envmode_index_file sha1: 03ef619e79a56cd363b087a5c6f19a1a09b49040 owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - osd.4 - osd.5 - osd.6 - osd.7 - osd.8 - osd.9 - client.0 seed: 6708 sha1: 03ef619e79a56cd363b087a5c6f19a1a09b49040 sleep_before_teardown: 0 subset: 582/12264 suite: rados suite_branch: wip-ifed-fix-vselector-in-envmode_index_file suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_03ef619e79a56cd363b087a5c6f19a1a09b49040/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 03ef619e79a56cd363b087a5c6f19a1a09b49040 targets: trial124.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLXLn+foLJS976cdzrBvCN8qzUyNiT2wISIDvfy6OEOpVKK3IHDIN+cStb9nx2oTf6hLnUbtJR4ju7e84/0mPbs= tasks: - install: null - ceph: conf: osd: osd max object name len: 400 osd max object namespace len: 64 log-ignorelist: - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - workunit: clients: all: - rados/test_health_warnings.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-13_08:57:15 tube: trial user: jayaprakash verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T00:29:59.682 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_03ef619e79a56cd363b087a5c6f19a1a09b49040/qa; will attempt to use it 2026-02-17T00:29:59.682 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_03ef619e79a56cd363b087a5c6f19a1a09b49040/qa/tasks 2026-02-17T00:29:59.682 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T00:29:59.684 INFO:teuthology.task.internal:Checking packages... 2026-02-17T00:29:59.684 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '03ef619e79a56cd363b087a5c6f19a1a09b49040' 2026-02-17T00:29:59.684 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T00:29:59.684 INFO:teuthology.packaging:ref: None 2026-02-17T00:29:59.684 INFO:teuthology.packaging:tag: None 2026-02-17T00:29:59.684 INFO:teuthology.packaging:branch: wip-ifed-fix-vselector-in-envmode_index_file 2026-02-17T00:29:59.684 INFO:teuthology.packaging:sha1: 03ef619e79a56cd363b087a5c6f19a1a09b49040 2026-02-17T00:29:59.684 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-ifed-fix-vselector-in-envmode_index_file 2026-02-17T00:29:59.803 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5225-g03ef619e-1jammy 2026-02-17T00:29:59.804 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T00:29:59.816 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T00:29:59.816 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T00:29:59.834 INFO:teuthology.task.internal:Saving configuration 2026-02-17T00:29:59.842 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T00:29:59.855 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T00:29:59.933 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial124.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48611', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 00:26:30.984873', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIK56ZpA7cXf9bOKIEviblpjH60zYYbDA5FB1LWQrQTWS'} 2026-02-17T00:29:59.933 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T00:29:59.948 INFO:teuthology.task.internal:roles: ubuntu@trial124.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'osd.8', 'osd.9', 'client.0'] 2026-02-17T00:29:59.948 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T00:30:00.037 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ed509bf9bc0>, signals=[15]) 2026-02-17T00:30:00.037 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T00:30:00.048 INFO:teuthology.task.internal:Opening connections... 2026-02-17T00:30:00.048 DEBUG:teuthology.task.internal:connecting to ubuntu@trial124.front.sepia.ceph.com 2026-02-17T00:30:00.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:30:00.114 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T00:30:00.126 DEBUG:teuthology.orchestra.run.trial124:> uname -m 2026-02-17T00:30:00.192 INFO:teuthology.orchestra.run.trial124.stdout:x86_64 2026-02-17T00:30:00.192 DEBUG:teuthology.orchestra.run.trial124:> cat /etc/os-release 2026-02-17T00:30:00.239 INFO:teuthology.orchestra.run.trial124.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-17T00:30:00.239 INFO:teuthology.orchestra.run.trial124.stdout:NAME="Ubuntu" 2026-02-17T00:30:00.239 INFO:teuthology.orchestra.run.trial124.stdout:VERSION_ID="22.04" 2026-02-17T00:30:00.239 INFO:teuthology.orchestra.run.trial124.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-17T00:30:00.239 INFO:teuthology.orchestra.run.trial124.stdout:VERSION_CODENAME=jammy 2026-02-17T00:30:00.239 INFO:teuthology.orchestra.run.trial124.stdout:ID=ubuntu 2026-02-17T00:30:00.239 INFO:teuthology.orchestra.run.trial124.stdout:ID_LIKE=debian 2026-02-17T00:30:00.239 INFO:teuthology.orchestra.run.trial124.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-17T00:30:00.240 INFO:teuthology.orchestra.run.trial124.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-17T00:30:00.240 INFO:teuthology.orchestra.run.trial124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-17T00:30:00.240 INFO:teuthology.orchestra.run.trial124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-17T00:30:00.240 INFO:teuthology.orchestra.run.trial124.stdout:UBUNTU_CODENAME=jammy 2026-02-17T00:30:00.240 INFO:teuthology.lock.ops:Updating trial124.front.sepia.ceph.com on lock server 2026-02-17T00:30:00.331 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T00:30:00.343 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T00:30:00.355 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T00:30:00.355 DEBUG:teuthology.orchestra.run.trial124:> test '!' -e /home/ubuntu/cephtest 2026-02-17T00:30:00.358 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T00:30:00.369 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T00:30:00.369 DEBUG:teuthology.orchestra.run.trial124:> test -z $(ls -A /var/lib/ceph) 2026-02-17T00:30:00.404 INFO:teuthology.orchestra.run.trial124.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-17T00:30:00.404 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T00:30:00.507 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T00:30:00.527 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T00:30:00.527 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T00:30:00.528 DEBUG:teuthology.orchestra.run.trial124:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T00:30:00.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:30:00.531 DEBUG:teuthology.orchestra.run.trial124:> uname -r 2026-02-17T00:30:00.575 INFO:teuthology.orchestra.run.trial124.stdout:5.15.0-164-generic 2026-02-17T00:30:00.575 INFO:teuthology.task.kernel:Running kernel on trial124: 5.15.0-164-generic 2026-02-17T00:30:00.575 DEBUG:teuthology.orchestra.run.trial124:> sudo apt-get clean 2026-02-17T00:30:00.633 DEBUG:teuthology.orchestra.run.trial124:> sudo apt-get update 2026-02-17T00:30:00.891 INFO:teuthology.orchestra.run.trial124.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T00:30:00.898 INFO:teuthology.orchestra.run.trial124.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-17T00:30:00.937 INFO:teuthology.orchestra.run.trial124.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-17T00:30:00.953 INFO:teuthology.orchestra.run.trial124.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-17T00:30:01.032 INFO:teuthology.orchestra.run.trial124.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3237 kB] 2026-02-17T00:30:01.099 INFO:teuthology.orchestra.run.trial124.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [493 kB] 2026-02-17T00:30:01.101 INFO:teuthology.orchestra.run.trial124.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-17T00:30:01.102 INFO:teuthology.orchestra.run.trial124.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1255 kB] 2026-02-17T00:30:01.109 INFO:teuthology.orchestra.run.trial124.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-17T00:30:01.111 INFO:teuthology.orchestra.run.trial124.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-17T00:30:01.111 INFO:teuthology.orchestra.run.trial124.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5287 kB] 2026-02-17T00:30:01.139 INFO:teuthology.orchestra.run.trial124.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [997 kB] 2026-02-17T00:30:01.142 INFO:teuthology.orchestra.run.trial124.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2966 kB] 2026-02-17T00:30:01.151 INFO:teuthology.orchestra.run.trial124.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [426 kB] 2026-02-17T00:30:01.152 INFO:teuthology.orchestra.run.trial124.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-17T00:30:01.153 INFO:teuthology.orchestra.run.trial124.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-17T00:30:01.157 INFO:teuthology.orchestra.run.trial124.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-17T00:30:01.158 INFO:teuthology.orchestra.run.trial124.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-17T00:30:01.158 INFO:teuthology.orchestra.run.trial124.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5096 kB] 2026-02-17T00:30:01.175 INFO:teuthology.orchestra.run.trial124.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [964 kB] 2026-02-17T00:30:04.839 INFO:teuthology.orchestra.run.trial124.stdout:Fetched 22.7 MB in 2s (13.0 MB/s) 2026-02-17T00:30:05.364 INFO:teuthology.orchestra.run.trial124.stdout:Reading package lists... 2026-02-17T00:30:05.377 DEBUG:teuthology.orchestra.run.trial124:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T00:30:05.409 INFO:teuthology.orchestra.run.trial124.stdout:Reading package lists... 2026-02-17T00:30:05.520 INFO:teuthology.orchestra.run.trial124.stdout:Building dependency tree... 2026-02-17T00:30:05.521 INFO:teuthology.orchestra.run.trial124.stdout:Reading state information... 2026-02-17T00:30:05.604 INFO:teuthology.orchestra.run.trial124.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T00:30:05.604 INFO:teuthology.orchestra.run.trial124.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T00:30:05.604 INFO:teuthology.orchestra.run.trial124.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T00:30:05.604 INFO:teuthology.orchestra.run.trial124.stdout: sg3-utils-udev 2026-02-17T00:30:05.604 INFO:teuthology.orchestra.run.trial124.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T00:30:05.604 INFO:teuthology.orchestra.run.trial124.stdout:The following additional packages will be installed: 2026-02-17T00:30:05.604 INFO:teuthology.orchestra.run.trial124.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T00:30:05.604 INFO:teuthology.orchestra.run.trial124.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-17T00:30:05.604 INFO:teuthology.orchestra.run.trial124.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-17T00:30:05.604 INFO:teuthology.orchestra.run.trial124.stdout:Suggested packages: 2026-02-17T00:30:05.604 INFO:teuthology.orchestra.run.trial124.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-17T00:30:05.618 INFO:teuthology.orchestra.run.trial124.stdout:The following NEW packages will be installed: 2026-02-17T00:30:05.618 INFO:teuthology.orchestra.run.trial124.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T00:30:05.618 INFO:teuthology.orchestra.run.trial124.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-17T00:30:05.618 INFO:teuthology.orchestra.run.trial124.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-17T00:30:05.619 INFO:teuthology.orchestra.run.trial124.stdout:The following packages will be upgraded: 2026-02-17T00:30:05.619 INFO:teuthology.orchestra.run.trial124.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-17T00:30:05.715 INFO:teuthology.orchestra.run.trial124.stdout:3 upgraded, 5 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T00:30:05.715 INFO:teuthology.orchestra.run.trial124.stdout:Need to get 113 MB of archives. 2026-02-17T00:30:05.715 INFO:teuthology.orchestra.run.trial124.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-17T00:30:05.715 INFO:teuthology.orchestra.run.trial124.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-17T00:30:05.891 INFO:teuthology.orchestra.run.trial124.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-17T00:30:05.934 INFO:teuthology.orchestra.run.trial124.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-17T00:30:06.181 INFO:teuthology.orchestra.run.trial124.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-17T00:30:06.182 INFO:teuthology.orchestra.run.trial124.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-17T00:30:06.182 INFO:teuthology.orchestra.run.trial124.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-17T00:30:06.230 INFO:teuthology.orchestra.run.trial124.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-17T00:30:06.241 INFO:teuthology.orchestra.run.trial124.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-17T00:30:06.441 INFO:teuthology.orchestra.run.trial124.stdout:Fetched 113 MB in 1s (183 MB/s) 2026-02-17T00:30:06.462 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-17T00:30:06.627 INFO:teuthology.orchestra.run.trial124.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-17T00:30:06.628 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T00:30:06.629 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T00:30:06.975 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-17T00:30:06.980 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T00:30:06.997 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T00:30:07.037 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-17T00:30:07.044 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T00:30:07.045 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T00:30:08.144 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T00:30:08.145 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T00:30:08.167 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T00:30:08.168 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T00:30:08.184 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-17T00:30:08.191 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-17T00:30:08.191 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T00:30:09.514 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-17T00:30:09.525 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T00:30:09.526 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T00:30:10.111 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T00:30:10.112 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T00:30:10.137 INFO:teuthology.orchestra.run.trial124.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T00:30:10.138 INFO:teuthology.orchestra.run.trial124.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T00:30:10.140 INFO:teuthology.orchestra.run.trial124.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-17T00:30:10.141 INFO:teuthology.orchestra.run.trial124.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T00:30:10.913 INFO:teuthology.orchestra.run.trial124.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T00:30:11.736 INFO:teuthology.orchestra.run.trial124.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-17T00:30:11.736 INFO:teuthology.orchestra.run.trial124.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-17T00:30:11.742 INFO:teuthology.orchestra.run.trial124.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T00:30:12.532 INFO:teuthology.orchestra.run.trial124.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-17T00:30:12.533 INFO:teuthology.orchestra.run.trial124.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-17T00:30:12.534 INFO:teuthology.orchestra.run.trial124.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T00:30:12.539 INFO:teuthology.orchestra.run.trial124.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-17T00:30:12.539 INFO:teuthology.orchestra.run.trial124.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-17T00:30:19.650 INFO:teuthology.orchestra.run.trial124.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-17T00:30:26.337 INFO:teuthology.orchestra.run.trial124.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-17T00:30:26.337 INFO:teuthology.orchestra.run.trial124.stdout:Sourcing file `/etc/default/grub' 2026-02-17T00:30:26.356 INFO:teuthology.orchestra.run.trial124.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T00:30:26.357 INFO:teuthology.orchestra.run.trial124.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T00:30:26.359 INFO:teuthology.orchestra.run.trial124.stdout:Generating grub configuration file ... 2026-02-17T00:30:26.440 INFO:teuthology.orchestra.run.trial124.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T00:30:26.447 INFO:teuthology.orchestra.run.trial124.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T00:30:26.626 INFO:teuthology.orchestra.run.trial124.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T00:30:26.632 INFO:teuthology.orchestra.run.trial124.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T00:30:26.704 INFO:teuthology.orchestra.run.trial124.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T00:30:26.704 INFO:teuthology.orchestra.run.trial124.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T00:30:26.704 INFO:teuthology.orchestra.run.trial124.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T00:30:26.706 INFO:teuthology.orchestra.run.trial124.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T00:30:26.715 INFO:teuthology.orchestra.run.trial124.stdout:done 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout:Pending kernel upgrade! 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout:Running kernel version: 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout: 5.15.0-164-generic 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout:Diagnostics: 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout:The processor microcode seems to be up-to-date. 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout:No services need to be restarted. 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout:No containers need to be restarted. 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout:No user sessions are running outdated binaries. 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:30:27.120 INFO:teuthology.orchestra.run.trial124.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T00:30:27.788 DEBUG:teuthology.orchestra.run.trial124:> dpkg -s linux-image-generic 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout:Package: linux-image-generic 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout:Status: install ok installed 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout:Priority: optional 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout:Section: kernel 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout:Installed-Size: 21 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout:Architecture: amd64 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout:Source: linux-meta 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout:Version: 5.15.0.170.159 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout:Recommends: thermald 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout:Description: Generic Linux kernel image 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout: This package will always depend on the latest generic kernel image 2026-02-17T00:30:27.798 INFO:teuthology.orchestra.run.trial124.stdout: available. 2026-02-17T00:30:27.799 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-17T00:30:27.799 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T00:30:27.799 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T00:30:27.799 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T00:30:27.799 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial124.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T00:30:27.799 DEBUG:teuthology.orchestra.run.trial124:> sudo apt-get clean 2026-02-17T00:30:27.880 DEBUG:teuthology.orchestra.run.trial124:> sudo apt-get update 2026-02-17T00:30:28.318 INFO:teuthology.orchestra.run.trial124.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T00:30:28.387 INFO:teuthology.orchestra.run.trial124.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T00:30:28.457 INFO:teuthology.orchestra.run.trial124.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T00:30:28.530 INFO:teuthology.orchestra.run.trial124.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T00:30:29.200 INFO:teuthology.orchestra.run.trial124.stdout:Reading package lists... 2026-02-17T00:30:29.214 DEBUG:teuthology.orchestra.run.trial124:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T00:30:29.247 INFO:teuthology.orchestra.run.trial124.stdout:Reading package lists... 2026-02-17T00:30:29.362 INFO:teuthology.orchestra.run.trial124.stdout:Building dependency tree... 2026-02-17T00:30:29.363 INFO:teuthology.orchestra.run.trial124.stdout:Reading state information... 2026-02-17T00:30:29.450 INFO:teuthology.orchestra.run.trial124.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-17T00:30:29.450 INFO:teuthology.orchestra.run.trial124.stdout:linux-image-generic set to manually installed. 2026-02-17T00:30:29.450 INFO:teuthology.orchestra.run.trial124.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T00:30:29.451 INFO:teuthology.orchestra.run.trial124.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T00:30:29.451 INFO:teuthology.orchestra.run.trial124.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T00:30:29.451 INFO:teuthology.orchestra.run.trial124.stdout: sg3-utils-udev 2026-02-17T00:30:29.451 INFO:teuthology.orchestra.run.trial124.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T00:30:29.470 INFO:teuthology.orchestra.run.trial124.stdout:0 upgraded, 0 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T00:30:29.472 DEBUG:teuthology.orchestra.run.trial124:> dpkg -s linux-image-generic 2026-02-17T00:30:29.524 INFO:teuthology.orchestra.run.trial124.stdout:Package: linux-image-generic 2026-02-17T00:30:29.524 INFO:teuthology.orchestra.run.trial124.stdout:Status: install ok installed 2026-02-17T00:30:29.524 INFO:teuthology.orchestra.run.trial124.stdout:Priority: optional 2026-02-17T00:30:29.524 INFO:teuthology.orchestra.run.trial124.stdout:Section: kernel 2026-02-17T00:30:29.524 INFO:teuthology.orchestra.run.trial124.stdout:Installed-Size: 21 2026-02-17T00:30:29.525 INFO:teuthology.orchestra.run.trial124.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T00:30:29.525 INFO:teuthology.orchestra.run.trial124.stdout:Architecture: amd64 2026-02-17T00:30:29.525 INFO:teuthology.orchestra.run.trial124.stdout:Source: linux-meta 2026-02-17T00:30:29.525 INFO:teuthology.orchestra.run.trial124.stdout:Version: 5.15.0.170.159 2026-02-17T00:30:29.525 INFO:teuthology.orchestra.run.trial124.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T00:30:29.525 INFO:teuthology.orchestra.run.trial124.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T00:30:29.525 INFO:teuthology.orchestra.run.trial124.stdout:Recommends: thermald 2026-02-17T00:30:29.525 INFO:teuthology.orchestra.run.trial124.stdout:Description: Generic Linux kernel image 2026-02-17T00:30:29.525 INFO:teuthology.orchestra.run.trial124.stdout: This package will always depend on the latest generic kernel image 2026-02-17T00:30:29.525 INFO:teuthology.orchestra.run.trial124.stdout: available. 2026-02-17T00:30:29.525 DEBUG:teuthology.orchestra.run.trial124:> mktemp 2026-02-17T00:30:29.572 INFO:teuthology.orchestra.run.trial124.stdout:/tmp/tmp.i81NANk9KO 2026-02-17T00:30:29.573 DEBUG:teuthology.orchestra.run.trial124:> sudo cp /boot/grub/grub.cfg /tmp/tmp.i81NANk9KO 2026-02-17T00:30:29.624 DEBUG:teuthology.orchestra.run.trial124:> sudo chmod 0666 /tmp/tmp.i81NANk9KO 2026-02-17T00:30:29.722 DEBUG:teuthology.orchestra.remote:trial124:/tmp/tmp.i81NANk9KO is 7KB 2026-02-17T00:30:29.731 DEBUG:teuthology.orchestra.run.trial124:> rm -fr /tmp/tmp.i81NANk9KO 2026-02-17T00:30:29.735 DEBUG:teuthology.orchestra.run.trial124:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-17T00:30:29.788 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:30:29.788 DEBUG:teuthology.orchestra.run.trial124:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-17T00:30:29.788 DEBUG:teuthology.orchestra.run.trial124:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-17T00:30:29.845 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-17T00:30:29.846 DEBUG:teuthology.orchestra.run.trial124:> sudo update-grub 2026-02-17T00:30:30.082 INFO:teuthology.orchestra.run.trial124.stderr:Sourcing file `/etc/default/grub' 2026-02-17T00:30:30.101 INFO:teuthology.orchestra.run.trial124.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T00:30:30.102 INFO:teuthology.orchestra.run.trial124.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T00:30:30.104 INFO:teuthology.orchestra.run.trial124.stderr:Generating grub configuration file ... 2026-02-17T00:30:30.189 INFO:teuthology.orchestra.run.trial124.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T00:30:30.195 INFO:teuthology.orchestra.run.trial124.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T00:30:30.366 INFO:teuthology.orchestra.run.trial124.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T00:30:30.371 INFO:teuthology.orchestra.run.trial124.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T00:30:30.443 INFO:teuthology.orchestra.run.trial124.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T00:30:30.443 INFO:teuthology.orchestra.run.trial124.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T00:30:30.443 INFO:teuthology.orchestra.run.trial124.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T00:30:30.445 INFO:teuthology.orchestra.run.trial124.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T00:30:30.452 INFO:teuthology.orchestra.run.trial124.stderr:done 2026-02-17T00:30:30.453 DEBUG:teuthology.orchestra.run.trial124:> sudo shutdown -r now 2026-02-17T00:31:00.456 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T00:31:00.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial124.front.sepia.ceph.com' 2026-02-17T00:31:00.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:32:00.518 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T00:32:09.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial124.front.sepia.ceph.com' 2026-02-17T00:32:09.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:32:09.608 DEBUG:teuthology.orchestra.run.trial124:> true 2026-02-17T00:32:09.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial124.front.sepia.ceph.com' 2026-02-17T00:32:09.997 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-17T00:32:09.997 DEBUG:teuthology.orchestra.run.trial124:> uname -r 2026-02-17T00:32:10.048 INFO:teuthology.orchestra.run.trial124.stdout:5.15.0-170-generic 2026-02-17T00:32:10.048 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-17T00:32:10.048 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T00:32:10.048 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-17T00:32:11.049 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T00:32:11.050 DEBUG:teuthology.orchestra.run.trial124:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T00:32:11.063 INFO:teuthology.orchestra.run.trial124.stdout:ttyS1 2026-02-17T00:32:11.094 DEBUG:teuthology.parallel:result is None 2026-02-17T00:32:11.095 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T00:32:11.106 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T00:32:11.106 DEBUG:teuthology.orchestra.run.trial124:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T00:32:11.139 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T00:32:11.150 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T00:32:11.164 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T00:32:11.164 DEBUG:teuthology.orchestra.run.trial124:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T00:32:11.191 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T00:32:11.202 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T00:32:11.202 DEBUG:teuthology.orchestra.run.trial124:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T00:32:11.236 INFO:teuthology.orchestra.run.trial124.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:32:11.243 INFO:teuthology.orchestra.run.trial124.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:32:11.244 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T00:32:11.255 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T00:32:11.256 DEBUG:teuthology.orchestra.run.trial124:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T00:32:11.296 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T00:32:11.313 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T00:32:11.313 DEBUG:teuthology.orchestra.run.trial124:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T00:32:11.345 DEBUG:teuthology.orchestra.run.trial124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T00:32:11.391 DEBUG:teuthology.orchestra.run.trial124:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T00:32:11.439 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:32:11.439 DEBUG:teuthology.orchestra.run.trial124:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T00:32:11.494 DEBUG:teuthology.orchestra.run.trial124:> sudo service rsyslog restart 2026-02-17T00:32:11.557 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T00:32:11.570 INFO:teuthology.task.internal:Starting timer... 2026-02-17T00:32:11.570 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T00:32:11.589 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T00:32:11.607 DEBUG:teuthology.task.selinux:Excluding trial124: OS 'ubuntu' does not support SELinux 2026-02-17T00:32:11.607 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T00:32:11.607 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-17T00:32:11.607 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T00:32:11.607 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T00:32:11.623 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T00:32:11.634 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T00:32:11.634 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial124.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T00:34:31.520 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial124.front.sepia.ceph.com')] 2026-02-17T00:34:31.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial124.front.sepia.ceph.com' 2026-02-17T00:34:31.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:34:31.681 DEBUG:teuthology.orchestra.run.trial124:> true 2026-02-17T00:34:31.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial124.front.sepia.ceph.com' 2026-02-17T00:34:31.933 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T00:34:31.954 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T00:34:31.954 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T00:34:31.955 DEBUG:teuthology.orchestra.run.trial124:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T00:34:31.991 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-17T00:34:31.992 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: Command line: ntpd -gq 2026-02-17T00:34:31.992 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: ---------------------------------------------------- 2026-02-17T00:34:31.992 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: ntp-4 is maintained by Network Time Foundation, 2026-02-17T00:34:31.992 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-17T00:34:31.992 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: corporation. Support and training for ntp-4 are 2026-02-17T00:34:31.992 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: available at https://www.nwtime.org/support 2026-02-17T00:34:31.992 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: ---------------------------------------------------- 2026-02-17T00:34:31.992 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: proto: precision = 0.030 usec (-25) 2026-02-17T00:34:31.992 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: basedate set to 2022-02-04 2026-02-17T00:34:31.993 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: gps base set to 2022-02-06 (week 2196) 2026-02-17T00:34:31.993 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T00:34:31.993 INFO:teuthology.orchestra.run.trial124.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T00:34:31.993 INFO:teuthology.orchestra.run.trial124.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-17T00:34:31.994 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: restrict ::: KOD does nothing without LIMITED. 2026-02-17T00:34:31.994 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: Listen and drop on 0 v6wildcard [::]:123 2026-02-17T00:34:31.995 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-17T00:34:31.995 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: Listen normally on 2 lo 127.0.0.1:123 2026-02-17T00:34:31.995 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: Listen normally on 3 enp1s0f0 10.20.193.124:123 2026-02-17T00:34:31.995 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: Listen normally on 4 lo [::1]:123 2026-02-17T00:34:31.995 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:644c%2]:123 2026-02-17T00:34:31.995 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:31 ntpd[8779]: Listening on routing socket on fd #22 for interface updates 2026-02-17T00:34:32.991 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:32 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:32.992 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:32 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:32.992 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:32 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:32.992 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:32 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:33.069 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:32 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:33.069 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:32 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:33.069 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:32 ntpd[8779]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T00:34:33.069 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:32 ntpd[8779]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T00:34:34.991 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:34 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:34.991 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:34 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:34.991 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:34 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:34.992 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:34 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:34.995 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:34 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:34.995 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:34 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:34.995 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:34 ntpd[8779]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T00:34:34.995 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:34 ntpd[8779]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T00:34:35.068 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:34 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:35.068 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:34 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:35.068 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:34 ntpd[8779]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T00:34:35.068 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:34 ntpd[8779]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T00:34:36.991 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:36.991 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:36.991 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:36.991 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:36.991 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:36.991 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:36.995 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:36.995 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:36.995 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T00:34:36.995 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T00:34:36.996 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:36.996 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:36.996 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T00:34:36.996 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T00:34:37.067 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:37.067 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:37.067 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T00:34:37.067 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:36 ntpd[8779]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T00:34:38.991 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:38.991 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:38.991 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:38.992 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:38.992 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:38.992 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:38.994 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:38.994 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:38.995 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T00:34:38.995 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T00:34:38.996 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:38.996 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:38.996 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T00:34:38.996 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T00:34:39.068 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T00:34:39.068 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T00:34:39.068 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T00:34:39.068 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:38 ntpd[8779]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T00:34:39.069 INFO:teuthology.orchestra.run.trial124.stdout:17 Feb 00:34:39 ntpd[8779]: ntpd: time set +0.401416 s 2026-02-17T00:34:39.069 INFO:teuthology.orchestra.run.trial124.stdout:ntpd: time set +0.401416s 2026-02-17T00:34:39.069 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:39 ntpd[8779]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-17T00:34:39.069 INFO:teuthology.orchestra.run.trial124.stderr:17 Feb 00:34:39 ntpd[8779]: can't open /var/log/ntpstats/loopstats.20260217: Permission denied 2026-02-17T00:34:39.126 INFO:teuthology.orchestra.run.trial124.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T00:34:39.126 INFO:teuthology.orchestra.run.trial124.stdout:============================================================================== 2026-02-17T00:34:39.126 INFO:teuthology.orchestra.run.trial124.stdout: time.cloudflare .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T00:34:39.126 INFO:teuthology.orchestra.run.trial124.stdout: as393746.mci.tr .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T00:34:39.126 INFO:teuthology.orchestra.run.trial124.stdout: 23.186.168.132 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T00:34:39.126 INFO:teuthology.orchestra.run.trial124.stdout: ntp.netlinkify. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T00:34:39.127 INFO:teuthology.run_tasks:Running task install... 2026-02-17T00:34:39.142 DEBUG:teuthology.task.install:project ceph 2026-02-17T00:34:39.142 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '03ef619e79a56cd363b087a5c6f19a1a09b49040'}} 2026-02-17T00:34:39.142 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '03ef619e79a56cd363b087a5c6f19a1a09b49040'} 2026-02-17T00:34:39.142 INFO:teuthology.task.install:Using flavor: default 2026-02-17T00:34:39.151 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T00:34:39.151 INFO:teuthology.task.install:extra packages: [] 2026-02-17T00:34:39.152 DEBUG:teuthology.orchestra.run.trial124:> sudo apt-key list | grep Ceph 2026-02-17T00:34:39.219 INFO:teuthology.orchestra.run.trial124.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-17T00:34:39.248 INFO:teuthology.orchestra.run.trial124.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-17T00:34:39.248 INFO:teuthology.orchestra.run.trial124.stdout:uid [ unknown] Ceph.com (release key) 2026-02-17T00:34:39.249 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-17T00:34:39.250 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=03ef619e79a56cd363b087a5c6f19a1a09b49040 2026-02-17T00:34:39.397 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default/ 2026-02-17T00:34:39.397 INFO:teuthology.task.install.deb:Package version is 20.3.0-5225-g03ef619e-1jammy 2026-02-17T00:34:39.738 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:34:39.738 DEBUG:teuthology.orchestra.run.trial124:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-17T00:34:39.748 DEBUG:teuthology.orchestra.run.trial124:> sudo apt-get update 2026-02-17T00:34:40.003 INFO:teuthology.orchestra.run.trial124.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy InRelease 2026-02-17T00:34:40.040 INFO:teuthology.orchestra.run.trial124.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy Release [7005 B] 2026-02-17T00:34:40.077 INFO:teuthology.orchestra.run.trial124.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-17T00:34:40.114 INFO:teuthology.orchestra.run.trial124.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-17T00:34:40.252 INFO:teuthology.orchestra.run.trial124.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T00:34:40.334 INFO:teuthology.orchestra.run.trial124.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T00:34:40.422 INFO:teuthology.orchestra.run.trial124.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T00:34:40.510 INFO:teuthology.orchestra.run.trial124.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T00:34:40.653 INFO:teuthology.orchestra.run.trial124.stdout:Fetched 26.3 kB in 1s (35.3 kB/s) 2026-02-17T00:34:41.180 INFO:teuthology.orchestra.run.trial124.stdout:Reading package lists... 2026-02-17T00:34:41.193 DEBUG:teuthology.orchestra.run.trial124:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5225-g03ef619e-1jammy cephadm=20.3.0-5225-g03ef619e-1jammy ceph-mds=20.3.0-5225-g03ef619e-1jammy ceph-mgr=20.3.0-5225-g03ef619e-1jammy ceph-osd=20.3.0-5225-g03ef619e-1jammy ceph-osd-classic=20.3.0-5225-g03ef619e-1jammy ceph-common=20.3.0-5225-g03ef619e-1jammy ceph-fuse=20.3.0-5225-g03ef619e-1jammy ceph-test=20.3.0-5225-g03ef619e-1jammy ceph-volume=20.3.0-5225-g03ef619e-1jammy radosgw=20.3.0-5225-g03ef619e-1jammy python3-rados=20.3.0-5225-g03ef619e-1jammy python3-rgw=20.3.0-5225-g03ef619e-1jammy python3-cephfs=20.3.0-5225-g03ef619e-1jammy python3-rbd=20.3.0-5225-g03ef619e-1jammy libcephfs2=20.3.0-5225-g03ef619e-1jammy libcephfs-dev=20.3.0-5225-g03ef619e-1jammy librados2=20.3.0-5225-g03ef619e-1jammy librbd1=20.3.0-5225-g03ef619e-1jammy rbd-fuse=20.3.0-5225-g03ef619e-1jammy 2026-02-17T00:34:41.226 INFO:teuthology.orchestra.run.trial124.stdout:Reading package lists... 2026-02-17T00:34:41.334 INFO:teuthology.orchestra.run.trial124.stdout:Building dependency tree... 2026-02-17T00:34:41.334 INFO:teuthology.orchestra.run.trial124.stdout:Reading state information... 2026-02-17T00:34:41.425 INFO:teuthology.orchestra.run.trial124.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T00:34:41.425 INFO:teuthology.orchestra.run.trial124.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T00:34:41.425 INFO:teuthology.orchestra.run.trial124.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T00:34:41.425 INFO:teuthology.orchestra.run.trial124.stdout: sg3-utils-udev 2026-02-17T00:34:41.426 INFO:teuthology.orchestra.run.trial124.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T00:34:41.426 INFO:teuthology.orchestra.run.trial124.stdout:The following additional packages will be installed: 2026-02-17T00:34:41.426 INFO:teuthology.orchestra.run.trial124.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-17T00:34:41.426 INFO:teuthology.orchestra.run.trial124.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-17T00:34:41.426 INFO:teuthology.orchestra.run.trial124.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-17T00:34:41.426 INFO:teuthology.orchestra.run.trial124.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T00:34:41.426 INFO:teuthology.orchestra.run.trial124.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-17T00:34:41.426 INFO:teuthology.orchestra.run.trial124.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-17T00:34:41.426 INFO:teuthology.orchestra.run.trial124.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-17T00:34:41.426 INFO:teuthology.orchestra.run.trial124.stdout: python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-17T00:34:41.426 INFO:teuthology.orchestra.run.trial124.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-17T00:34:41.426 INFO:teuthology.orchestra.run.trial124.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-17T00:34:41.427 INFO:teuthology.orchestra.run.trial124.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-17T00:34:41.427 INFO:teuthology.orchestra.run.trial124.stdout: python3-pygments python3-pytest python3-repoze.lru python3-requests-oauthlib 2026-02-17T00:34:41.427 INFO:teuthology.orchestra.run.trial124.stdout: python3-routes python3-rsa python3-simplejson python3-sklearn 2026-02-17T00:34:41.427 INFO:teuthology.orchestra.run.trial124.stdout: python3-sklearn-lib python3-tempora python3-threadpoolctl python3-toml 2026-02-17T00:34:41.427 INFO:teuthology.orchestra.run.trial124.stdout: python3-wcwidth python3-webob python3-websocket python3-zc.lockfile 2026-02-17T00:34:41.427 INFO:teuthology.orchestra.run.trial124.stdout: qttranslations5-l10n socat xmlstarlet 2026-02-17T00:34:41.427 INFO:teuthology.orchestra.run.trial124.stdout:Suggested packages: 2026-02-17T00:34:41.427 INFO:teuthology.orchestra.run.trial124.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-17T00:34:41.427 INFO:teuthology.orchestra.run.trial124.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-17T00:34:41.427 INFO:teuthology.orchestra.run.trial124.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-17T00:34:41.428 INFO:teuthology.orchestra.run.trial124.stdout:Recommended packages: 2026-02-17T00:34:41.428 INFO:teuthology.orchestra.run.trial124.stdout: btrfs-tools 2026-02-17T00:34:41.461 INFO:teuthology.orchestra.run.trial124.stdout:The following NEW packages will be installed: 2026-02-17T00:34:41.461 INFO:teuthology.orchestra.run.trial124.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-17T00:34:41.461 INFO:teuthology.orchestra.run.trial124.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-17T00:34:41.461 INFO:teuthology.orchestra.run.trial124.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-17T00:34:41.461 INFO:teuthology.orchestra.run.trial124.stdout: ceph-volume cephadm jq libcephfs-daemon libcephfs-dev libcephfs-proxy2 2026-02-17T00:34:41.461 INFO:teuthology.orchestra.run.trial124.stdout: libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-17T00:34:41.461 INFO:teuthology.orchestra.run.trial124.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T00:34:41.461 INFO:teuthology.orchestra.run.trial124.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-17T00:34:41.462 INFO:teuthology.orchestra.run.trial124.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-17T00:34:41.462 INFO:teuthology.orchestra.run.trial124.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-17T00:34:41.462 INFO:teuthology.orchestra.run.trial124.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T00:34:41.462 INFO:teuthology.orchestra.run.trial124.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T00:34:41.462 INFO:teuthology.orchestra.run.trial124.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-17T00:34:41.462 INFO:teuthology.orchestra.run.trial124.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-17T00:34:41.462 INFO:teuthology.orchestra.run.trial124.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-17T00:34:41.462 INFO:teuthology.orchestra.run.trial124.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-17T00:34:41.462 INFO:teuthology.orchestra.run.trial124.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-17T00:34:41.462 INFO:teuthology.orchestra.run.trial124.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-17T00:34:41.462 INFO:teuthology.orchestra.run.trial124.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-17T00:34:41.462 INFO:teuthology.orchestra.run.trial124.stdout: socat xmlstarlet 2026-02-17T00:34:41.712 INFO:teuthology.orchestra.run.trial124.stdout:0 upgraded, 87 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T00:34:41.713 INFO:teuthology.orchestra.run.trial124.stdout:Need to get 698 MB of archives. 2026-02-17T00:34:41.713 INFO:teuthology.orchestra.run.trial124.stdout:After this operation, 2661 MB of additional disk space will be used. 2026-02-17T00:34:41.713 INFO:teuthology.orchestra.run.trial124.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5225-g03ef619e-1jammy [3799 kB] 2026-02-17T00:34:41.813 INFO:teuthology.orchestra.run.trial124.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-17T00:34:42.151 INFO:teuthology.orchestra.run.trial124.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-17T00:34:42.161 INFO:teuthology.orchestra.run.trial124.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-17T00:34:42.232 INFO:teuthology.orchestra.run.trial124.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-17T00:34:42.434 INFO:teuthology.orchestra.run.trial124.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-17T00:34:42.444 INFO:teuthology.orchestra.run.trial124.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-17T00:34:42.471 INFO:teuthology.orchestra.run.trial124.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-17T00:34:42.479 INFO:teuthology.orchestra.run.trial124.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-17T00:34:42.481 INFO:teuthology.orchestra.run.trial124.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-17T00:34:42.482 INFO:teuthology.orchestra.run.trial124.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-17T00:34:42.482 INFO:teuthology.orchestra.run.trial124.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-17T00:34:42.499 INFO:teuthology.orchestra.run.trial124.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-17T00:34:42.500 INFO:teuthology.orchestra.run.trial124.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-17T00:34:42.506 INFO:teuthology.orchestra.run.trial124.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-17T00:34:42.570 INFO:teuthology.orchestra.run.trial124.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5225-g03ef619e-1jammy [2910 kB] 2026-02-17T00:34:42.573 INFO:teuthology.orchestra.run.trial124.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-17T00:34:42.573 INFO:teuthology.orchestra.run.trial124.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-17T00:34:42.574 INFO:teuthology.orchestra.run.trial124.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-17T00:34:42.574 INFO:teuthology.orchestra.run.trial124.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-17T00:34:42.574 INFO:teuthology.orchestra.run.trial124.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-17T00:34:42.575 INFO:teuthology.orchestra.run.trial124.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-17T00:34:42.575 INFO:teuthology.orchestra.run.trial124.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-17T00:34:42.579 INFO:teuthology.orchestra.run.trial124.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-17T00:34:42.579 INFO:teuthology.orchestra.run.trial124.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-17T00:34:42.649 INFO:teuthology.orchestra.run.trial124.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-17T00:34:42.651 INFO:teuthology.orchestra.run.trial124.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-17T00:34:42.651 INFO:teuthology.orchestra.run.trial124.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-17T00:34:42.652 INFO:teuthology.orchestra.run.trial124.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-17T00:34:42.677 INFO:teuthology.orchestra.run.trial124.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-17T00:34:42.679 INFO:teuthology.orchestra.run.trial124.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-17T00:34:42.679 INFO:teuthology.orchestra.run.trial124.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-17T00:34:42.737 INFO:teuthology.orchestra.run.trial124.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-17T00:34:42.737 INFO:teuthology.orchestra.run.trial124.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-17T00:34:42.737 INFO:teuthology.orchestra.run.trial124.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-17T00:34:42.738 INFO:teuthology.orchestra.run.trial124.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-17T00:34:42.738 INFO:teuthology.orchestra.run.trial124.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-17T00:34:42.738 INFO:teuthology.orchestra.run.trial124.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-17T00:34:42.797 INFO:teuthology.orchestra.run.trial124.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-17T00:34:42.799 INFO:teuthology.orchestra.run.trial124.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-17T00:34:42.800 INFO:teuthology.orchestra.run.trial124.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-17T00:34:42.870 INFO:teuthology.orchestra.run.trial124.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-17T00:34:42.873 INFO:teuthology.orchestra.run.trial124.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-17T00:34:42.875 INFO:teuthology.orchestra.run.trial124.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-17T00:34:42.879 INFO:teuthology.orchestra.run.trial124.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-17T00:34:42.881 INFO:teuthology.orchestra.run.trial124.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-17T00:34:42.881 INFO:teuthology.orchestra.run.trial124.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-17T00:34:42.882 INFO:teuthology.orchestra.run.trial124.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-17T00:34:42.942 INFO:teuthology.orchestra.run.trial124.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-17T00:34:42.942 INFO:teuthology.orchestra.run.trial124.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5225-g03ef619e-1jammy [882 kB] 2026-02-17T00:34:42.942 INFO:teuthology.orchestra.run.trial124.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-17T00:34:42.949 INFO:teuthology.orchestra.run.trial124.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-17T00:34:43.014 INFO:teuthology.orchestra.run.trial124.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-17T00:34:43.016 INFO:teuthology.orchestra.run.trial124.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-17T00:34:43.016 INFO:teuthology.orchestra.run.trial124.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-17T00:34:43.017 INFO:teuthology.orchestra.run.trial124.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-17T00:34:43.068 INFO:teuthology.orchestra.run.trial124.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5225-g03ef619e-1jammy [359 kB] 2026-02-17T00:34:43.074 INFO:teuthology.orchestra.run.trial124.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5225-g03ef619e-1jammy [32.8 kB] 2026-02-17T00:34:43.075 INFO:teuthology.orchestra.run.trial124.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5225-g03ef619e-1jammy [225 kB] 2026-02-17T00:34:43.135 INFO:teuthology.orchestra.run.trial124.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5225-g03ef619e-1jammy [88.4 kB] 2026-02-17T00:34:43.136 INFO:teuthology.orchestra.run.trial124.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5225-g03ef619e-1jammy [339 kB] 2026-02-17T00:34:43.143 INFO:teuthology.orchestra.run.trial124.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5225-g03ef619e-1jammy [9083 kB] 2026-02-17T00:34:44.116 INFO:teuthology.orchestra.run.trial124.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5225-g03ef619e-1jammy [112 kB] 2026-02-17T00:34:44.117 INFO:teuthology.orchestra.run.trial124.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5225-g03ef619e-1jammy [261 kB] 2026-02-17T00:34:44.122 INFO:teuthology.orchestra.run.trial124.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5225-g03ef619e-1jammy [31.5 MB] 2026-02-17T00:34:47.252 INFO:teuthology.orchestra.run.trial124.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5225-g03ef619e-1jammy [4983 kB] 2026-02-17T00:34:47.619 INFO:teuthology.orchestra.run.trial124.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5225-g03ef619e-1jammy [293 kB] 2026-02-17T00:34:47.628 INFO:teuthology.orchestra.run.trial124.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5225-g03ef619e-1jammy [127 kB] 2026-02-17T00:34:47.631 INFO:teuthology.orchestra.run.trial124.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5225-g03ef619e-1jammy [922 kB] 2026-02-17T00:34:47.687 INFO:teuthology.orchestra.run.trial124.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5225-g03ef619e-1jammy [7536 kB] 2026-02-17T00:34:48.239 INFO:teuthology.orchestra.run.trial124.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5225-g03ef619e-1jammy [468 MB] 2026-02-17T00:35:12.175 INFO:teuthology.orchestra.run.trial124.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5225-g03ef619e-1jammy [180 kB] 2026-02-17T00:35:12.177 INFO:teuthology.orchestra.run.trial124.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5225-g03ef619e-1jammy [14.1 kB] 2026-02-17T00:35:12.177 INFO:teuthology.orchestra.run.trial124.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5225-g03ef619e-1jammy [1030 kB] 2026-02-17T00:35:12.182 INFO:teuthology.orchestra.run.trial124.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5225-g03ef619e-1jammy [2437 kB] 2026-02-17T00:35:12.194 INFO:teuthology.orchestra.run.trial124.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5225-g03ef619e-1jammy [1068 kB] 2026-02-17T00:35:12.200 INFO:teuthology.orchestra.run.trial124.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5225-g03ef619e-1jammy [190 kB] 2026-02-17T00:35:12.201 INFO:teuthology.orchestra.run.trial124.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5225-g03ef619e-1jammy [54.5 MB] 2026-02-17T00:35:13.357 INFO:teuthology.orchestra.run.trial124.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5225-g03ef619e-1jammy [8626 kB] 2026-02-17T00:35:13.489 INFO:teuthology.orchestra.run.trial124.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5225-g03ef619e-1jammy [14.2 kB] 2026-02-17T00:35:13.489 INFO:teuthology.orchestra.run.trial124.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5225-g03ef619e-1jammy [65.4 MB] 2026-02-17T00:35:14.570 INFO:teuthology.orchestra.run.trial124.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5225-g03ef619e-1jammy [136 kB] 2026-02-17T00:35:14.570 INFO:teuthology.orchestra.run.trial124.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5225-g03ef619e-1jammy [45.1 kB] 2026-02-17T00:35:14.571 INFO:teuthology.orchestra.run.trial124.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5225-g03ef619e-1jammy [31.7 kB] 2026-02-17T00:35:14.571 INFO:teuthology.orchestra.run.trial124.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5225-g03ef619e-1jammy [44.2 kB] 2026-02-17T00:35:14.571 INFO:teuthology.orchestra.run.trial124.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5225-g03ef619e-1jammy [18.3 MB] 2026-02-17T00:35:14.869 INFO:teuthology.orchestra.run.trial124.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5225-g03ef619e-1jammy [93.8 kB] 2026-02-17T00:35:15.161 INFO:teuthology.orchestra.run.trial124.stdout:Fetched 698 MB in 33s (20.9 MB/s) 2026-02-17T00:35:15.178 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-17T00:35:15.332 INFO:teuthology.orchestra.run.trial124.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-17T00:35:15.334 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-17T00:35:15.335 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T00:35:15.355 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-17T00:35:15.368 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-17T00:35:15.368 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T00:35:15.384 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-17T00:35:15.396 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-17T00:35:15.396 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T00:35:15.416 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-17T00:35:15.424 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T00:35:15.429 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T00:35:15.460 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-17T00:35:15.468 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T00:35:15.468 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T00:35:15.485 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-17T00:35:15.493 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T00:35:15.493 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T00:35:15.512 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-17T00:35:15.520 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-17T00:35:15.521 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T00:35:15.537 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package librados2. 2026-02-17T00:35:15.545 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../07-librados2_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:15.545 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking librados2 (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:15.585 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libnbd0. 2026-02-17T00:35:15.593 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-17T00:35:15.593 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-17T00:35:15.608 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package librbd1. 2026-02-17T00:35:15.616 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../09-librbd1_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:15.617 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking librbd1 (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:15.654 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libcephfs2. 2026-02-17T00:35:15.662 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../10-libcephfs2_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:15.662 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libcephfs2 (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:15.682 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-rados. 2026-02-17T00:35:15.690 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../11-python3-rados_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:15.690 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-rados (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:15.707 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-17T00:35:15.716 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.3.0-5225-g03ef619e-1jammy_all.deb ... 2026-02-17T00:35:15.716 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-ceph-argparse (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:15.730 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-cephfs. 2026-02-17T00:35:15.738 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../13-python3-cephfs_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:15.738 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-cephfs (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:15.754 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-17T00:35:15.762 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../14-python3-ceph-common_20.3.0-5225-g03ef619e-1jammy_all.deb ... 2026-02-17T00:35:15.763 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-ceph-common (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:15.781 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-17T00:35:15.789 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-17T00:35:15.789 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T00:35:15.804 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-prettytable. 2026-02-17T00:35:15.812 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-17T00:35:15.813 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-17T00:35:15.826 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-rbd. 2026-02-17T00:35:15.834 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../17-python3-rbd_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:15.835 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-rbd (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:15.852 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-17T00:35:15.860 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-17T00:35:15.861 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T00:35:15.879 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package librgw2. 2026-02-17T00:35:15.887 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../19-librgw2_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:15.887 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking librgw2 (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:15.982 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-rgw. 2026-02-17T00:35:15.990 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../20-python3-rgw_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:15.990 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-rgw (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:16.006 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-17T00:35:16.014 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-17T00:35:16.015 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T00:35:16.029 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libradosstriper1. 2026-02-17T00:35:16.037 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../22-libradosstriper1_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:16.038 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libradosstriper1 (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:16.054 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-common. 2026-02-17T00:35:16.061 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../23-ceph-common_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:16.062 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-common (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:16.319 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-base. 2026-02-17T00:35:16.327 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../24-ceph-base_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:16.332 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-base (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:16.389 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-17T00:35:16.397 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-17T00:35:16.397 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-17T00:35:16.412 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-cheroot. 2026-02-17T00:35:16.421 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-17T00:35:16.421 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T00:35:16.438 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-17T00:35:16.446 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-17T00:35:16.446 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-17T00:35:16.461 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-17T00:35:16.469 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-17T00:35:16.469 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-17T00:35:16.484 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-17T00:35:16.492 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-17T00:35:16.492 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-17T00:35:16.506 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-tempora. 2026-02-17T00:35:16.514 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-17T00:35:16.514 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-17T00:35:16.528 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-portend. 2026-02-17T00:35:16.536 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-17T00:35:16.537 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-17T00:35:16.551 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-17T00:35:16.559 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-17T00:35:16.559 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-17T00:35:16.574 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-17T00:35:16.582 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-17T00:35:16.583 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-17T00:35:16.605 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-natsort. 2026-02-17T00:35:16.613 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-17T00:35:16.614 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-17T00:35:16.630 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-17T00:35:16.638 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.3.0-5225-g03ef619e-1jammy_all.deb ... 2026-02-17T00:35:16.639 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:16.670 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-17T00:35:16.678 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:16.678 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:16.693 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-mgr. 2026-02-17T00:35:16.701 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../37-ceph-mgr_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:16.701 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-mgr (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:16.725 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-mon. 2026-02-17T00:35:16.732 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../38-ceph-mon_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:16.733 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-mon (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:16.796 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-17T00:35:16.805 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-17T00:35:16.805 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T00:35:16.821 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-17T00:35:16.829 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../40-ceph-osd-classic_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:16.830 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-osd-classic (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:20.747 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-osd. 2026-02-17T00:35:20.758 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../41-ceph-osd_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:20.758 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-osd (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:20.778 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph. 2026-02-17T00:35:20.790 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../42-ceph_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:20.791 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:20.807 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-fuse. 2026-02-17T00:35:20.820 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../43-ceph-fuse_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:20.820 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-fuse (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:20.846 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-mds. 2026-02-17T00:35:20.857 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../44-ceph-mds_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:20.857 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-mds (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:20.897 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package cephadm. 2026-02-17T00:35:20.906 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../45-cephadm_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:20.906 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking cephadm (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:20.922 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-17T00:35:20.930 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../46-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T00:35:20.930 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T00:35:20.952 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-17T00:35:20.960 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../47-ceph-mgr-cephadm_20.3.0-5225-g03ef619e-1jammy_all.deb ... 2026-02-17T00:35:20.961 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:20.981 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-17T00:35:20.989 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../48-python3-repoze.lru_0.7-2_all.deb ... 2026-02-17T00:35:20.990 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-17T00:35:21.005 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-routes. 2026-02-17T00:35:21.013 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../49-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-17T00:35:21.014 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T00:35:21.034 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-17T00:35:21.041 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../50-ceph-mgr-dashboard_20.3.0-5225-g03ef619e-1jammy_all.deb ... 2026-02-17T00:35:21.041 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:21.718 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-17T00:35:21.727 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../51-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-17T00:35:21.727 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T00:35:21.766 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-joblib. 2026-02-17T00:35:21.775 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../52-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-17T00:35:21.775 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T00:35:21.802 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-17T00:35:21.811 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../53-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-17T00:35:21.811 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-17T00:35:21.827 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-sklearn. 2026-02-17T00:35:21.835 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../54-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-17T00:35:21.835 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T00:35:21.917 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-17T00:35:21.926 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-local_20.3.0-5225-g03ef619e-1jammy_all.deb ... 2026-02-17T00:35:21.927 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:22.083 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-cachetools. 2026-02-17T00:35:22.091 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../56-python3-cachetools_5.0.0-1_all.deb ... 2026-02-17T00:35:22.091 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-17T00:35:22.106 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-rsa. 2026-02-17T00:35:22.113 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../57-python3-rsa_4.8-1_all.deb ... 2026-02-17T00:35:22.113 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-17T00:35:22.132 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-google-auth. 2026-02-17T00:35:22.141 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../58-python3-google-auth_1.5.1-3_all.deb ... 2026-02-17T00:35:22.141 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-17T00:35:22.158 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-17T00:35:22.166 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../59-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-17T00:35:22.167 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T00:35:22.183 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-websocket. 2026-02-17T00:35:22.192 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../60-python3-websocket_1.2.3-1_all.deb ... 2026-02-17T00:35:22.192 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-17T00:35:22.209 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-17T00:35:22.218 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../61-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-17T00:35:22.218 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T00:35:22.318 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-17T00:35:22.326 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_20.3.0-5225-g03ef619e-1jammy_all.deb ... 2026-02-17T00:35:22.327 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:22.341 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-17T00:35:22.350 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../63-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-17T00:35:22.350 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T00:35:22.367 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-17T00:35:22.375 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../64-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T00:35:22.376 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T00:35:22.391 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package jq. 2026-02-17T00:35:22.399 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../65-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T00:35:22.400 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-17T00:35:22.414 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package socat. 2026-02-17T00:35:22.423 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../66-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-17T00:35:22.423 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-17T00:35:22.444 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package xmlstarlet. 2026-02-17T00:35:22.452 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../67-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-17T00:35:22.453 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-17T00:35:22.487 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-test. 2026-02-17T00:35:22.496 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../68-ceph-test_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:22.497 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-test (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:23.117 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package ceph-volume. 2026-02-17T00:35:23.126 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../69-ceph-volume_20.3.0-5225-g03ef619e-1jammy_all.deb ... 2026-02-17T00:35:23.126 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking ceph-volume (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:23.149 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-17T00:35:23.158 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../70-libcephfs-daemon_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:23.158 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libcephfs-daemon (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:23.173 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-17T00:35:23.182 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../71-libcephfs-proxy2_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:23.182 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libcephfs-proxy2 (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:23.196 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-17T00:35:23.204 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../72-libcephfs-dev_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:23.205 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking libcephfs-dev (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:23.220 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package nvme-cli. 2026-02-17T00:35:23.229 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../73-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-17T00:35:23.229 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T00:35:23.259 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-17T00:35:23.268 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../74-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T00:35:23.268 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T00:35:23.297 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-17T00:35:23.306 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../75-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-17T00:35:23.306 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-17T00:35:23.322 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-pluggy. 2026-02-17T00:35:23.330 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../76-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-17T00:35:23.330 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-17T00:35:23.346 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-psutil. 2026-02-17T00:35:23.355 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../77-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-17T00:35:23.355 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-17T00:35:23.375 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-py. 2026-02-17T00:35:23.384 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../78-python3-py_1.10.0-1_all.deb ... 2026-02-17T00:35:23.384 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-17T00:35:23.405 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-pygments. 2026-02-17T00:35:23.413 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../79-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-17T00:35:23.414 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T00:35:23.455 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-toml. 2026-02-17T00:35:23.464 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../80-python3-toml_0.10.2-1_all.deb ... 2026-02-17T00:35:23.464 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-17T00:35:23.479 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-pytest. 2026-02-17T00:35:23.487 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../81-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-17T00:35:23.488 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T00:35:23.509 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-simplejson. 2026-02-17T00:35:23.518 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../82-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-17T00:35:23.518 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-17T00:35:23.543 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package python3-webob. 2026-02-17T00:35:23.552 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../83-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-17T00:35:23.552 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T00:35:23.570 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-17T00:35:23.578 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../84-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-17T00:35:23.578 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-17T00:35:23.647 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package radosgw. 2026-02-17T00:35:23.656 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../85-radosgw_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:23.656 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking radosgw (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:23.814 INFO:teuthology.orchestra.run.trial124.stdout:Selecting previously unselected package rbd-fuse. 2026-02-17T00:35:23.823 INFO:teuthology.orchestra.run.trial124.stdout:Preparing to unpack .../86-rbd-fuse_20.3.0-5225-g03ef619e-1jammy_amd64.deb ... 2026-02-17T00:35:23.823 INFO:teuthology.orchestra.run.trial124.stdout:Unpacking rbd-fuse (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:23.851 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-17T00:35:23.915 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T00:35:23.916 INFO:teuthology.orchestra.run.trial124.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T00:35:23.995 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T00:35:24.270 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-17T00:35:24.687 INFO:teuthology.orchestra.run.trial124.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-17T00:35:24.698 INFO:teuthology.orchestra.run.trial124.stdout:Setting up cephadm (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:24.742 INFO:teuthology.orchestra.run.trial124.stdout:Adding system user cephadm....done 2026-02-17T00:35:24.749 INFO:teuthology.orchestra.run.trial124.stdout:usermod: no changes 2026-02-17T00:35:24.754 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-17T00:35:24.826 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T00:35:24.827 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-17T00:35:24.891 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-17T00:35:24.965 INFO:teuthology.orchestra.run.trial124.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T00:35:24.966 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-17T00:35:25.064 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T00:35:25.186 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-17T00:35:25.261 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-17T00:35:25.337 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-ceph-argparse (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:25.404 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T00:35:25.405 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-17T00:35:25.406 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T00:35:25.407 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T00:35:25.407 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-17T00:35:25.529 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-17T00:35:25.607 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libcephfs-proxy2 (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:25.608 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T00:35:25.687 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-17T00:35:25.778 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T00:35:26.034 INFO:teuthology.orchestra.run.trial124.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-17T00:35:26.035 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T00:35:26.128 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T00:35:26.255 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T00:35:26.335 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-17T00:35:26.407 INFO:teuthology.orchestra.run.trial124.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-17T00:35:26.408 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-ceph-common (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:26.497 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T00:35:27.002 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T00:35:27.006 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-17T00:35:27.086 INFO:teuthology.orchestra.run.trial124.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T00:35:27.087 INFO:teuthology.orchestra.run.trial124.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-17T00:35:27.088 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-17T00:35:27.162 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-17T00:35:27.233 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T00:35:27.234 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-17T00:35:27.312 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-17T00:35:27.384 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-17T00:35:27.461 INFO:teuthology.orchestra.run.trial124.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T00:35:27.461 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-17T00:35:27.545 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T00:35:27.546 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T00:35:27.625 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T00:35:27.710 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-17T00:35:27.783 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T00:35:27.784 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T00:35:27.920 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-17T00:35:27.994 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T00:35:27.995 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-17T00:35:28.080 INFO:teuthology.orchestra.run.trial124.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-17T00:35:28.081 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-17T00:35:28.210 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T00:35:28.211 INFO:teuthology.orchestra.run.trial124.stdout:Setting up librados2 (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:28.212 INFO:teuthology.orchestra.run.trial124.stdout:Setting up librgw2 (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:28.213 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:28.214 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T00:35:28.739 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libcephfs2 (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:28.740 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libradosstriper1 (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:28.741 INFO:teuthology.orchestra.run.trial124.stdout:Setting up librbd1 (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:28.742 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-mgr-modules-core (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:28.743 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-fuse (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:28.816 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T00:35:28.816 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T00:35:29.244 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libcephfs-dev (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:29.245 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-rados (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:29.246 INFO:teuthology.orchestra.run.trial124.stdout:Setting up libcephfs-daemon (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:29.247 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-rbd (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:29.248 INFO:teuthology.orchestra.run.trial124.stdout:Setting up rbd-fuse (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:29.249 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-rgw (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:29.250 INFO:teuthology.orchestra.run.trial124.stdout:Setting up python3-cephfs (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:29.250 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-common (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:29.278 INFO:teuthology.orchestra.run.trial124.stdout:Adding group ceph....done 2026-02-17T00:35:29.312 INFO:teuthology.orchestra.run.trial124.stdout:Adding system user ceph....done 2026-02-17T00:35:29.322 INFO:teuthology.orchestra.run.trial124.stdout:Setting system user ceph properties....done 2026-02-17T00:35:29.328 INFO:teuthology.orchestra.run.trial124.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-17T00:35:29.416 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-17T00:35:29.705 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-17T00:35:30.093 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-test (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:30.093 INFO:teuthology.orchestra.run.trial124.stdout:Setting up radosgw (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:30.355 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T00:35:30.355 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T00:35:30.759 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-base (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:30.876 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-17T00:35:31.274 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-mds (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:31.333 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T00:35:31.333 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T00:35:31.732 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-mgr (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:31.806 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T00:35:31.806 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T00:35:32.183 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:32.184 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-osd-classic (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:32.201 INFO:teuthology.orchestra.run.trial124.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-17T00:35:32.210 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:32.222 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-mon (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:32.292 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T00:35:32.292 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T00:35:32.708 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-mgr-cephadm (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:32.718 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-mgr-dashboard (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:32.729 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-osd (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:32.812 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T00:35:32.812 INFO:teuthology.orchestra.run.trial124.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T00:35:33.245 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:33.246 INFO:teuthology.orchestra.run.trial124.stdout:Setting up ceph-volume (20.3.0-5225-g03ef619e-1jammy) ... 2026-02-17T00:35:33.354 INFO:teuthology.orchestra.run.trial124.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-17T00:35:33.437 INFO:teuthology.orchestra.run.trial124.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-17T00:35:33.861 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:33.861 INFO:teuthology.orchestra.run.trial124.stdout:Running kernel seems to be up-to-date. 2026-02-17T00:35:33.861 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:33.861 INFO:teuthology.orchestra.run.trial124.stdout:The processor microcode seems to be up-to-date. 2026-02-17T00:35:33.861 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:33.861 INFO:teuthology.orchestra.run.trial124.stdout:No services need to be restarted. 2026-02-17T00:35:33.861 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:33.861 INFO:teuthology.orchestra.run.trial124.stdout:No containers need to be restarted. 2026-02-17T00:35:33.862 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:33.862 INFO:teuthology.orchestra.run.trial124.stdout:No user sessions are running outdated binaries. 2026-02-17T00:35:33.862 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:33.862 INFO:teuthology.orchestra.run.trial124.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T00:35:34.510 INFO:teuthology.orchestra.run.trial124.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-17T00:35:34.518 DEBUG:teuthology.parallel:result is None 2026-02-17T00:35:34.518 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=03ef619e79a56cd363b087a5c6f19a1a09b49040 2026-02-17T00:35:34.677 DEBUG:teuthology.orchestra.run.trial124:> dpkg-query -W -f '${Version}' ceph 2026-02-17T00:35:34.687 INFO:teuthology.orchestra.run.trial124.stdout:20.3.0-5225-g03ef619e-1jammy 2026-02-17T00:35:34.687 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5225-g03ef619e-1jammy 2026-02-17T00:35:34.687 INFO:teuthology.task.install:The correct ceph version 20.3.0-5225-g03ef619e-1jammy is installed. 2026-02-17T00:35:34.689 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T00:35:34.689 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:34.689 DEBUG:teuthology.orchestra.run.trial124:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T00:35:34.738 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T00:35:34.738 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:34.738 DEBUG:teuthology.orchestra.run.trial124:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T00:35:34.789 DEBUG:teuthology.orchestra.run.trial124:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T00:35:34.837 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T00:35:34.838 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:34.838 DEBUG:teuthology.orchestra.run.trial124:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T00:35:34.892 DEBUG:teuthology.orchestra.run.trial124:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T00:35:34.941 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T00:35:34.942 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:34.942 DEBUG:teuthology.orchestra.run.trial124:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T00:35:34.989 DEBUG:teuthology.orchestra.run.trial124:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T00:35:35.037 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T00:35:35.145 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T00:35:35.145 DEBUG:teuthology.orchestra.run.trial124:> sudo chmod 777 /var/log/ceph 2026-02-17T00:35:35.153 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T00:35:35.153 DEBUG:teuthology.orchestra.run.trial124:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T00:35:35.200 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T00:35:35.200 DEBUG:teuthology.orchestra.run.trial124:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T00:35:35.257 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T00:35:35.257 INFO:tasks.ceph:config {'conf': {'osd': {'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T00:35:35.257 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48611', 'branch': 'wip-ifed-fix-vselector-in-envmode_index_file', 'description': 'rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}', 'email': 'akupczyk@ibm.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '48611', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-ifed-fix-vselector-in-envmode_index_file'}, 'ceph': {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '03ef619e79a56cd363b087a5c6f19a1a09b49040'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '03ef619e79a56cd363b087a5c6f19a1a09b49040'}}, 'workunit': {'branch': 'wip-ifed-fix-vselector-in-envmode_index_file', 'sha1': '03ef619e79a56cd363b087a5c6f19a1a09b49040'}}, 'owner': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'osd.8', 'osd.9', 'client.0']], 'seed': 6708, 'sha1': '03ef619e79a56cd363b087a5c6f19a1a09b49040', 'sleep_before_teardown': 0, 'subset': '582/12264', 'suite': 'rados', 'suite_branch': 'wip-ifed-fix-vselector-in-envmode_index_file', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_03ef619e79a56cd363b087a5c6f19a1a09b49040/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '03ef619e79a56cd363b087a5c6f19a1a09b49040', 'targets': {'trial124.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLXLn+foLJS976cdzrBvCN8qzUyNiT2wISIDvfy6OEOpVKK3IHDIN+cStb9nx2oTf6hLnUbtJR4ju7e84/0mPbs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'log-ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'flavor': 'default', 'sha1': '03ef619e79a56cd363b087a5c6f19a1a09b49040', 'cluster': 'ceph'}}, {'workunit': {'clients': {'all': ['rados/test_health_warnings.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8bec0da71becad44414c54979f64c9ef0e7099c6', 'timestamp': '2026-02-13_08:57:15', 'tube': 'trial', 'user': 'jayaprakash', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T00:35:35.257 DEBUG:teuthology.orchestra.run.trial124:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T00:35:35.293 DEBUG:teuthology.orchestra.run.trial124:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T00:35:35.341 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:35.341 DEBUG:teuthology.orchestra.run.trial124:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T00:35:35.385 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T00:35:35.385 DEBUG:teuthology.orchestra.run.trial124:> stat /dev/vg_nvme/lv_1 2026-02-17T00:35:35.428 INFO:teuthology.orchestra.run.trial124.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T00:35:35.429 INFO:teuthology.orchestra.run.trial124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:35:35.429 INFO:teuthology.orchestra.run.trial124.stdout:Device: 5h/5d Inode: 899 Links: 1 2026-02-17T00:35:35.429 INFO:teuthology.orchestra.run.trial124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:35:35.429 INFO:teuthology.orchestra.run.trial124.stdout:Access: 2026-02-17 00:34:18.869487353 +0000 2026-02-17T00:35:35.429 INFO:teuthology.orchestra.run.trial124.stdout:Modify: 2026-02-17 00:34:18.865487481 +0000 2026-02-17T00:35:35.429 INFO:teuthology.orchestra.run.trial124.stdout:Change: 2026-02-17 00:34:18.865487481 +0000 2026-02-17T00:35:35.429 INFO:teuthology.orchestra.run.trial124.stdout: Birth: - 2026-02-17T00:35:35.429 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T00:35:35.476 INFO:teuthology.orchestra.run.trial124.stderr:1+0 records in 2026-02-17T00:35:35.476 INFO:teuthology.orchestra.run.trial124.stderr:1+0 records out 2026-02-17T00:35:35.476 INFO:teuthology.orchestra.run.trial124.stderr:512 bytes copied, 0.000175475 s, 2.9 MB/s 2026-02-17T00:35:35.477 DEBUG:teuthology.orchestra.run.trial124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T00:35:35.522 DEBUG:teuthology.orchestra.run.trial124:> stat /dev/vg_nvme/lv_2 2026-02-17T00:35:35.569 INFO:teuthology.orchestra.run.trial124.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T00:35:35.570 INFO:teuthology.orchestra.run.trial124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:35:35.570 INFO:teuthology.orchestra.run.trial124.stdout:Device: 5h/5d Inode: 935 Links: 1 2026-02-17T00:35:35.570 INFO:teuthology.orchestra.run.trial124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:35:35.570 INFO:teuthology.orchestra.run.trial124.stdout:Access: 2026-02-17 00:34:19.333472571 +0000 2026-02-17T00:35:35.571 INFO:teuthology.orchestra.run.trial124.stdout:Modify: 2026-02-17 00:34:19.181477415 +0000 2026-02-17T00:35:35.571 INFO:teuthology.orchestra.run.trial124.stdout:Change: 2026-02-17 00:34:19.181477415 +0000 2026-02-17T00:35:35.571 INFO:teuthology.orchestra.run.trial124.stdout: Birth: - 2026-02-17T00:35:35.571 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T00:35:35.627 INFO:teuthology.orchestra.run.trial124.stderr:1+0 records in 2026-02-17T00:35:35.629 INFO:teuthology.orchestra.run.trial124.stderr:1+0 records out 2026-02-17T00:35:35.629 INFO:teuthology.orchestra.run.trial124.stderr:512 bytes copied, 0.000227551 s, 2.3 MB/s 2026-02-17T00:35:35.632 DEBUG:teuthology.orchestra.run.trial124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T00:35:35.674 DEBUG:teuthology.orchestra.run.trial124:> stat /dev/vg_nvme/lv_3 2026-02-17T00:35:35.721 INFO:teuthology.orchestra.run.trial124.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T00:35:35.721 INFO:teuthology.orchestra.run.trial124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:35:35.722 INFO:teuthology.orchestra.run.trial124.stdout:Device: 5h/5d Inode: 948 Links: 1 2026-02-17T00:35:35.722 INFO:teuthology.orchestra.run.trial124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:35:35.722 INFO:teuthology.orchestra.run.trial124.stdout:Access: 2026-02-17 00:34:19.653462376 +0000 2026-02-17T00:35:35.722 INFO:teuthology.orchestra.run.trial124.stdout:Modify: 2026-02-17 00:34:19.509466965 +0000 2026-02-17T00:35:35.722 INFO:teuthology.orchestra.run.trial124.stdout:Change: 2026-02-17 00:34:19.509466965 +0000 2026-02-17T00:35:35.722 INFO:teuthology.orchestra.run.trial124.stdout: Birth: - 2026-02-17T00:35:35.723 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T00:35:35.774 INFO:teuthology.orchestra.run.trial124.stderr:1+0 records in 2026-02-17T00:35:35.774 INFO:teuthology.orchestra.run.trial124.stderr:1+0 records out 2026-02-17T00:35:35.775 INFO:teuthology.orchestra.run.trial124.stderr:512 bytes copied, 0.000161399 s, 3.2 MB/s 2026-02-17T00:35:35.775 DEBUG:teuthology.orchestra.run.trial124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T00:35:35.822 DEBUG:teuthology.orchestra.run.trial124:> stat /dev/vg_nvme/lv_4 2026-02-17T00:35:35.868 INFO:teuthology.orchestra.run.trial124.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T00:35:35.868 INFO:teuthology.orchestra.run.trial124.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T00:35:35.868 INFO:teuthology.orchestra.run.trial124.stdout:Device: 5h/5d Inode: 982 Links: 1 2026-02-17T00:35:35.868 INFO:teuthology.orchestra.run.trial124.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T00:35:35.868 INFO:teuthology.orchestra.run.trial124.stdout:Access: 2026-02-17 00:34:19.993451545 +0000 2026-02-17T00:35:35.868 INFO:teuthology.orchestra.run.trial124.stdout:Modify: 2026-02-17 00:34:19.837456515 +0000 2026-02-17T00:35:35.868 INFO:teuthology.orchestra.run.trial124.stdout:Change: 2026-02-17 00:34:19.837456515 +0000 2026-02-17T00:35:35.868 INFO:teuthology.orchestra.run.trial124.stdout: Birth: - 2026-02-17T00:35:35.869 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T00:35:35.916 INFO:teuthology.orchestra.run.trial124.stderr:1+0 records in 2026-02-17T00:35:35.916 INFO:teuthology.orchestra.run.trial124.stderr:1+0 records out 2026-02-17T00:35:35.916 INFO:teuthology.orchestra.run.trial124.stderr:512 bytes copied, 0.000183028 s, 2.8 MB/s 2026-02-17T00:35:35.917 DEBUG:teuthology.orchestra.run.trial124:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T00:35:35.962 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T00:35:35.962 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial124.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-17T00:35:35.962 INFO:tasks.ceph:Generating config... 2026-02-17T00:35:35.963 INFO:tasks.ceph:[osd] osd max object name len = 400 2026-02-17T00:35:35.963 INFO:tasks.ceph:[osd] osd max object namespace len = 64 2026-02-17T00:35:35.963 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T00:35:35.963 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T00:35:35.963 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T00:35:35.963 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T00:35:35.963 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T00:35:35.963 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T00:35:35.963 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T00:35:35.963 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-17T00:35:35.963 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T00:35:35.964 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T00:35:35.964 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-17T00:35:35.964 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T00:35:35.964 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T00:35:35.964 INFO:tasks.ceph:[mon] debug mon = 30 2026-02-17T00:35:35.964 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T00:35:35.964 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T00:35:35.964 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T00:35:35.964 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T00:35:35.964 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T00:35:36.022 INFO:teuthology.orchestra.run.trial124.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T00:35:36.025 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T00:35:36.084 DEBUG:teuthology.orchestra.run.trial124:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T00:35:36.134 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.124')] 2026-02-17T00:35:36.135 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.124', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'osd max object name len': 400, 'osd max object namespace len': 64, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 30, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-17T00:35:36.137 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:36.138 DEBUG:teuthology.orchestra.run.trial124:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T00:35:36.182 DEBUG:teuthology.orchestra.run.trial124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.124 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:36.242 INFO:teuthology.orchestra.run.trial124.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:36.242 INFO:teuthology.orchestra.run.trial124.stdout:monmaptool: generated fsid f197ec5f-226a-4c0a-a1e0-350b07c62afb 2026-02-17T00:35:36.242 INFO:teuthology.orchestra.run.trial124.stdout:setting min_mon_release = tentacle 2026-02-17T00:35:36.242 INFO:teuthology.orchestra.run.trial124.stdout:epoch 0 2026-02-17T00:35:36.242 INFO:teuthology.orchestra.run.trial124.stdout:fsid f197ec5f-226a-4c0a-a1e0-350b07c62afb 2026-02-17T00:35:36.242 INFO:teuthology.orchestra.run.trial124.stdout:last_changed 2026-02-17T00:35:36.238952+0000 2026-02-17T00:35:36.242 INFO:teuthology.orchestra.run.trial124.stdout:created 2026-02-17T00:35:36.238952+0000 2026-02-17T00:35:36.243 INFO:teuthology.orchestra.run.trial124.stdout:min_mon_release 20 (tentacle) 2026-02-17T00:35:36.243 INFO:teuthology.orchestra.run.trial124.stdout:election_strategy: 3 2026-02-17T00:35:36.243 INFO:teuthology.orchestra.run.trial124.stdout:0: [v2:10.20.193.124:3300/0,v1:10.20.193.124:6789/0] mon.a 2026-02-17T00:35:36.243 INFO:teuthology.orchestra.run.trial124.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-17T00:35:36.244 DEBUG:teuthology.orchestra.run.trial124:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T00:35:36.289 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f197ec5f-226a-4c0a-a1e0-350b07c62afb... 2026-02-17T00:35:36.290 DEBUG:teuthology.orchestra.run.trial124:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T00:35:36.349 INFO:teuthology.orchestra.run.trial124.stdout:[global] 2026-02-17T00:35:36.349 INFO:teuthology.orchestra.run.trial124.stdout: chdir = "" 2026-02-17T00:35:36.349 INFO:teuthology.orchestra.run.trial124.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T00:35:36.349 INFO:teuthology.orchestra.run.trial124.stdout: auth supported = cephx 2026-02-17T00:35:36.349 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.349 INFO:teuthology.orchestra.run.trial124.stdout: filestore xattr use omap = true 2026-02-17T00:35:36.349 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.350 INFO:teuthology.orchestra.run.trial124.stdout: mon clock drift allowed = 1.000 2026-02-17T00:35:36.350 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.350 INFO:teuthology.orchestra.run.trial124.stdout: osd crush chooseleaf type = 0 2026-02-17T00:35:36.350 INFO:teuthology.orchestra.run.trial124.stdout: auth debug = true 2026-02-17T00:35:36.350 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.350 INFO:teuthology.orchestra.run.trial124.stdout: ms die on old message = true 2026-02-17T00:35:36.350 INFO:teuthology.orchestra.run.trial124.stdout: ms die on bug = true 2026-02-17T00:35:36.350 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.350 INFO:teuthology.orchestra.run.trial124.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T00:35:36.350 INFO:teuthology.orchestra.run.trial124.stdout: mon pg warn max object skew = 0 2026-02-17T00:35:36.350 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.350 INFO:teuthology.orchestra.run.trial124.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T00:35:36.351 INFO:teuthology.orchestra.run.trial124.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T00:35:36.351 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.351 INFO:teuthology.orchestra.run.trial124.stdout: osd pool default size = 2 2026-02-17T00:35:36.351 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.351 INFO:teuthology.orchestra.run.trial124.stdout: mon osd allow primary affinity = true 2026-02-17T00:35:36.351 INFO:teuthology.orchestra.run.trial124.stdout: mon osd allow pg remap = true 2026-02-17T00:35:36.351 INFO:teuthology.orchestra.run.trial124.stdout: mon warn on legacy crush tunables = false 2026-02-17T00:35:36.351 INFO:teuthology.orchestra.run.trial124.stdout: mon warn on crush straw calc version zero = false 2026-02-17T00:35:36.351 INFO:teuthology.orchestra.run.trial124.stdout: mon warn on no sortbitwise = false 2026-02-17T00:35:36.351 INFO:teuthology.orchestra.run.trial124.stdout: mon warn on osd down out interval zero = false 2026-02-17T00:35:36.351 INFO:teuthology.orchestra.run.trial124.stdout: mon warn on too few osds = false 2026-02-17T00:35:36.351 INFO:teuthology.orchestra.run.trial124.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T00:35:36.352 INFO:teuthology.orchestra.run.trial124.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T00:35:36.352 INFO:teuthology.orchestra.run.trial124.stdout: mon_allow_pool_size_one = true 2026-02-17T00:35:36.352 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.352 INFO:teuthology.orchestra.run.trial124.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T00:35:36.352 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.352 INFO:teuthology.orchestra.run.trial124.stdout: osd default data pool replay window = 5 2026-02-17T00:35:36.352 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.352 INFO:teuthology.orchestra.run.trial124.stdout: mon allow pool delete = true 2026-02-17T00:35:36.352 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.352 INFO:teuthology.orchestra.run.trial124.stdout: mon cluster log file level = debug 2026-02-17T00:35:36.352 INFO:teuthology.orchestra.run.trial124.stdout: debug asserts on shutdown = true 2026-02-17T00:35:36.352 INFO:teuthology.orchestra.run.trial124.stdout: mon health detail to clog = false 2026-02-17T00:35:36.353 INFO:teuthology.orchestra.run.trial124.stdout: mon host = 10.20.193.124 2026-02-17T00:35:36.353 INFO:teuthology.orchestra.run.trial124.stdout: mon election default strategy = 3 2026-02-17T00:35:36.353 INFO:teuthology.orchestra.run.trial124.stdout: fsid = f197ec5f-226a-4c0a-a1e0-350b07c62afb 2026-02-17T00:35:36.353 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.353 INFO:teuthology.orchestra.run.trial124.stdout:[osd] 2026-02-17T00:35:36.353 INFO:teuthology.orchestra.run.trial124.stdout: osd journal size = 100 2026-02-17T00:35:36.353 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.353 INFO:teuthology.orchestra.run.trial124.stdout: osd scrub load threshold = 5.0 2026-02-17T00:35:36.353 INFO:teuthology.orchestra.run.trial124.stdout: osd scrub max interval = 600 2026-02-17T00:35:36.353 INFO:teuthology.orchestra.run.trial124.stdout: osd mclock profile = high_recovery_ops 2026-02-17T00:35:36.353 INFO:teuthology.orchestra.run.trial124.stdout: osd mclock skip benchmark = True 2026-02-17T00:35:36.353 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.354 INFO:teuthology.orchestra.run.trial124.stdout: osd recover clone overlap = true 2026-02-17T00:35:36.354 INFO:teuthology.orchestra.run.trial124.stdout: osd recovery max chunk = 1048576 2026-02-17T00:35:36.354 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.354 INFO:teuthology.orchestra.run.trial124.stdout: osd debug shutdown = true 2026-02-17T00:35:36.354 INFO:teuthology.orchestra.run.trial124.stdout: osd debug op order = true 2026-02-17T00:35:36.354 INFO:teuthology.orchestra.run.trial124.stdout: osd debug verify stray on activate = true 2026-02-17T00:35:36.354 INFO:teuthology.orchestra.run.trial124.stdout: osd debug trim objects = true 2026-02-17T00:35:36.354 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.354 INFO:teuthology.orchestra.run.trial124.stdout: osd open classes on start = true 2026-02-17T00:35:36.354 INFO:teuthology.orchestra.run.trial124.stdout: osd debug pg log writeout = true 2026-02-17T00:35:36.354 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.354 INFO:teuthology.orchestra.run.trial124.stdout: osd deep scrub update digest min age = 30 2026-02-17T00:35:36.355 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.355 INFO:teuthology.orchestra.run.trial124.stdout: osd map max advance = 10 2026-02-17T00:35:36.355 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.355 INFO:teuthology.orchestra.run.trial124.stdout: journal zero on create = true 2026-02-17T00:35:36.355 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.355 INFO:teuthology.orchestra.run.trial124.stdout: filestore ondisk finisher threads = 3 2026-02-17T00:35:36.355 INFO:teuthology.orchestra.run.trial124.stdout: filestore apply finisher threads = 3 2026-02-17T00:35:36.355 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.355 INFO:teuthology.orchestra.run.trial124.stdout: bdev debug aio = true 2026-02-17T00:35:36.355 INFO:teuthology.orchestra.run.trial124.stdout: osd debug misdirected ops = true 2026-02-17T00:35:36.355 INFO:teuthology.orchestra.run.trial124.stdout: osd max object name len = 400 2026-02-17T00:35:36.355 INFO:teuthology.orchestra.run.trial124.stdout: osd max object namespace len = 64 2026-02-17T00:35:36.355 INFO:teuthology.orchestra.run.trial124.stdout: bluestore zero block detection = True 2026-02-17T00:35:36.356 INFO:teuthology.orchestra.run.trial124.stdout: debug ms = 1 2026-02-17T00:35:36.356 INFO:teuthology.orchestra.run.trial124.stdout: debug osd = 20 2026-02-17T00:35:36.356 INFO:teuthology.orchestra.run.trial124.stdout: osd debug verify cached snaps = True 2026-02-17T00:35:36.356 INFO:teuthology.orchestra.run.trial124.stdout: osd debug verify missing on start = True 2026-02-17T00:35:36.356 INFO:teuthology.orchestra.run.trial124.stdout: osd mclock override recovery settings = True 2026-02-17T00:35:36.356 INFO:teuthology.orchestra.run.trial124.stdout: osd op queue = debug_random 2026-02-17T00:35:36.356 INFO:teuthology.orchestra.run.trial124.stdout: osd op queue cut off = debug_random 2026-02-17T00:35:36.356 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.356 INFO:teuthology.orchestra.run.trial124.stdout:[mgr] 2026-02-17T00:35:36.356 INFO:teuthology.orchestra.run.trial124.stdout: debug ms = 1 2026-02-17T00:35:36.356 INFO:teuthology.orchestra.run.trial124.stdout: debug mgr = 20 2026-02-17T00:35:36.356 INFO:teuthology.orchestra.run.trial124.stdout: debug mon = 20 2026-02-17T00:35:36.356 INFO:teuthology.orchestra.run.trial124.stdout: debug auth = 20 2026-02-17T00:35:36.357 INFO:teuthology.orchestra.run.trial124.stdout: mon reweight min pgs per osd = 4 2026-02-17T00:35:36.357 INFO:teuthology.orchestra.run.trial124.stdout: mon reweight min bytes per osd = 10 2026-02-17T00:35:36.357 INFO:teuthology.orchestra.run.trial124.stdout: mgr/telemetry/nag = false 2026-02-17T00:35:36.357 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.357 INFO:teuthology.orchestra.run.trial124.stdout:[mon] 2026-02-17T00:35:36.357 INFO:teuthology.orchestra.run.trial124.stdout: debug ms = 1 2026-02-17T00:35:36.357 INFO:teuthology.orchestra.run.trial124.stdout: debug mon = 30 2026-02-17T00:35:36.357 INFO:teuthology.orchestra.run.trial124.stdout: debug paxos = 20 2026-02-17T00:35:36.357 INFO:teuthology.orchestra.run.trial124.stdout: debug auth = 20 2026-02-17T00:35:36.357 INFO:teuthology.orchestra.run.trial124.stdout: mon data avail warn = 5 2026-02-17T00:35:36.357 INFO:teuthology.orchestra.run.trial124.stdout: mon mgr mkfs grace = 240 2026-02-17T00:35:36.357 INFO:teuthology.orchestra.run.trial124.stdout: mon reweight min pgs per osd = 4 2026-02-17T00:35:36.357 INFO:teuthology.orchestra.run.trial124.stdout: mon osd reporter subtree level = osd 2026-02-17T00:35:36.358 INFO:teuthology.orchestra.run.trial124.stdout: mon osd prime pg temp = true 2026-02-17T00:35:36.358 INFO:teuthology.orchestra.run.trial124.stdout: mon reweight min bytes per osd = 10 2026-02-17T00:35:36.358 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.358 INFO:teuthology.orchestra.run.trial124.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T00:35:36.358 INFO:teuthology.orchestra.run.trial124.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T00:35:36.358 INFO:teuthology.orchestra.run.trial124.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T00:35:36.358 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.358 INFO:teuthology.orchestra.run.trial124.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T00:35:36.358 INFO:teuthology.orchestra.run.trial124.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T00:35:36.358 INFO:teuthology.orchestra.run.trial124.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T00:35:36.358 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.358 INFO:teuthology.orchestra.run.trial124.stdout: # 1m isn't quite enough 2026-02-17T00:35:36.359 INFO:teuthology.orchestra.run.trial124.stdout: mon_down_mkfs_grace = 2m 2026-02-17T00:35:36.359 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.359 INFO:teuthology.orchestra.run.trial124.stdout: mon_warn_on_filestore_osds = false 2026-02-17T00:35:36.359 INFO:teuthology.orchestra.run.trial124.stdout: mon scrub interval = 300 2026-02-17T00:35:36.359 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:36.359 INFO:teuthology.orchestra.run.trial124.stdout:[client] 2026-02-17T00:35:36.359 INFO:teuthology.orchestra.run.trial124.stdout: rgw cache enabled = true 2026-02-17T00:35:36.359 INFO:teuthology.orchestra.run.trial124.stdout: rgw enable ops log = true 2026-02-17T00:35:36.359 INFO:teuthology.orchestra.run.trial124.stdout: rgw enable usage log = true 2026-02-17T00:35:36.359 INFO:teuthology.orchestra.run.trial124.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T00:35:36.359 INFO:teuthology.orchestra.run.trial124.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T00:35:36.359 INFO:teuthology.orchestra.run.trial124.stdout:[mon.a] 2026-02-17T00:35:36.361 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T00:35:36.361 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T00:35:36.424 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T00:35:36.425 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:36.425 DEBUG:teuthology.orchestra.run.trial124:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T00:35:36.470 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:36.470 DEBUG:teuthology.orchestra.run.trial124:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T00:35:36.517 INFO:tasks.ceph:Sending monmap to node ubuntu@trial124.front.sepia.ceph.com 2026-02-17T00:35:36.517 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:36.517 DEBUG:teuthology.orchestra.run.trial124:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T00:35:36.517 DEBUG:teuthology.orchestra.run.trial124:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T00:35:36.571 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:36.572 DEBUG:teuthology.orchestra.run.trial124:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:36.618 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T00:35:36.618 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T00:35:36.618 DEBUG:teuthology.orchestra.run.trial124:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T00:35:36.690 INFO:teuthology.orchestra.run.trial124.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T00:35:36.692 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T00:35:36.693 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T00:35:36.693 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T00:35:36.756 INFO:teuthology.orchestra.run.trial124.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T00:35:36.764 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T00:35:36.764 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial124.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-17T00:35:36.764 DEBUG:teuthology.orchestra.run.trial124:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T00:35:36.813 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T00:35:36.814 INFO:tasks.ceph:role: osd.0 2026-02-17T00:35:36.814 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial124.front.sepia.ceph.com 2026-02-17T00:35:36.814 DEBUG:teuthology.orchestra.run.trial124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T00:35:36.867 INFO:teuthology.orchestra.run.trial124.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T00:35:36.867 INFO:teuthology.orchestra.run.trial124.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T00:35:36.867 INFO:teuthology.orchestra.run.trial124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T00:35:36.867 INFO:teuthology.orchestra.run.trial124.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T00:35:36.867 INFO:teuthology.orchestra.run.trial124.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T00:35:36.867 INFO:teuthology.orchestra.run.trial124.stdout: = sunit=0 swidth=0 blks 2026-02-17T00:35:36.867 INFO:teuthology.orchestra.run.trial124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T00:35:36.868 INFO:teuthology.orchestra.run.trial124.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T00:35:36.868 INFO:teuthology.orchestra.run.trial124.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T00:35:36.868 INFO:teuthology.orchestra.run.trial124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T00:35:37.445 INFO:teuthology.orchestra.run.trial124.stdout:Discarding blocks...Done. 2026-02-17T00:35:37.446 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial124.front.sepia.ceph.com -o noatime 2026-02-17T00:35:37.446 DEBUG:teuthology.orchestra.run.trial124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T00:35:37.501 DEBUG:teuthology.orchestra.run.trial124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T00:35:37.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:35:37.552 INFO:teuthology.orchestra.run.trial124.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T00:35:37.553 DEBUG:teuthology.orchestra.run.trial124:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T00:35:37.602 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T00:35:37.602 INFO:tasks.ceph:role: osd.1 2026-02-17T00:35:37.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial124.front.sepia.ceph.com 2026-02-17T00:35:37.603 DEBUG:teuthology.orchestra.run.trial124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T00:35:37.655 INFO:teuthology.orchestra.run.trial124.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T00:35:37.656 INFO:teuthology.orchestra.run.trial124.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T00:35:37.656 INFO:teuthology.orchestra.run.trial124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T00:35:37.656 INFO:teuthology.orchestra.run.trial124.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T00:35:37.656 INFO:teuthology.orchestra.run.trial124.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T00:35:37.656 INFO:teuthology.orchestra.run.trial124.stdout: = sunit=0 swidth=0 blks 2026-02-17T00:35:37.656 INFO:teuthology.orchestra.run.trial124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T00:35:37.656 INFO:teuthology.orchestra.run.trial124.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T00:35:37.656 INFO:teuthology.orchestra.run.trial124.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T00:35:37.656 INFO:teuthology.orchestra.run.trial124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T00:35:38.223 INFO:teuthology.orchestra.run.trial124.stdout:Discarding blocks...Done. 2026-02-17T00:35:38.224 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial124.front.sepia.ceph.com -o noatime 2026-02-17T00:35:38.224 DEBUG:teuthology.orchestra.run.trial124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T00:35:38.283 DEBUG:teuthology.orchestra.run.trial124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T00:35:38.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:35:38.332 INFO:teuthology.orchestra.run.trial124.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T00:35:38.333 DEBUG:teuthology.orchestra.run.trial124:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T00:35:38.381 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T00:35:38.382 INFO:tasks.ceph:role: osd.2 2026-02-17T00:35:38.382 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial124.front.sepia.ceph.com 2026-02-17T00:35:38.382 DEBUG:teuthology.orchestra.run.trial124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T00:35:38.435 INFO:teuthology.orchestra.run.trial124.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T00:35:38.435 INFO:teuthology.orchestra.run.trial124.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T00:35:38.435 INFO:teuthology.orchestra.run.trial124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T00:35:38.435 INFO:teuthology.orchestra.run.trial124.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T00:35:38.436 INFO:teuthology.orchestra.run.trial124.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T00:35:38.436 INFO:teuthology.orchestra.run.trial124.stdout: = sunit=0 swidth=0 blks 2026-02-17T00:35:38.436 INFO:teuthology.orchestra.run.trial124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T00:35:38.436 INFO:teuthology.orchestra.run.trial124.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T00:35:38.436 INFO:teuthology.orchestra.run.trial124.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T00:35:38.436 INFO:teuthology.orchestra.run.trial124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T00:35:38.998 INFO:teuthology.orchestra.run.trial124.stdout:Discarding blocks...Done. 2026-02-17T00:35:39.000 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial124.front.sepia.ceph.com -o noatime 2026-02-17T00:35:39.000 DEBUG:teuthology.orchestra.run.trial124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T00:35:39.059 DEBUG:teuthology.orchestra.run.trial124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T00:35:39.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:35:39.108 INFO:teuthology.orchestra.run.trial124.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T00:35:39.108 DEBUG:teuthology.orchestra.run.trial124:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-17T00:35:39.158 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T00:35:39.158 INFO:tasks.ceph:role: osd.3 2026-02-17T00:35:39.158 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial124.front.sepia.ceph.com 2026-02-17T00:35:39.158 DEBUG:teuthology.orchestra.run.trial124:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T00:35:39.211 INFO:teuthology.orchestra.run.trial124.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T00:35:39.212 INFO:teuthology.orchestra.run.trial124.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T00:35:39.212 INFO:teuthology.orchestra.run.trial124.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T00:35:39.212 INFO:teuthology.orchestra.run.trial124.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T00:35:39.212 INFO:teuthology.orchestra.run.trial124.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T00:35:39.213 INFO:teuthology.orchestra.run.trial124.stdout: = sunit=0 swidth=0 blks 2026-02-17T00:35:39.213 INFO:teuthology.orchestra.run.trial124.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T00:35:39.213 INFO:teuthology.orchestra.run.trial124.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T00:35:39.213 INFO:teuthology.orchestra.run.trial124.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T00:35:39.213 INFO:teuthology.orchestra.run.trial124.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T00:35:39.771 INFO:teuthology.orchestra.run.trial124.stdout:Discarding blocks...Done. 2026-02-17T00:35:39.773 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial124.front.sepia.ceph.com -o noatime 2026-02-17T00:35:39.773 DEBUG:teuthology.orchestra.run.trial124:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-17T00:35:39.830 DEBUG:teuthology.orchestra.run.trial124:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-17T00:35:39.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:35:39.880 INFO:teuthology.orchestra.run.trial124.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T00:35:39.880 DEBUG:teuthology.orchestra.run.trial124:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-17T00:35:39.930 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T00:35:39.930 INFO:tasks.ceph:role: osd.4 2026-02-17T00:35:39.930 DEBUG:teuthology.orchestra.run.trial124:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-17T00:35:39.981 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T00:35:39.981 INFO:tasks.ceph:role: osd.5 2026-02-17T00:35:39.982 DEBUG:teuthology.orchestra.run.trial124:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-17T00:35:40.028 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T00:35:40.028 INFO:tasks.ceph:role: osd.6 2026-02-17T00:35:40.028 DEBUG:teuthology.orchestra.run.trial124:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-17T00:35:40.077 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T00:35:40.077 INFO:tasks.ceph:role: osd.7 2026-02-17T00:35:40.078 DEBUG:teuthology.orchestra.run.trial124:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-17T00:35:40.125 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T00:35:40.125 INFO:tasks.ceph:role: osd.8 2026-02-17T00:35:40.126 DEBUG:teuthology.orchestra.run.trial124:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-17T00:35:40.173 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T00:35:40.173 INFO:tasks.ceph:role: osd.9 2026-02-17T00:35:40.174 DEBUG:teuthology.orchestra.run.trial124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:40.235 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:40.227+0000 7f2be9e8ca40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T00:35:40.235 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:40.227+0000 7f2be9e8ca40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T00:35:40.235 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:40.227+0000 7f2be9e8ca40 -1 bdev(0x55958bd5b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T00:35:40.235 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:40.227+0000 7f2be9e8ca40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T00:35:40.856 DEBUG:teuthology.orchestra.run.trial124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T00:35:40.907 DEBUG:teuthology.orchestra.run.trial124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:40.969 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:40.959+0000 7f0e11754a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T00:35:40.970 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:40.963+0000 7f0e11754a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T00:35:40.970 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:40.963+0000 7f0e11754a40 -1 bdev(0x55af88d89800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T00:35:40.970 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:40.963+0000 7f0e11754a40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T00:35:41.601 DEBUG:teuthology.orchestra.run.trial124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T00:35:41.653 DEBUG:teuthology.orchestra.run.trial124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:41.718 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:41.711+0000 7ff00d51ba40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T00:35:41.718 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:41.711+0000 7ff00d51ba40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T00:35:41.719 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:41.711+0000 7ff00d51ba40 -1 bdev(0x563dd8859800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T00:35:41.719 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:41.711+0000 7ff00d51ba40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T00:35:42.359 DEBUG:teuthology.orchestra.run.trial124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T00:35:42.410 DEBUG:teuthology.orchestra.run.trial124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:42.474 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:42.467+0000 7fc178d34a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-17T00:35:42.475 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:42.467+0000 7fc178d34a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-17T00:35:42.475 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:42.467+0000 7fc178d34a40 -1 bdev(0x55cb1ef7b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-17T00:35:42.475 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:42.467+0000 7fc178d34a40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-17T00:35:43.113 DEBUG:teuthology.orchestra.run.trial124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-17T00:35:43.166 DEBUG:teuthology.orchestra.run.trial124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:43.229 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:43.219+0000 7f9b55507a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-17T00:35:43.230 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:43.223+0000 7f9b55507a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-17T00:35:43.230 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:43.223+0000 7f9b55507a40 -1 bdev(0x55e3463bf800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-17T00:35:43.230 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:43.223+0000 7f9b55507a40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-17T00:35:43.865 DEBUG:teuthology.orchestra.run.trial124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-17T00:35:43.914 DEBUG:teuthology.orchestra.run.trial124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:43.979 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:43.970+0000 7fe3e2cffa40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-17T00:35:43.979 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:43.970+0000 7fe3e2cffa40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-17T00:35:43.979 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:43.970+0000 7fe3e2cffa40 -1 bdev(0x55ead536f800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-17T00:35:43.979 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:43.970+0000 7fe3e2cffa40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-17T00:35:44.598 DEBUG:teuthology.orchestra.run.trial124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-17T00:35:44.650 DEBUG:teuthology.orchestra.run.trial124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:44.713 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:44.706+0000 7fe3c43b5a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-17T00:35:44.713 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:44.706+0000 7fe3c43b5a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-17T00:35:44.713 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:44.706+0000 7fe3c43b5a40 -1 bdev(0x561ac4943800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-17T00:35:44.713 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:44.706+0000 7fe3c43b5a40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-17T00:35:45.337 DEBUG:teuthology.orchestra.run.trial124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-17T00:35:45.390 DEBUG:teuthology.orchestra.run.trial124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:45.454 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:45.450+0000 7fc7859f2a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-17T00:35:45.454 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:45.450+0000 7fc7859f2a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-17T00:35:45.454 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:45.450+0000 7fc7859f2a40 -1 bdev(0x559b87c21800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-17T00:35:45.454 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:45.450+0000 7fc7859f2a40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-17T00:35:46.069 DEBUG:teuthology.orchestra.run.trial124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-17T00:35:46.118 DEBUG:teuthology.orchestra.run.trial124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:46.183 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:46.178+0000 7f16314bfa40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-17T00:35:46.183 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:46.178+0000 7f16314bfa40 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-17T00:35:46.183 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:46.178+0000 7f16314bfa40 -1 bdev(0x559c00729800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-17T00:35:46.183 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:46.178+0000 7f16314bfa40 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-17T00:35:46.805 DEBUG:teuthology.orchestra.run.trial124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-17T00:35:46.853 DEBUG:teuthology.orchestra.run.trial124:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:46.918 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:46.914+0000 7ff87ab66a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-17T00:35:46.919 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:46.914+0000 7ff87ab66a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-17T00:35:46.919 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:46.914+0000 7ff87ab66a40 -1 bdev(0x55750e205800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-17T00:35:46.919 INFO:teuthology.orchestra.run.trial124.stderr:2026-02-17T00:35:46.914+0000 7ff87ab66a40 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-17T00:35:47.589 DEBUG:teuthology.orchestra.run.trial124:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-17T00:35:47.641 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T00:35:47.641 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:47.642 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T00:35:47.694 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:47.694 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T00:35:47.747 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:47.747 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T00:35:47.798 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:47.798 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T00:35:47.849 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:47.850 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-17T00:35:47.902 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:47.902 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-17T00:35:47.952 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:47.952 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-17T00:35:48.002 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:48.002 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-17T00:35:48.049 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:48.049 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-17T00:35:48.097 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:48.097 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-17T00:35:48.145 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:48.146 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-17T00:35:48.193 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:48.193 DEBUG:teuthology.orchestra.run.trial124:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T00:35:48.237 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T00:35:48.238 DEBUG:teuthology.orchestra.run.trial124:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T00:35:48.284 INFO:teuthology.orchestra.run.trial124.stdout:[mgr.x] 2026-02-17T00:35:48.285 INFO:teuthology.orchestra.run.trial124.stdout: key = AQDYt5NppaP2KBAA5CXAfOQs/XujPvx99DBqJw== 2026-02-17T00:35:48.285 INFO:teuthology.orchestra.run.trial124.stdout:[osd.0] 2026-02-17T00:35:48.285 INFO:teuthology.orchestra.run.trial124.stdout: key = AQDct5NpLy/eDRAABSx3Ew2zh/EhVkIrWGtDWQ== 2026-02-17T00:35:48.285 INFO:teuthology.orchestra.run.trial124.stdout:[osd.1] 2026-02-17T00:35:48.285 INFO:teuthology.orchestra.run.trial124.stdout: key = AQDct5NpoK2fORAA5v8CLZHTf8yuYZ0l/GGn/Q== 2026-02-17T00:35:48.285 INFO:teuthology.orchestra.run.trial124.stdout:[osd.2] 2026-02-17T00:35:48.285 INFO:teuthology.orchestra.run.trial124.stdout: key = AQDdt5Np+iefKhAA1oRRnvEEtvelV0uAu2JSLQ== 2026-02-17T00:35:48.285 INFO:teuthology.orchestra.run.trial124.stdout:[osd.3] 2026-02-17T00:35:48.285 INFO:teuthology.orchestra.run.trial124.stdout: key = AQDet5Np81IdHBAA5HYNB4YoVJwdnIGTvmHumw== 2026-02-17T00:35:48.285 INFO:teuthology.orchestra.run.trial124.stdout:[osd.4] 2026-02-17T00:35:48.286 INFO:teuthology.orchestra.run.trial124.stdout: key = AQDft5Np8zGHDRAANVKdyCDXW1PfTXRm7LTD3g== 2026-02-17T00:35:48.286 INFO:teuthology.orchestra.run.trial124.stdout:[osd.5] 2026-02-17T00:35:48.286 INFO:teuthology.orchestra.run.trial124.stdout: key = AQDft5Np56UvOhAAVfDv+ACBNVbKLhXJ8gdV2g== 2026-02-17T00:35:48.286 INFO:teuthology.orchestra.run.trial124.stdout:[osd.6] 2026-02-17T00:35:48.286 INFO:teuthology.orchestra.run.trial124.stdout: key = AQDgt5Np29BcKhAAEKf5IEuV/1tUDzd9wvhHiQ== 2026-02-17T00:35:48.286 INFO:teuthology.orchestra.run.trial124.stdout:[osd.7] 2026-02-17T00:35:48.286 INFO:teuthology.orchestra.run.trial124.stdout: key = AQDht5NprljmGhAACguosuemeGLHIQ5WBanMPA== 2026-02-17T00:35:48.286 INFO:teuthology.orchestra.run.trial124.stdout:[osd.8] 2026-02-17T00:35:48.286 INFO:teuthology.orchestra.run.trial124.stdout: key = AQDit5Npzq2wChAA1FJSbtJ4gjiCRCDFq5I73g== 2026-02-17T00:35:48.286 INFO:teuthology.orchestra.run.trial124.stdout:[osd.9] 2026-02-17T00:35:48.286 INFO:teuthology.orchestra.run.trial124.stdout: key = AQDit5NpCPmPNhAAkWZpSm6kjd5I1/qE+bQBJA== 2026-02-17T00:35:48.286 INFO:teuthology.orchestra.run.trial124.stdout:[client.0] 2026-02-17T00:35:48.287 INFO:teuthology.orchestra.run.trial124.stdout: key = AQDYt5NpM1TmLBAA9nRIkVCY9l8PMcJMedg2yg== 2026-02-17T00:35:48.288 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T00:35:48.352 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T00:35:48.413 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T00:35:48.482 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T00:35:48.546 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T00:35:48.609 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T00:35:48.674 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T00:35:48.737 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T00:35:48.802 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T00:35:48.867 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T00:35:48.930 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T00:35:48.998 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T00:35:49.063 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T00:35:49.063 DEBUG:teuthology.orchestra.run.trial124:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T00:35:49.117 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T00:35:49.187 DEBUG:teuthology.orchestra.run.trial124:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T00:35:49.238 DEBUG:teuthology.orchestra.run.trial124:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T00:35:49.285 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T00:35:49.285 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T00:35:49.286 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T00:35:49.327 INFO:tasks.ceph.mon.a:Started 2026-02-17T00:35:49.327 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph config set mgr mgr_pool false --force 2026-02-17T00:35:49.463 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T00:35:49.463 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T00:35:49.463 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T00:35:49.465 INFO:tasks.ceph.mgr.x:Started 2026-02-17T00:35:49.465 DEBUG:tasks.ceph:set 0 configs 2026-02-17T00:35:49.465 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph config dump 2026-02-17T00:35:49.560 INFO:teuthology.orchestra.run.trial124.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-17T00:35:49.560 INFO:teuthology.orchestra.run.trial124.stdout:mgr dev mgr_pool false * 2026-02-17T00:35:49.569 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T00:35:49.569 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T00:35:49.664 INFO:teuthology.orchestra.run.trial124.stderr:adjusted tunables profile to default 2026-02-17T00:35:49.673 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T00:35:49.673 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T00:35:49.673 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:49.673 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T00:35:49.683 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:49.684 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T00:35:49.732 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:49.733 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T00:35:49.781 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:49.781 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-17T00:35:49.828 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:49.828 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-17T00:35:49.876 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:49.876 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-17T00:35:49.928 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:49.928 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-17T00:35:49.977 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:49.977 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-17T00:35:50.024 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:50.024 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-17T00:35:50.072 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:35:50.072 DEBUG:teuthology.orchestra.run.trial124:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-17T00:35:50.120 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph osd new 92f5e876-06b7-432d-a823-9d17528babae 0 2026-02-17T00:35:50.258 INFO:teuthology.orchestra.run.trial124.stdout:0 2026-02-17T00:35:50.267 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph osd new a4f08285-6e02-4daf-ab7b-dccfbfde038e 1 2026-02-17T00:35:50.363 INFO:teuthology.orchestra.run.trial124.stdout:1 2026-02-17T00:35:50.372 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph osd new 90375a99-4b6c-4fae-b94c-9f4b71cdb262 2 2026-02-17T00:35:50.471 INFO:teuthology.orchestra.run.trial124.stdout:2 2026-02-17T00:35:50.480 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph osd new 524f3b52-cf39-4421-9542-6f573e3008b2 3 2026-02-17T00:35:50.578 INFO:teuthology.orchestra.run.trial124.stdout:3 2026-02-17T00:35:50.586 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph osd new a8687dcc-5b7c-48f9-a282-d58a26195f7e 4 2026-02-17T00:35:50.681 INFO:teuthology.orchestra.run.trial124.stdout:4 2026-02-17T00:35:50.690 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph osd new 921cfb10-f16c-4ed3-a69c-95c58816c1c4 5 2026-02-17T00:35:50.785 INFO:teuthology.orchestra.run.trial124.stdout:5 2026-02-17T00:35:50.795 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph osd new 69312bec-4a05-4b6d-bf26-e25d5dd67449 6 2026-02-17T00:35:50.891 INFO:teuthology.orchestra.run.trial124.stdout:6 2026-02-17T00:35:50.900 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph osd new 4af8fd69-8238-494a-b710-e4eefb7abf63 7 2026-02-17T00:35:50.957 INFO:tasks.ceph.mgr.x.trial124.stderr:ERROR:root:Module 'jmespath' is not installed. 2026-02-17T00:35:50.999 INFO:teuthology.orchestra.run.trial124.stdout:7 2026-02-17T00:35:51.008 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph osd new cb7ac6aa-c85e-436a-b78e-edc15c84d83f 8 2026-02-17T00:35:51.011 INFO:tasks.ceph.mgr.x.trial124.stderr:ERROR:dashboard.controllers.nvmeof:Failed to import NVMeoFClient and related components: cannot import name 'NVMeoFClient' from 'dashboard.services.nvmeof_client' (/usr/share/ceph/mgr/dashboard/services/nvmeof_client.py) 2026-02-17T00:35:51.017 INFO:tasks.ceph.mgr.x.trial124.stderr:ERROR:sso:Module 'jmespath' is not installed. 2026-02-17T00:35:51.067 INFO:tasks.ceph.mgr.x.trial124.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-17T00:35:51.108 INFO:teuthology.orchestra.run.trial124.stdout:8 2026-02-17T00:35:51.117 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph osd new f26cc0f5-ab7a-42da-9b9f-2f8845df5d2e 9 2026-02-17T00:35:51.254 INFO:teuthology.orchestra.run.trial124.stdout:9 2026-02-17T00:35:51.262 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T00:35:51.262 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T00:35:51.263 INFO:tasks.ceph.osd.0:Started 2026-02-17T00:35:51.263 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T00:35:51.263 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T00:35:51.264 INFO:tasks.ceph.osd.1:Started 2026-02-17T00:35:51.264 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T00:35:51.264 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T00:35:51.265 INFO:tasks.ceph.osd.2:Started 2026-02-17T00:35:51.265 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-17T00:35:51.265 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-17T00:35:51.266 INFO:tasks.ceph.osd.3:Started 2026-02-17T00:35:51.266 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-17T00:35:51.266 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-17T00:35:51.267 INFO:tasks.ceph.osd.4:Started 2026-02-17T00:35:51.267 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-17T00:35:51.267 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-17T00:35:51.268 INFO:tasks.ceph.osd.5:Started 2026-02-17T00:35:51.268 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-17T00:35:51.268 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2026-02-17T00:35:51.269 INFO:tasks.ceph.osd.6:Started 2026-02-17T00:35:51.269 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-17T00:35:51.269 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2026-02-17T00:35:51.270 INFO:tasks.ceph.osd.7:Started 2026-02-17T00:35:51.270 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-17T00:35:51.270 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2026-02-17T00:35:51.271 INFO:tasks.ceph.osd.8:Started 2026-02-17T00:35:51.271 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-17T00:35:51.271 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2026-02-17T00:35:51.272 INFO:tasks.ceph.osd.9:Started 2026-02-17T00:35:51.272 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T00:35:51.365 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:35:51.365 INFO:teuthology.orchestra.run.trial124.stdout:{"epoch":12,"fsid":"f197ec5f-226a-4c0a-a1e0-350b07c62afb","created":"2026-02-17T00:35:49.408352+0000","modified":"2026-02-17T00:35:51.250518+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T00:35:51.250518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"92f5e876-06b7-432d-a823-9d17528babae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a4f08285-6e02-4daf-ab7b-dccfbfde038e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"90375a99-4b6c-4fae-b94c-9f4b71cdb262","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"524f3b52-cf39-4421-9542-6f573e3008b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a8687dcc-5b7c-48f9-a282-d58a26195f7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"921cfb10-f16c-4ed3-a69c-95c58816c1c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"69312bec-4a05-4b6d-bf26-e25d5dd67449","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4af8fd69-8238-494a-b710-e4eefb7abf63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"cb7ac6aa-c85e-436a-b78e-edc15c84d83f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"f26cc0f5-ab7a-42da-9b9f-2f8845df5d2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T00:35:51.375 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T00:35:51.375 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T00:35:51.517 INFO:tasks.ceph.mgr.x.trial124.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T00:35:51.517 INFO:tasks.ceph.mgr.x.trial124.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T00:35:51.517 INFO:tasks.ceph.mgr.x.trial124.stderr: from numpy import show_config as show_numpy_config 2026-02-17T00:35:51.768 INFO:tasks.ceph.osd.2.trial124.stderr:2026-02-17T00:35:51.762+0000 7fdfacd47a40 -1 Falling back to public interface 2026-02-17T00:35:51.768 INFO:tasks.ceph.osd.3.trial124.stderr:2026-02-17T00:35:51.762+0000 7fcc5105ca40 -1 Falling back to public interface 2026-02-17T00:35:51.769 INFO:tasks.ceph.osd.4.trial124.stderr:2026-02-17T00:35:51.762+0000 7f1b95e29a40 -1 Falling back to public interface 2026-02-17T00:35:51.769 INFO:tasks.ceph.osd.3.trial124.stderr:2026-02-17T00:35:51.762+0000 7fcc5001c640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6802/0: (98) Address already in use 2026-02-17T00:35:51.774 INFO:tasks.ceph.osd.0.trial124.stderr:2026-02-17T00:35:51.770+0000 7fa9dba6ea40 -1 Falling back to public interface 2026-02-17T00:35:51.783 INFO:tasks.ceph.osd.1.trial124.stderr:2026-02-17T00:35:51.778+0000 7f3da448ea40 -1 Falling back to public interface 2026-02-17T00:35:51.790 INFO:tasks.ceph.osd.7.trial124.stderr:2026-02-17T00:35:51.786+0000 7f22050aaa40 -1 Falling back to public interface 2026-02-17T00:35:51.802 INFO:tasks.ceph.osd.9.trial124.stderr:2026-02-17T00:35:51.798+0000 7f652d3c9a40 -1 Falling back to public interface 2026-02-17T00:35:51.806 INFO:tasks.ceph.osd.6.trial124.stderr:2026-02-17T00:35:51.802+0000 7f56392caa40 -1 Falling back to public interface 2026-02-17T00:35:51.826 INFO:tasks.ceph.osd.5.trial124.stderr:2026-02-17T00:35:51.822+0000 7f2f62ff3a40 -1 Falling back to public interface 2026-02-17T00:35:51.838 INFO:tasks.ceph.osd.8.trial124.stderr:2026-02-17T00:35:51.834+0000 7f50412bfa40 -1 Falling back to public interface 2026-02-17T00:35:52.381 DEBUG:teuthology.orchestra.run.trial124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T00:35:52.468 INFO:teuthology.misc.health.trial124.stdout: 2026-02-17T00:35:52.468 INFO:teuthology.misc.health.trial124.stdout:{"epoch":12,"fsid":"f197ec5f-226a-4c0a-a1e0-350b07c62afb","created":"2026-02-17T00:35:49.408352+0000","modified":"2026-02-17T00:35:51.250518+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T00:35:51.250518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"92f5e876-06b7-432d-a823-9d17528babae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a4f08285-6e02-4daf-ab7b-dccfbfde038e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"90375a99-4b6c-4fae-b94c-9f4b71cdb262","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"524f3b52-cf39-4421-9542-6f573e3008b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a8687dcc-5b7c-48f9-a282-d58a26195f7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"921cfb10-f16c-4ed3-a69c-95c58816c1c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"69312bec-4a05-4b6d-bf26-e25d5dd67449","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4af8fd69-8238-494a-b710-e4eefb7abf63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"cb7ac6aa-c85e-436a-b78e-edc15c84d83f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"f26cc0f5-ab7a-42da-9b9f-2f8845df5d2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T00:35:52.476 DEBUG:teuthology.misc:0 of 10 OSDs are up 2026-02-17T00:35:52.530 INFO:tasks.ceph.osd.4.trial124.stderr:2026-02-17T00:35:52.526+0000 7f1b95e29a40 -1 osd.4 0 log_to_monitors true 2026-02-17T00:35:52.567 INFO:tasks.ceph.osd.9.trial124.stderr:2026-02-17T00:35:52.562+0000 7f652d3c9a40 -1 osd.9 0 log_to_monitors true 2026-02-17T00:35:52.576 INFO:tasks.ceph.osd.7.trial124.stderr:2026-02-17T00:35:52.570+0000 7f22050aaa40 -1 osd.7 0 log_to_monitors true 2026-02-17T00:35:52.581 INFO:tasks.ceph.osd.3.trial124.stderr:2026-02-17T00:35:52.574+0000 7fcc5105ca40 -1 osd.3 0 log_to_monitors true 2026-02-17T00:35:52.592 INFO:tasks.ceph.mgr.x.trial124.stderr:2026-02-17T00:35:52.586+0000 7fbbdfda9640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-17T00:35:52.593 INFO:tasks.ceph.osd.6.trial124.stderr:2026-02-17T00:35:52.586+0000 7f56392caa40 -1 osd.6 0 log_to_monitors true 2026-02-17T00:35:52.605 INFO:tasks.ceph.osd.0.trial124.stderr:2026-02-17T00:35:52.598+0000 7fa9dba6ea40 -1 osd.0 0 log_to_monitors true 2026-02-17T00:35:52.606 INFO:tasks.ceph.osd.2.trial124.stderr:2026-02-17T00:35:52.602+0000 7fdfacd47a40 -1 osd.2 0 log_to_monitors true 2026-02-17T00:35:52.606 INFO:tasks.ceph.osd.1.trial124.stderr:2026-02-17T00:35:52.602+0000 7f3da448ea40 -1 osd.1 0 log_to_monitors true 2026-02-17T00:35:52.621 INFO:tasks.ceph.osd.8.trial124.stderr:2026-02-17T00:35:52.614+0000 7f50412bfa40 -1 osd.8 0 log_to_monitors true 2026-02-17T00:35:52.625 INFO:tasks.ceph.osd.5.trial124.stderr:2026-02-17T00:35:52.618+0000 7f2f62ff3a40 -1 osd.5 0 log_to_monitors true 2026-02-17T00:35:54.429 INFO:tasks.ceph.osd.9.trial124.stderr:2026-02-17T00:35:54.422+0000 7f6529373640 -1 osd.9 0 waiting for initial osdmap 2026-02-17T00:35:54.430 INFO:tasks.ceph.osd.7.trial124.stderr:2026-02-17T00:35:54.426+0000 7f2201054640 -1 osd.7 0 waiting for initial osdmap 2026-02-17T00:35:54.430 INFO:tasks.ceph.osd.6.trial124.stderr:2026-02-17T00:35:54.426+0000 7f5635274640 -1 osd.6 0 waiting for initial osdmap 2026-02-17T00:35:54.430 INFO:tasks.ceph.osd.2.trial124.stderr:2026-02-17T00:35:54.426+0000 7fdfa8cf1640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T00:35:54.430 INFO:tasks.ceph.osd.3.trial124.stderr:2026-02-17T00:35:54.426+0000 7fcc4d006640 -1 osd.3 0 waiting for initial osdmap 2026-02-17T00:35:54.431 INFO:tasks.ceph.osd.0.trial124.stderr:2026-02-17T00:35:54.426+0000 7fa9d7a18640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T00:35:54.431 INFO:tasks.ceph.osd.5.trial124.stderr:2026-02-17T00:35:54.426+0000 7f2f5ef9d640 -1 osd.5 0 waiting for initial osdmap 2026-02-17T00:35:54.431 INFO:tasks.ceph.osd.1.trial124.stderr:2026-02-17T00:35:54.426+0000 7f3da0438640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T00:35:54.431 INFO:tasks.ceph.osd.8.trial124.stderr:2026-02-17T00:35:54.426+0000 7f503d269640 -1 osd.8 0 waiting for initial osdmap 2026-02-17T00:35:54.431 INFO:tasks.ceph.osd.4.trial124.stderr:2026-02-17T00:35:54.426+0000 7f1b91dd3640 -1 osd.4 0 waiting for initial osdmap 2026-02-17T00:35:54.433 INFO:tasks.ceph.osd.2.trial124.stderr:2026-02-17T00:35:54.426+0000 7fdfa43c8640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:35:54.433 INFO:tasks.ceph.osd.9.trial124.stderr:2026-02-17T00:35:54.426+0000 7f6520a42640 -1 osd.9 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:35:54.434 INFO:tasks.ceph.osd.3.trial124.stderr:2026-02-17T00:35:54.430+0000 7fcc486dd640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:35:54.434 INFO:tasks.ceph.osd.7.trial124.stderr:2026-02-17T00:35:54.430+0000 7f21f8723640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:35:54.434 INFO:tasks.ceph.osd.0.trial124.stderr:2026-02-17T00:35:54.430+0000 7fa9d30ef640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:35:54.434 INFO:tasks.ceph.osd.5.trial124.stderr:2026-02-17T00:35:54.430+0000 7f2f5a674640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:35:54.435 INFO:tasks.ceph.osd.4.trial124.stderr:2026-02-17T00:35:54.430+0000 7f1b894a2640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:35:54.435 INFO:tasks.ceph.osd.6.trial124.stderr:2026-02-17T00:35:54.430+0000 7f562c943640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:35:54.435 INFO:tasks.ceph.osd.8.trial124.stderr:2026-02-17T00:35:54.430+0000 7f5034938640 -1 osd.8 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:35:54.435 INFO:tasks.ceph.osd.1.trial124.stderr:2026-02-17T00:35:54.430+0000 7f3d97b07640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:35:59.482 DEBUG:teuthology.orchestra.run.trial124:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T00:35:59.637 INFO:teuthology.misc.health.trial124.stdout: 2026-02-17T00:35:59.637 INFO:teuthology.misc.health.trial124.stdout:{"epoch":15,"fsid":"f197ec5f-226a-4c0a-a1e0-350b07c62afb","created":"2026-02-17T00:35:49.408352+0000","modified":"2026-02-17T00:35:55.421207+0000","last_up_change":"2026-02-17T00:35:55.421207+0000","last_in_change":"2026-02-17T00:35:51.250518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"92f5e876-06b7-432d-a823-9d17528babae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6826","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6827","nonce":2275529749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6828","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6829","nonce":2275529749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6832","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6833","nonce":2275529749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6830","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6831","nonce":2275529749}]},"public_addr":"10.20.193.124:6827/2275529749","cluster_addr":"10.20.193.124:6829/2275529749","heartbeat_back_addr":"10.20.193.124:6833/2275529749","heartbeat_front_addr":"10.20.193.124:6831/2275529749","state":["exists","up"]},{"osd":1,"uuid":"a4f08285-6e02-4daf-ab7b-dccfbfde038e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6834","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6835","nonce":1827517214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6836","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6837","nonce":1827517214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6840","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6841","nonce":1827517214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6838","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6839","nonce":1827517214}]},"public_addr":"10.20.193.124:6835/1827517214","cluster_addr":"10.20.193.124:6837/1827517214","heartbeat_back_addr":"10.20.193.124:6841/1827517214","heartbeat_front_addr":"10.20.193.124:6839/1827517214","state":["exists","up"]},{"osd":2,"uuid":"90375a99-4b6c-4fae-b94c-9f4b71cdb262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6802","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6805","nonce":2907939377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6808","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6811","nonce":2907939377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6820","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6823","nonce":2907939377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6814","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6817","nonce":2907939377}]},"public_addr":"10.20.193.124:6805/2907939377","cluster_addr":"10.20.193.124:6811/2907939377","heartbeat_back_addr":"10.20.193.124:6823/2907939377","heartbeat_front_addr":"10.20.193.124:6817/2907939377","state":["exists","up"]},{"osd":3,"uuid":"524f3b52-cf39-4421-9542-6f573e3008b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6803","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6806","nonce":3904026978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6809","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6812","nonce":3904026978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6819","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6821","nonce":3904026978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6815","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6816","nonce":3904026978}]},"public_addr":"10.20.193.124:6806/3904026978","cluster_addr":"10.20.193.124:6812/3904026978","heartbeat_back_addr":"10.20.193.124:6821/3904026978","heartbeat_front_addr":"10.20.193.124:6816/3904026978","state":["exists","up"]},{"osd":4,"uuid":"a8687dcc-5b7c-48f9-a282-d58a26195f7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6804","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6807","nonce":786547060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6810","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6813","nonce":786547060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6824","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6825","nonce":786547060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6818","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6822","nonce":786547060}]},"public_addr":"10.20.193.124:6807/786547060","cluster_addr":"10.20.193.124:6813/786547060","heartbeat_back_addr":"10.20.193.124:6825/786547060","heartbeat_front_addr":"10.20.193.124:6822/786547060","state":["exists","up"]},{"osd":5,"uuid":"921cfb10-f16c-4ed3-a69c-95c58816c1c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6866","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6867","nonce":1783893241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6868","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6869","nonce":1783893241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6872","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6873","nonce":1783893241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6870","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6871","nonce":1783893241}]},"public_addr":"10.20.193.124:6867/1783893241","cluster_addr":"10.20.193.124:6869/1783893241","heartbeat_back_addr":"10.20.193.124:6873/1783893241","heartbeat_front_addr":"10.20.193.124:6871/1783893241","state":["exists","up"]},{"osd":6,"uuid":"69312bec-4a05-4b6d-bf26-e25d5dd67449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6855","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6857","nonce":957442686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6859","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6861","nonce":957442686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6864","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6865","nonce":957442686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6862","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6863","nonce":957442686}]},"public_addr":"10.20.193.124:6857/957442686","cluster_addr":"10.20.193.124:6861/957442686","heartbeat_back_addr":"10.20.193.124:6865/957442686","heartbeat_front_addr":"10.20.193.124:6863/957442686","state":["exists","up"]},{"osd":7,"uuid":"4af8fd69-8238-494a-b710-e4eefb7abf63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6842","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6843","nonce":951373869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6844","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6845","nonce":951373869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6848","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6849","nonce":951373869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6846","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6847","nonce":951373869}]},"public_addr":"10.20.193.124:6843/951373869","cluster_addr":"10.20.193.124:6845/951373869","heartbeat_back_addr":"10.20.193.124:6849/951373869","heartbeat_front_addr":"10.20.193.124:6847/951373869","state":["exists","up"]},{"osd":8,"uuid":"cb7ac6aa-c85e-436a-b78e-edc15c84d83f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6874","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6875","nonce":2712194498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6876","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6877","nonce":2712194498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6880","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6881","nonce":2712194498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6878","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6879","nonce":2712194498}]},"public_addr":"10.20.193.124:6875/2712194498","cluster_addr":"10.20.193.124:6877/2712194498","heartbeat_back_addr":"10.20.193.124:6881/2712194498","heartbeat_front_addr":"10.20.193.124:6879/2712194498","state":["exists","up"]},{"osd":9,"uuid":"f26cc0f5-ab7a-42da-9b9f-2f8845df5d2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6850","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6851","nonce":132817667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6852","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6853","nonce":132817667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6858","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6860","nonce":132817667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6854","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6856","nonce":132817667}]},"public_addr":"10.20.193.124:6851/132817667","cluster_addr":"10.20.193.124:6853/132817667","heartbeat_back_addr":"10.20.193.124:6860/132817667","heartbeat_front_addr":"10.20.193.124:6856/132817667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T00:35:59.648 DEBUG:teuthology.misc:10 of 10 OSDs are up 2026-02-17T00:35:59.649 INFO:tasks.ceph:Creating RBD pool 2026-02-17T00:35:59.649 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T00:36:00.435 INFO:teuthology.orchestra.run.trial124.stderr:pool 'rbd' created 2026-02-17T00:36:00.448 DEBUG:teuthology.orchestra.run.trial124:> rbd --cluster ceph pool init rbd 2026-02-17T00:36:03.451 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T00:36:03.451 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-17T00:36:03.452 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T00:36:03.614 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:36:03.624 INFO:teuthology.orchestra.run.trial124.stdout:[{"version":2,"timestamp":"2026-02-17T00:35:49.448920+0000","name":"","changes":[{"name":"mgr/mgr_pool","new_value":"false"}]}] 2026-02-17T00:36:03.625 INFO:tasks.ceph_manager:config epoch is 2 2026-02-17T00:36:03.625 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T00:36:03.625 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T00:36:03.625 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T00:36:03.804 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:36:03.815 INFO:teuthology.orchestra.run.trial124.stdout:{"epoch":4,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6800","nonce":2827312008},{"type":"v1","addr":"10.20.193.124:6801","nonce":2827312008}]},"active_addr":"10.20.193.124:6801/2827312008","active_change":"2026-02-17T00:35:51.583704+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.124:0","nonce":1037087451}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.124:0","nonce":232525560}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.124:0","nonce":2575099972}]}]} 2026-02-17T00:36:03.817 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T00:36:03.817 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T00:36:03.818 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T00:36:03.972 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:36:03.973 INFO:teuthology.orchestra.run.trial124.stdout:{"epoch":19,"fsid":"f197ec5f-226a-4c0a-a1e0-350b07c62afb","created":"2026-02-17T00:35:49.408352+0000","modified":"2026-02-17T00:36:03.436841+0000","last_up_change":"2026-02-17T00:35:55.421207+0000","last_in_change":"2026-02-17T00:35:51.250518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T00:35:59.803458+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.89999997615814209,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92f5e876-06b7-432d-a823-9d17528babae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6826","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6827","nonce":2275529749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6828","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6829","nonce":2275529749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6832","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6833","nonce":2275529749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6830","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6831","nonce":2275529749}]},"public_addr":"10.20.193.124:6827/2275529749","cluster_addr":"10.20.193.124:6829/2275529749","heartbeat_back_addr":"10.20.193.124:6833/2275529749","heartbeat_front_addr":"10.20.193.124:6831/2275529749","state":["exists","up"]},{"osd":1,"uuid":"a4f08285-6e02-4daf-ab7b-dccfbfde038e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6834","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6835","nonce":1827517214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6836","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6837","nonce":1827517214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6840","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6841","nonce":1827517214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6838","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6839","nonce":1827517214}]},"public_addr":"10.20.193.124:6835/1827517214","cluster_addr":"10.20.193.124:6837/1827517214","heartbeat_back_addr":"10.20.193.124:6841/1827517214","heartbeat_front_addr":"10.20.193.124:6839/1827517214","state":["exists","up"]},{"osd":2,"uuid":"90375a99-4b6c-4fae-b94c-9f4b71cdb262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6802","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6805","nonce":2907939377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6808","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6811","nonce":2907939377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6820","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6823","nonce":2907939377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6814","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6817","nonce":2907939377}]},"public_addr":"10.20.193.124:6805/2907939377","cluster_addr":"10.20.193.124:6811/2907939377","heartbeat_back_addr":"10.20.193.124:6823/2907939377","heartbeat_front_addr":"10.20.193.124:6817/2907939377","state":["exists","up"]},{"osd":3,"uuid":"524f3b52-cf39-4421-9542-6f573e3008b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6803","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6806","nonce":3904026978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6809","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6812","nonce":3904026978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6819","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6821","nonce":3904026978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6815","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6816","nonce":3904026978}]},"public_addr":"10.20.193.124:6806/3904026978","cluster_addr":"10.20.193.124:6812/3904026978","heartbeat_back_addr":"10.20.193.124:6821/3904026978","heartbeat_front_addr":"10.20.193.124:6816/3904026978","state":["exists","up"]},{"osd":4,"uuid":"a8687dcc-5b7c-48f9-a282-d58a26195f7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6804","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6807","nonce":786547060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6810","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6813","nonce":786547060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6824","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6825","nonce":786547060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6818","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6822","nonce":786547060}]},"public_addr":"10.20.193.124:6807/786547060","cluster_addr":"10.20.193.124:6813/786547060","heartbeat_back_addr":"10.20.193.124:6825/786547060","heartbeat_front_addr":"10.20.193.124:6822/786547060","state":["exists","up"]},{"osd":5,"uuid":"921cfb10-f16c-4ed3-a69c-95c58816c1c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6866","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6867","nonce":1783893241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6868","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6869","nonce":1783893241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6872","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6873","nonce":1783893241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6870","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6871","nonce":1783893241}]},"public_addr":"10.20.193.124:6867/1783893241","cluster_addr":"10.20.193.124:6869/1783893241","heartbeat_back_addr":"10.20.193.124:6873/1783893241","heartbeat_front_addr":"10.20.193.124:6871/1783893241","state":["exists","up"]},{"osd":6,"uuid":"69312bec-4a05-4b6d-bf26-e25d5dd67449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6855","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6857","nonce":957442686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6859","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6861","nonce":957442686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6864","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6865","nonce":957442686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6862","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6863","nonce":957442686}]},"public_addr":"10.20.193.124:6857/957442686","cluster_addr":"10.20.193.124:6861/957442686","heartbeat_back_addr":"10.20.193.124:6865/957442686","heartbeat_front_addr":"10.20.193.124:6863/957442686","state":["exists","up"]},{"osd":7,"uuid":"4af8fd69-8238-494a-b710-e4eefb7abf63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6842","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6843","nonce":951373869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6844","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6845","nonce":951373869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6848","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6849","nonce":951373869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6846","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6847","nonce":951373869}]},"public_addr":"10.20.193.124:6843/951373869","cluster_addr":"10.20.193.124:6845/951373869","heartbeat_back_addr":"10.20.193.124:6849/951373869","heartbeat_front_addr":"10.20.193.124:6847/951373869","state":["exists","up"]},{"osd":8,"uuid":"cb7ac6aa-c85e-436a-b78e-edc15c84d83f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6874","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6875","nonce":2712194498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6876","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6877","nonce":2712194498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6880","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6881","nonce":2712194498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6878","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6879","nonce":2712194498}]},"public_addr":"10.20.193.124:6875/2712194498","cluster_addr":"10.20.193.124:6877/2712194498","heartbeat_back_addr":"10.20.193.124:6881/2712194498","heartbeat_front_addr":"10.20.193.124:6879/2712194498","state":["exists","up"]},{"osd":9,"uuid":"f26cc0f5-ab7a-42da-9b9f-2f8845df5d2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6850","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6851","nonce":132817667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6852","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6853","nonce":132817667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6858","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6860","nonce":132817667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6854","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6856","nonce":132817667}]},"public_addr":"10.20.193.124:6851/132817667","cluster_addr":"10.20.193.124:6853/132817667","heartbeat_back_addr":"10.20.193.124:6860/132817667","heartbeat_front_addr":"10.20.193.124:6856/132817667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T00:36:03.983 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T00:36:03.983 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T00:36:04.144 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:36:04.144 INFO:teuthology.orchestra.run.trial124.stdout:{"epoch":19,"fsid":"f197ec5f-226a-4c0a-a1e0-350b07c62afb","created":"2026-02-17T00:35:49.408352+0000","modified":"2026-02-17T00:36:03.436841+0000","last_up_change":"2026-02-17T00:35:55.421207+0000","last_in_change":"2026-02-17T00:35:51.250518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T00:35:59.803458+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.89999997615814209,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92f5e876-06b7-432d-a823-9d17528babae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6826","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6827","nonce":2275529749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6828","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6829","nonce":2275529749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6832","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6833","nonce":2275529749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6830","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6831","nonce":2275529749}]},"public_addr":"10.20.193.124:6827/2275529749","cluster_addr":"10.20.193.124:6829/2275529749","heartbeat_back_addr":"10.20.193.124:6833/2275529749","heartbeat_front_addr":"10.20.193.124:6831/2275529749","state":["exists","up"]},{"osd":1,"uuid":"a4f08285-6e02-4daf-ab7b-dccfbfde038e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6834","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6835","nonce":1827517214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6836","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6837","nonce":1827517214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6840","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6841","nonce":1827517214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6838","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6839","nonce":1827517214}]},"public_addr":"10.20.193.124:6835/1827517214","cluster_addr":"10.20.193.124:6837/1827517214","heartbeat_back_addr":"10.20.193.124:6841/1827517214","heartbeat_front_addr":"10.20.193.124:6839/1827517214","state":["exists","up"]},{"osd":2,"uuid":"90375a99-4b6c-4fae-b94c-9f4b71cdb262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6802","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6805","nonce":2907939377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6808","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6811","nonce":2907939377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6820","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6823","nonce":2907939377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6814","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6817","nonce":2907939377}]},"public_addr":"10.20.193.124:6805/2907939377","cluster_addr":"10.20.193.124:6811/2907939377","heartbeat_back_addr":"10.20.193.124:6823/2907939377","heartbeat_front_addr":"10.20.193.124:6817/2907939377","state":["exists","up"]},{"osd":3,"uuid":"524f3b52-cf39-4421-9542-6f573e3008b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6803","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6806","nonce":3904026978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6809","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6812","nonce":3904026978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6819","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6821","nonce":3904026978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6815","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6816","nonce":3904026978}]},"public_addr":"10.20.193.124:6806/3904026978","cluster_addr":"10.20.193.124:6812/3904026978","heartbeat_back_addr":"10.20.193.124:6821/3904026978","heartbeat_front_addr":"10.20.193.124:6816/3904026978","state":["exists","up"]},{"osd":4,"uuid":"a8687dcc-5b7c-48f9-a282-d58a26195f7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6804","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6807","nonce":786547060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6810","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6813","nonce":786547060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6824","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6825","nonce":786547060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6818","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6822","nonce":786547060}]},"public_addr":"10.20.193.124:6807/786547060","cluster_addr":"10.20.193.124:6813/786547060","heartbeat_back_addr":"10.20.193.124:6825/786547060","heartbeat_front_addr":"10.20.193.124:6822/786547060","state":["exists","up"]},{"osd":5,"uuid":"921cfb10-f16c-4ed3-a69c-95c58816c1c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6866","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6867","nonce":1783893241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6868","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6869","nonce":1783893241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6872","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6873","nonce":1783893241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6870","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6871","nonce":1783893241}]},"public_addr":"10.20.193.124:6867/1783893241","cluster_addr":"10.20.193.124:6869/1783893241","heartbeat_back_addr":"10.20.193.124:6873/1783893241","heartbeat_front_addr":"10.20.193.124:6871/1783893241","state":["exists","up"]},{"osd":6,"uuid":"69312bec-4a05-4b6d-bf26-e25d5dd67449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6855","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6857","nonce":957442686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6859","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6861","nonce":957442686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6864","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6865","nonce":957442686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6862","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6863","nonce":957442686}]},"public_addr":"10.20.193.124:6857/957442686","cluster_addr":"10.20.193.124:6861/957442686","heartbeat_back_addr":"10.20.193.124:6865/957442686","heartbeat_front_addr":"10.20.193.124:6863/957442686","state":["exists","up"]},{"osd":7,"uuid":"4af8fd69-8238-494a-b710-e4eefb7abf63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6842","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6843","nonce":951373869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6844","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6845","nonce":951373869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6848","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6849","nonce":951373869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6846","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6847","nonce":951373869}]},"public_addr":"10.20.193.124:6843/951373869","cluster_addr":"10.20.193.124:6845/951373869","heartbeat_back_addr":"10.20.193.124:6849/951373869","heartbeat_front_addr":"10.20.193.124:6847/951373869","state":["exists","up"]},{"osd":8,"uuid":"cb7ac6aa-c85e-436a-b78e-edc15c84d83f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6874","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6875","nonce":2712194498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6876","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6877","nonce":2712194498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6880","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6881","nonce":2712194498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6878","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6879","nonce":2712194498}]},"public_addr":"10.20.193.124:6875/2712194498","cluster_addr":"10.20.193.124:6877/2712194498","heartbeat_back_addr":"10.20.193.124:6881/2712194498","heartbeat_front_addr":"10.20.193.124:6879/2712194498","state":["exists","up"]},{"osd":9,"uuid":"f26cc0f5-ab7a-42da-9b9f-2f8845df5d2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6850","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6851","nonce":132817667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6852","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6853","nonce":132817667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6858","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6860","nonce":132817667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6854","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6856","nonce":132817667}]},"public_addr":"10.20.193.124:6851/132817667","cluster_addr":"10.20.193.124:6853/132817667","heartbeat_back_addr":"10.20.193.124:6860/132817667","heartbeat_front_addr":"10.20.193.124:6856/132817667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T00:36:04.156 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T00:36:04.156 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T00:36:04.156 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T00:36:04.157 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T00:36:04.157 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-17T00:36:04.157 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-17T00:36:04.157 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-17T00:36:04.157 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-17T00:36:04.157 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-17T00:36:04.158 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-17T00:36:04.249 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:04.250 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T00:36:04.250 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:04.251 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T00:36:04.251 INFO:teuthology.orchestra.run.trial124.stdout:64424509444 2026-02-17T00:36:04.251 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-17T00:36:04.252 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:04.252 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T00:36:04.253 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:04.253 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T00:36:04.256 INFO:teuthology.orchestra.run.trial124.stdout:64424509444 2026-02-17T00:36:04.256 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T00:36:04.257 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:04.257 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T00:36:04.258 INFO:teuthology.orchestra.run.trial124.stdout:64424509444 2026-02-17T00:36:04.258 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T00:36:04.260 INFO:teuthology.orchestra.run.trial124.stdout:64424509444 2026-02-17T00:36:04.260 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T00:36:04.260 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:04.261 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T00:36:04.418 INFO:teuthology.orchestra.run.trial124.stdout:64424509442 2026-02-17T00:36:04.426 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:04.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.2 2026-02-17T00:36:04.438 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:04.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.8 2026-02-17T00:36:04.440 INFO:teuthology.orchestra.run.trial124.stdout:64424509442 2026-02-17T00:36:04.445 INFO:teuthology.orchestra.run.trial124.stdout:64424509442 2026-02-17T00:36:04.448 INFO:teuthology.orchestra.run.trial124.stdout:64424509442 2026-02-17T00:36:04.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.6 2026-02-17T00:36:04.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.1 2026-02-17T00:36:04.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.7 2026-02-17T00:36:04.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.0 2026-02-17T00:36:04.473 INFO:teuthology.orchestra.run.trial124.stdout:64424509442 2026-02-17T00:36:04.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.5 2026-02-17T00:36:04.517 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:04.518 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:04.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.4 2026-02-17T00:36:04.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.9 2026-02-17T00:36:04.531 INFO:teuthology.orchestra.run.trial124.stdout:64424509442 2026-02-17T00:36:04.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.3 2026-02-17T00:36:05.432 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T00:36:05.439 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-17T00:36:05.453 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T00:36:05.455 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T00:36:05.459 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T00:36:05.461 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T00:36:05.486 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T00:36:05.530 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T00:36:05.531 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T00:36:05.545 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T00:36:05.607 INFO:teuthology.orchestra.run.trial124.stdout:64424509442 2026-02-17T00:36:05.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.2 2026-02-17T00:36:05.640 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:05.644 INFO:teuthology.orchestra.run.trial124.stdout:64424509442 2026-02-17T00:36:05.644 INFO:teuthology.orchestra.run.trial124.stdout:64424509442 2026-02-17T00:36:05.649 INFO:teuthology.orchestra.run.trial124.stdout:64424509442 2026-02-17T00:36:05.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.6 2026-02-17T00:36:05.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.0 2026-02-17T00:36:05.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.1 2026-02-17T00:36:05.660 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:05.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.7 2026-02-17T00:36:05.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.8 2026-02-17T00:36:05.692 INFO:teuthology.orchestra.run.trial124.stdout:64424509442 2026-02-17T00:36:05.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.5 2026-02-17T00:36:05.731 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:05.733 INFO:teuthology.orchestra.run.trial124.stdout:64424509442 2026-02-17T00:36:05.734 INFO:teuthology.orchestra.run.trial124.stdout:64424509443 2026-02-17T00:36:05.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.4 2026-02-17T00:36:05.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.3 2026-02-17T00:36:05.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.9 2026-02-17T00:36:06.621 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T00:36:06.654 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T00:36:06.659 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T00:36:06.661 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T00:36:06.664 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T00:36:06.672 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-17T00:36:06.706 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T00:36:06.744 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T00:36:06.746 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T00:36:06.748 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T00:36:06.782 INFO:teuthology.orchestra.run.trial124.stdout:64424509444 2026-02-17T00:36:06.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.2 2026-02-17T00:36:06.796 DEBUG:teuthology.parallel:result is None 2026-02-17T00:36:06.830 INFO:teuthology.orchestra.run.trial124.stdout:64424509444 2026-02-17T00:36:06.831 INFO:teuthology.orchestra.run.trial124.stdout:64424509444 2026-02-17T00:36:06.832 INFO:teuthology.orchestra.run.trial124.stdout:64424509445 2026-02-17T00:36:06.838 INFO:teuthology.orchestra.run.trial124.stdout:64424509444 2026-02-17T00:36:06.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.1 2026-02-17T00:36:06.843 DEBUG:teuthology.parallel:result is None 2026-02-17T00:36:06.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.7 2026-02-17T00:36:06.844 DEBUG:teuthology.parallel:result is None 2026-02-17T00:36:06.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.6 2026-02-17T00:36:06.845 DEBUG:teuthology.parallel:result is None 2026-02-17T00:36:06.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.0 2026-02-17T00:36:06.851 DEBUG:teuthology.parallel:result is None 2026-02-17T00:36:06.870 INFO:teuthology.orchestra.run.trial124.stdout:64424509445 2026-02-17T00:36:06.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.8 2026-02-17T00:36:06.883 DEBUG:teuthology.parallel:result is None 2026-02-17T00:36:06.908 INFO:teuthology.orchestra.run.trial124.stdout:64424509444 2026-02-17T00:36:06.913 INFO:teuthology.orchestra.run.trial124.stdout:64424509445 2026-02-17T00:36:06.917 INFO:teuthology.orchestra.run.trial124.stdout:64424509444 2026-02-17T00:36:06.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.5 2026-02-17T00:36:06.921 DEBUG:teuthology.parallel:result is None 2026-02-17T00:36:06.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.4 2026-02-17T00:36:06.925 DEBUG:teuthology.parallel:result is None 2026-02-17T00:36:06.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509444 for osd.3 2026-02-17T00:36:06.930 DEBUG:teuthology.parallel:result is None 2026-02-17T00:36:06.941 INFO:teuthology.orchestra.run.trial124.stdout:64424509444 2026-02-17T00:36:06.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.9 2026-02-17T00:36:06.954 DEBUG:teuthology.parallel:result is None 2026-02-17T00:36:06.955 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T00:36:06.955 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T00:36:07.157 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:36:07.157 INFO:teuthology.orchestra.run.trial124.stderr:dumped all 2026-02-17T00:36:07.167 INFO:teuthology.orchestra.run.trial124.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-17T00:36:05.588052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":1048576000,"kb_used":271408,"kb_used_data":1808,"kb_used_omap":64,"kb_used_meta":269375,"kb_avail":1048304592,"statfs":{"total":1073741824000,"available":1073463902208,"internally_reserved":0,"allocated":1851392,"data_stored":596678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66296,"internal_metadata":275840264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.478079+0000","last_change":"2026-02-17T00:36:03.478204+0000","last_active":"2026-02-17T00:36:03.478079+0000","last_peered":"2026-02-17T00:36:03.478079+0000","last_clean":"2026-02-17T00:36:03.478079+0000","last_became_active":"2026-02-17T00:36:01.436327+0000","last_became_peered":"2026-02-17T00:36:01.436327+0000","last_unstale":"2026-02-17T00:36:03.478079+0000","last_undegraded":"2026-02-17T00:36:03.478079+0000","last_fullsized":"2026-02-17T00:36:03.478079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:13:57.372673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032515099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.478023+0000","last_change":"2026-02-17T00:36:03.478156+0000","last_active":"2026-02-17T00:36:03.478023+0000","last_peered":"2026-02-17T00:36:03.478023+0000","last_clean":"2026-02-17T00:36:03.478023+0000","last_became_active":"2026-02-17T00:36:01.588525+0000","last_became_peered":"2026-02-17T00:36:01.588525+0000","last_unstale":"2026-02-17T00:36:03.478023+0000","last_undegraded":"2026-02-17T00:36:03.478023+0000","last_fullsized":"2026-02-17T00:36:03.478023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:51:09.669406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028708100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.478006+0000","last_change":"2026-02-17T00:36:03.478102+0000","last_active":"2026-02-17T00:36:03.478006+0000","last_peered":"2026-02-17T00:36:03.478006+0000","last_clean":"2026-02-17T00:36:03.478006+0000","last_became_active":"2026-02-17T00:36:01.436386+0000","last_became_peered":"2026-02-17T00:36:01.436386+0000","last_unstale":"2026-02-17T00:36:03.478006+0000","last_undegraded":"2026-02-17T00:36:03.478006+0000","last_fullsized":"2026-02-17T00:36:03.478006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:19:12.334190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000260332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.438635+0000","last_change":"2026-02-17T00:36:03.438635+0000","last_active":"2026-02-17T00:36:03.438635+0000","last_peered":"2026-02-17T00:36:03.438635+0000","last_clean":"2026-02-17T00:36:03.438635+0000","last_became_active":"2026-02-17T00:36:01.436117+0000","last_became_peered":"2026-02-17T00:36:01.436117+0000","last_unstale":"2026-02-17T00:36:03.438635+0000","last_undegraded":"2026-02-17T00:36:03.438635+0000","last_fullsized":"2026-02-17T00:36:03.438635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:13:09.059503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000288874,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.478052+0000","last_change":"2026-02-17T00:36:03.478185+0000","last_active":"2026-02-17T00:36:03.478052+0000","last_peered":"2026-02-17T00:36:03.478052+0000","last_clean":"2026-02-17T00:36:03.478052+0000","last_became_active":"2026-02-17T00:36:01.599684+0000","last_became_peered":"2026-02-17T00:36:01.599684+0000","last_unstale":"2026-02-17T00:36:03.478052+0000","last_undegraded":"2026-02-17T00:36:03.478052+0000","last_fullsized":"2026-02-17T00:36:03.478052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T04:46:54.482536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000325552,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.442133+0000","last_change":"2026-02-17T00:36:03.441817+0000","last_active":"2026-02-17T00:36:03.442133+0000","last_peered":"2026-02-17T00:36:03.442133+0000","last_clean":"2026-02-17T00:36:03.442133+0000","last_became_active":"2026-02-17T00:36:01.436186+0000","last_became_peered":"2026-02-17T00:36:01.436186+0000","last_unstale":"2026-02-17T00:36:03.442133+0000","last_undegraded":"2026-02-17T00:36:03.442133+0000","last_fullsized":"2026-02-17T00:36:03.442133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:13:09.059503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000798166,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.478034+0000","last_change":"2026-02-17T00:36:03.478034+0000","last_active":"2026-02-17T00:36:03.478034+0000","last_peered":"2026-02-17T00:36:03.478034+0000","last_clean":"2026-02-17T00:36:03.478034+0000","last_became_active":"2026-02-17T00:36:01.436385+0000","last_became_peered":"2026-02-17T00:36:01.436385+0000","last_unstale":"2026-02-17T00:36:03.478034+0000","last_undegraded":"2026-02-17T00:36:03.478034+0000","last_fullsized":"2026-02-17T00:36:03.478034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:13:09.059503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029884300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.478049+0000","last_change":"2026-02-17T00:36:03.478049+0000","last_active":"2026-02-17T00:36:03.478049+0000","last_peered":"2026-02-17T00:36:03.478049+0000","last_clean":"2026-02-17T00:36:03.478049+0000","last_became_active":"2026-02-17T00:36:01.435972+0000","last_became_peered":"2026-02-17T00:36:01.435972+0000","last_unstale":"2026-02-17T00:36:03.478049+0000","last_undegraded":"2026-02-17T00:36:03.478049+0000","last_fullsized":"2026-02-17T00:36:03.478049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:20:44.163814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026392800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6830,"internal_metadata":27583826},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":59683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6820,"internal_metadata":27583836},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6824,"internal_metadata":27583832},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6824,"internal_metadata":27583832},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4875,"internal_metadata":27585781},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6823,"internal_metadata":27583833},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":59683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:36:07.167 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T00:36:07.326 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:36:07.326 INFO:teuthology.orchestra.run.trial124.stderr:dumped all 2026-02-17T00:36:07.336 INFO:teuthology.orchestra.run.trial124.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-17T00:36:05.588052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":9,"kb":1048576000,"kb_used":271408,"kb_used_data":1808,"kb_used_omap":64,"kb_used_meta":269375,"kb_avail":1048304592,"statfs":{"total":1073741824000,"available":1073463902208,"internally_reserved":0,"allocated":1851392,"data_stored":596678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":66296,"internal_metadata":275840264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.478079+0000","last_change":"2026-02-17T00:36:03.478204+0000","last_active":"2026-02-17T00:36:03.478079+0000","last_peered":"2026-02-17T00:36:03.478079+0000","last_clean":"2026-02-17T00:36:03.478079+0000","last_became_active":"2026-02-17T00:36:01.436327+0000","last_became_peered":"2026-02-17T00:36:01.436327+0000","last_unstale":"2026-02-17T00:36:03.478079+0000","last_undegraded":"2026-02-17T00:36:03.478079+0000","last_fullsized":"2026-02-17T00:36:03.478079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:13:57.372673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032515099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.478023+0000","last_change":"2026-02-17T00:36:03.478156+0000","last_active":"2026-02-17T00:36:03.478023+0000","last_peered":"2026-02-17T00:36:03.478023+0000","last_clean":"2026-02-17T00:36:03.478023+0000","last_became_active":"2026-02-17T00:36:01.588525+0000","last_became_peered":"2026-02-17T00:36:01.588525+0000","last_unstale":"2026-02-17T00:36:03.478023+0000","last_undegraded":"2026-02-17T00:36:03.478023+0000","last_fullsized":"2026-02-17T00:36:03.478023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:51:09.669406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028708100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.478006+0000","last_change":"2026-02-17T00:36:03.478102+0000","last_active":"2026-02-17T00:36:03.478006+0000","last_peered":"2026-02-17T00:36:03.478006+0000","last_clean":"2026-02-17T00:36:03.478006+0000","last_became_active":"2026-02-17T00:36:01.436386+0000","last_became_peered":"2026-02-17T00:36:01.436386+0000","last_unstale":"2026-02-17T00:36:03.478006+0000","last_undegraded":"2026-02-17T00:36:03.478006+0000","last_fullsized":"2026-02-17T00:36:03.478006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:19:12.334190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000260332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.438635+0000","last_change":"2026-02-17T00:36:03.438635+0000","last_active":"2026-02-17T00:36:03.438635+0000","last_peered":"2026-02-17T00:36:03.438635+0000","last_clean":"2026-02-17T00:36:03.438635+0000","last_became_active":"2026-02-17T00:36:01.436117+0000","last_became_peered":"2026-02-17T00:36:01.436117+0000","last_unstale":"2026-02-17T00:36:03.438635+0000","last_undegraded":"2026-02-17T00:36:03.438635+0000","last_fullsized":"2026-02-17T00:36:03.438635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:13:09.059503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000288874,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.478052+0000","last_change":"2026-02-17T00:36:03.478185+0000","last_active":"2026-02-17T00:36:03.478052+0000","last_peered":"2026-02-17T00:36:03.478052+0000","last_clean":"2026-02-17T00:36:03.478052+0000","last_became_active":"2026-02-17T00:36:01.599684+0000","last_became_peered":"2026-02-17T00:36:01.599684+0000","last_unstale":"2026-02-17T00:36:03.478052+0000","last_undegraded":"2026-02-17T00:36:03.478052+0000","last_fullsized":"2026-02-17T00:36:03.478052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T04:46:54.482536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000325552,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.442133+0000","last_change":"2026-02-17T00:36:03.441817+0000","last_active":"2026-02-17T00:36:03.442133+0000","last_peered":"2026-02-17T00:36:03.442133+0000","last_clean":"2026-02-17T00:36:03.442133+0000","last_became_active":"2026-02-17T00:36:01.436186+0000","last_became_peered":"2026-02-17T00:36:01.436186+0000","last_unstale":"2026-02-17T00:36:03.442133+0000","last_undegraded":"2026-02-17T00:36:03.442133+0000","last_fullsized":"2026-02-17T00:36:03.442133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:13:09.059503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000798166,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.478034+0000","last_change":"2026-02-17T00:36:03.478034+0000","last_active":"2026-02-17T00:36:03.478034+0000","last_peered":"2026-02-17T00:36:03.478034+0000","last_clean":"2026-02-17T00:36:03.478034+0000","last_became_active":"2026-02-17T00:36:01.436385+0000","last_became_peered":"2026-02-17T00:36:01.436385+0000","last_unstale":"2026-02-17T00:36:03.478034+0000","last_undegraded":"2026-02-17T00:36:03.478034+0000","last_fullsized":"2026-02-17T00:36:03.478034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:13:09.059503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029884300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-17T00:36:03.478049+0000","last_change":"2026-02-17T00:36:03.478049+0000","last_active":"2026-02-17T00:36:03.478049+0000","last_peered":"2026-02-17T00:36:03.478049+0000","last_clean":"2026-02-17T00:36:03.478049+0000","last_became_active":"2026-02-17T00:36:01.435972+0000","last_became_peered":"2026-02-17T00:36:01.435972+0000","last_unstale":"2026-02-17T00:36:03.478049+0000","last_undegraded":"2026-02-17T00:36:03.478049+0000","last_fullsized":"2026-02-17T00:36:03.478049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:20:44.163814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026392800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6830,"internal_metadata":27583826},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":59683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6820,"internal_metadata":27583836},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6824,"internal_metadata":27583832},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6824,"internal_metadata":27583832},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":4,"kb_used_meta":26939,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4875,"internal_metadata":27585781},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6823,"internal_metadata":27583833},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27140,"kb_used_data":180,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830460,"statfs":{"total":107374182400,"available":107346391040,"internally_reserved":0,"allocated":184320,"data_stored":59664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27144,"kb_used_data":184,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":104830456,"statfs":{"total":107374182400,"available":107346386944,"internally_reserved":0,"allocated":188416,"data_stored":59683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:36:07.336 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T00:36:07.336 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T00:36:07.336 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T00:36:07.336 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T00:36:07.516 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:36:07.516 INFO:teuthology.orchestra.run.trial124.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T00:36:07.526 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T00:36:07.527 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T00:36:07.552 INFO:tasks.workunit:Pulling workunits from ref 03ef619e79a56cd363b087a5c6f19a1a09b49040 2026-02-17T00:36:07.553 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T00:36:07.553 INFO:tasks.workunit:timeout=3h 2026-02-17T00:36:07.553 INFO:tasks.workunit:cleanup=True 2026-02-17T00:36:07.553 DEBUG:teuthology.orchestra.run.trial124:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T00:36:07.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:36:07.558 INFO:teuthology.orchestra.run.trial124.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T00:36:07.559 DEBUG:teuthology.orchestra.run.trial124:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T00:36:07.608 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T00:36:07.609 DEBUG:teuthology.orchestra.run.trial124:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T00:36:07.654 DEBUG:teuthology.orchestra.run.trial124:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 03ef619e79a56cd363b087a5c6f19a1a09b49040 2026-02-17T00:36:07.708 INFO:tasks.workunit.client.0.trial124.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr:Note: switching to '03ef619e79a56cd363b087a5c6f19a1a09b49040'. 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr: 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr: 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr: 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr: git switch -c 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr: 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr:Or undo this operation with: 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr: 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr: git switch - 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr: 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr: 2026-02-17T00:36:36.480 INFO:tasks.workunit.client.0.trial124.stderr:HEAD is now at 03ef619e79a test/test_bluefs: make a standalone test case to reproduce bug#74765 2026-02-17T00:36:36.490 DEBUG:teuthology.orchestra.run.trial124:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T00:36:36.538 INFO:tasks.workunit.client.0.trial124.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-17T00:36:36.540 INFO:tasks.workunit.client.0.trial124.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-17T00:36:36.540 INFO:tasks.workunit.client.0.trial124.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-17T00:36:36.638 INFO:tasks.workunit.client.0.trial124.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-17T00:36:36.670 INFO:tasks.workunit.client.0.trial124.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-17T00:36:36.695 INFO:tasks.workunit.client.0.trial124.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-17T00:36:36.696 INFO:tasks.workunit.client.0.trial124.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-17T00:36:36.696 INFO:tasks.workunit.client.0.trial124.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-17T00:36:36.720 INFO:tasks.workunit.client.0.trial124.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-17T00:36:36.723 DEBUG:teuthology.orchestra.run.trial124:> set -ex 2026-02-17T00:36:36.724 DEBUG:teuthology.orchestra.run.trial124:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T00:36:36.771 INFO:tasks.workunit:Running workunits matching rados/test_health_warnings.sh on client.0... 2026-02-17T00:36:36.773 INFO:tasks.workunit:Running workunit rados/test_health_warnings.sh... 2026-02-17T00:36:36.774 DEBUG:teuthology.orchestra.run.trial124:workunit test rados/test_health_warnings.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=03ef619e79a56cd363b087a5c6f19a1a09b49040 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_health_warnings.sh 2026-02-17T00:36:36.821 INFO:tasks.workunit.client.0.trial124.stderr:+ crushtool -o crushmap --build --num_osds 10 host straw 2 rack straw 2 row straw 2 root straw 0 2026-02-17T00:36:36.832 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd setcrushmap -i crushmap 2026-02-17T00:36:38.470 INFO:tasks.workunit.client.0.trial124.stderr:6 2026-02-17T00:36:38.484 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd tree 2026-02-17T00:36:38.681 INFO:tasks.workunit.client.0.trial124.stdout:ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF 2026-02-17T00:36:38.681 INFO:tasks.workunit.client.0.trial124.stdout:-11 10.00000 root root 2026-02-17T00:36:38.681 INFO:tasks.workunit.client.0.trial124.stdout: -9 8.00000 row row0 2026-02-17T00:36:38.681 INFO:tasks.workunit.client.0.trial124.stdout: -6 4.00000 rack rack0 2026-02-17T00:36:38.681 INFO:tasks.workunit.client.0.trial124.stdout: -1 2.00000 host host0 2026-02-17T00:36:38.681 INFO:tasks.workunit.client.0.trial124.stdout: 0 1.00000 osd.0 up 1.00000 1.00000 2026-02-17T00:36:38.681 INFO:tasks.workunit.client.0.trial124.stdout: 1 1.00000 osd.1 up 1.00000 1.00000 2026-02-17T00:36:38.681 INFO:tasks.workunit.client.0.trial124.stdout: -2 2.00000 host host1 2026-02-17T00:36:38.681 INFO:tasks.workunit.client.0.trial124.stdout: 2 1.00000 osd.2 up 1.00000 1.00000 2026-02-17T00:36:38.682 INFO:tasks.workunit.client.0.trial124.stdout: 3 1.00000 osd.3 up 1.00000 1.00000 2026-02-17T00:36:38.682 INFO:tasks.workunit.client.0.trial124.stdout: -7 4.00000 rack rack1 2026-02-17T00:36:38.682 INFO:tasks.workunit.client.0.trial124.stdout: -3 2.00000 host host2 2026-02-17T00:36:38.682 INFO:tasks.workunit.client.0.trial124.stdout: 4 1.00000 osd.4 up 1.00000 1.00000 2026-02-17T00:36:38.682 INFO:tasks.workunit.client.0.trial124.stdout: 5 1.00000 osd.5 up 1.00000 1.00000 2026-02-17T00:36:38.682 INFO:tasks.workunit.client.0.trial124.stdout: -4 2.00000 host host3 2026-02-17T00:36:38.682 INFO:tasks.workunit.client.0.trial124.stdout: 6 1.00000 osd.6 up 1.00000 1.00000 2026-02-17T00:36:38.682 INFO:tasks.workunit.client.0.trial124.stdout: 7 1.00000 osd.7 up 1.00000 1.00000 2026-02-17T00:36:38.682 INFO:tasks.workunit.client.0.trial124.stdout:-10 2.00000 row row1 2026-02-17T00:36:38.682 INFO:tasks.workunit.client.0.trial124.stdout: -8 2.00000 rack rack2 2026-02-17T00:36:38.682 INFO:tasks.workunit.client.0.trial124.stdout: -5 2.00000 host host4 2026-02-17T00:36:38.682 INFO:tasks.workunit.client.0.trial124.stdout: 8 1.00000 osd.8 up 1.00000 1.00000 2026-02-17T00:36:38.682 INFO:tasks.workunit.client.0.trial124.stdout: 9 1.00000 osd.9 up 1.00000 1.00000 2026-02-17T00:36:38.690 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph tell 'osd.*' injectargs --osd_max_markdown_count 1024 --osd_max_markdown_period 1 2026-02-17T00:36:38.781 INFO:tasks.workunit.client.0.trial124.stdout:osd.0: {} 2026-02-17T00:36:38.799 INFO:tasks.workunit.client.0.trial124.stdout:osd.1: {} 2026-02-17T00:36:38.818 INFO:tasks.workunit.client.0.trial124.stdout:osd.2: {} 2026-02-17T00:36:38.835 INFO:tasks.workunit.client.0.trial124.stdout:osd.3: {} 2026-02-17T00:36:38.853 INFO:tasks.workunit.client.0.trial124.stdout:osd.4: {} 2026-02-17T00:36:38.871 INFO:tasks.workunit.client.0.trial124.stdout:osd.5: {} 2026-02-17T00:36:38.888 INFO:tasks.workunit.client.0.trial124.stdout:osd.6: {} 2026-02-17T00:36:38.906 INFO:tasks.workunit.client.0.trial124.stdout:osd.7: {} 2026-02-17T00:36:38.924 INFO:tasks.workunit.client.0.trial124.stdout:osd.8: {} 2026-02-17T00:36:38.941 INFO:tasks.workunit.client.0.trial124.stdout:osd.9: {} 2026-02-17T00:36:38.952 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd set noout 2026-02-17T00:36:40.474 INFO:tasks.workunit.client.0.trial124.stderr:noout is set 2026-02-17T00:36:40.485 INFO:tasks.workunit.client.0.trial124.stderr:+ test_mark_two_osds_same_host_down 2026-02-17T00:36:40.485 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd set noup 2026-02-17T00:36:42.479 INFO:tasks.workunit.client.0.trial124.stderr:noup is set 2026-02-17T00:36:42.494 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd down osd.0 osd.1 2026-02-17T00:36:42.648 INFO:tasks.ceph.mon.a.trial124.stderr:2026-02-17T00:36:42.641+0000 7f09979e5640 -1 mon.a@0(leader).osd e26 definitely_dead 0 2026-02-17T00:36:43.532 INFO:tasks.ceph.mon.a.trial124.stderr:2026-02-17T00:36:43.525+0000 7f09979e5640 -1 mon.a@0(leader).osd e27 definitely_dead 0 2026-02-17T00:36:43.533 INFO:tasks.workunit.client.0.trial124.stderr:osd.0 is already down. osd.1 is already down. 2026-02-17T00:36:43.543 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health detail 2026-02-17T00:36:43.800 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-17T00:36:43.801 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-17T00:36:43.801 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-17T00:36:43.801 INFO:tasks.workunit.client.0.trial124.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T00:36:43.801 INFO:tasks.workunit.client.0.trial124.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T00:36:43.801 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-17T00:36:43.801 INFO:tasks.workunit.client.0.trial124.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-17T00:36:43.810 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:36:43.810 INFO:tasks.workunit.client.0.trial124.stderr:+ grep '1 host' 2026-02-17T00:36:44.075 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-17T00:36:44.075 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:36:44.075 INFO:tasks.workunit.client.0.trial124.stderr:+ grep '2 osds' 2026-02-17T00:36:44.314 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-17T00:36:44.314 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health detail 2026-02-17T00:36:44.315 INFO:tasks.workunit.client.0.trial124.stderr:+ grep osd.0 2026-02-17T00:36:44.540 INFO:tasks.ceph.osd.0.trial124.stderr:2026-02-17T00:36:44.533+0000 7fa9d8219640 -1 osd.0 28 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T00:36:44.592 INFO:tasks.workunit.client.0.trial124.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T00:36:44.593 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health detail 2026-02-17T00:36:44.593 INFO:tasks.workunit.client.0.trial124.stderr:+ grep osd.1 2026-02-17T00:36:44.863 INFO:tasks.workunit.client.0.trial124.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T00:36:44.863 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd unset noup 2026-02-17T00:36:45.486 INFO:tasks.ceph.osd.0.trial124.stderr:2026-02-17T00:36:45.481+0000 7fa9d30ef640 -1 osd.0 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:36:45.744 INFO:tasks.ceph.osd.1.trial124.stderr:2026-02-17T00:36:45.737+0000 7f3d97b07640 -1 osd.1 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:36:46.488 INFO:tasks.workunit.client.0.trial124.stderr:noup is unset 2026-02-17T00:36:46.501 INFO:tasks.workunit.client.0.trial124.stderr:+ wait_for_healthy 2026-02-17T00:36:46.501 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:36:46.501 INFO:tasks.workunit.client.0.trial124.stderr:+ grep down 2026-02-17T00:36:46.738 INFO:tasks.workunit.client.0.trial124.stderr:+ test_mark_two_osds_same_rack_down 2026-02-17T00:36:46.738 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd set noup 2026-02-17T00:36:48.495 INFO:tasks.workunit.client.0.trial124.stderr:noup is set 2026-02-17T00:36:48.508 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd down osd.8 osd.9 2026-02-17T00:36:48.660 INFO:tasks.ceph.mon.a.trial124.stderr:2026-02-17T00:36:48.652+0000 7f09979e5640 -1 mon.a@0(leader).osd e32 definitely_dead 0 2026-02-17T00:36:49.550 INFO:tasks.ceph.mon.a.trial124.stderr:2026-02-17T00:36:49.540+0000 7f09979e5640 -1 mon.a@0(leader).osd e33 definitely_dead 0 2026-02-17T00:36:49.550 INFO:tasks.workunit.client.0.trial124.stderr:osd.8 is already down. osd.9 is already down. 2026-02-17T00:36:49.562 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health detail 2026-02-17T00:36:49.765 INFO:tasks.ceph.osd.8.trial124.stderr:2026-02-17T00:36:49.756+0000 7f503da6a640 -1 osd.8 33 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T00:36:49.832 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down; Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded 2026-02-17T00:36:49.832 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-17T00:36:49.832 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-17T00:36:49.832 INFO:tasks.workunit.client.0.trial124.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-17T00:36:49.832 INFO:tasks.workunit.client.0.trial124.stdout: osd.9 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-17T00:36:49.832 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-17T00:36:49.832 INFO:tasks.workunit.client.0.trial124.stdout: host host4 (root=root,row=row1,rack=rack2) (2 osds) is down 2026-02-17T00:36:49.832 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSD_RACK_DOWN: 1 rack (2 osds) down 2026-02-17T00:36:49.832 INFO:tasks.workunit.client.0.trial124.stdout: rack rack2 (root=root,row=row1) (2 osds) is down 2026-02-17T00:36:49.832 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSD_ROW_DOWN: 1 row (2 osds) down 2026-02-17T00:36:49.832 INFO:tasks.workunit.client.0.trial124.stdout: row row1 (root=root) (2 osds) is down 2026-02-17T00:36:49.833 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded 2026-02-17T00:36:49.833 INFO:tasks.workunit.client.0.trial124.stdout: pg 1.2 is active+undersized+degraded+wait, acting [4] 2026-02-17T00:36:49.833 INFO:tasks.workunit.client.0.trial124.stdout: pg 1.3 is active+undersized+degraded+wait, acting [3] 2026-02-17T00:36:49.842 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:36:49.842 INFO:tasks.workunit.client.0.trial124.stderr:+ grep '1 host' 2026-02-17T00:36:50.096 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down; Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded 2026-02-17T00:36:50.097 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:36:50.097 INFO:tasks.workunit.client.0.trial124.stderr:+ grep '1 rack' 2026-02-17T00:36:50.342 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down; Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded 2026-02-17T00:36:50.343 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:36:50.343 INFO:tasks.workunit.client.0.trial124.stderr:+ grep '1 row' 2026-02-17T00:36:50.500 INFO:tasks.ceph.osd.8.trial124.stderr:2026-02-17T00:36:50.492+0000 7f502c5ee640 -1 osd.8 34 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T00:36:50.587 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down; Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded 2026-02-17T00:36:50.587 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:36:50.588 INFO:tasks.workunit.client.0.trial124.stderr:+ grep '2 osds' 2026-02-17T00:36:50.839 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down; 1 rack (2 osds) down; 1 row (2 osds) down; Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded 2026-02-17T00:36:50.839 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health detail 2026-02-17T00:36:50.839 INFO:tasks.workunit.client.0.trial124.stderr:+ grep osd.8 2026-02-17T00:36:51.106 INFO:tasks.workunit.client.0.trial124.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-17T00:36:51.106 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health detail 2026-02-17T00:36:51.107 INFO:tasks.workunit.client.0.trial124.stderr:+ grep osd.9 2026-02-17T00:36:51.369 INFO:tasks.workunit.client.0.trial124.stdout: osd.9 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-17T00:36:51.370 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd unset noup 2026-02-17T00:36:52.502 INFO:tasks.ceph.osd.8.trial124.stderr:2026-02-17T00:36:52.496+0000 7f5034938640 -1 osd.8 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:36:52.645 INFO:tasks.ceph.osd.9.trial124.stderr:2026-02-17T00:36:52.636+0000 7f6520a42640 -1 osd.9 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:36:53.503 INFO:tasks.workunit.client.0.trial124.stderr:noup is unset 2026-02-17T00:36:53.515 INFO:tasks.workunit.client.0.trial124.stderr:+ wait_for_healthy 2026-02-17T00:36:53.515 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:36:53.515 INFO:tasks.workunit.client.0.trial124.stderr:+ grep down 2026-02-17T00:36:53.750 INFO:tasks.workunit.client.0.trial124.stderr:+ test_mark_all_but_last_osds_down 2026-02-17T00:36:53.750 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd set noup 2026-02-17T00:36:55.507 INFO:tasks.workunit.client.0.trial124.stderr:noup is set 2026-02-17T00:36:55.519 INFO:tasks.workunit.client.0.trial124.stderr:++ ceph osd ls 2026-02-17T00:36:55.520 INFO:tasks.workunit.client.0.trial124.stderr:++ sed '$d' 2026-02-17T00:36:55.733 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd down 0 1 2 3 4 5 6 7 8 2026-02-17T00:36:55.889 INFO:tasks.ceph.mon.a.trial124.stderr:2026-02-17T00:36:55.880+0000 7f09979e5640 -1 mon.a@0(leader).osd e38 definitely_dead 0 2026-02-17T00:36:56.562 INFO:tasks.ceph.mon.a.trial124.stderr:2026-02-17T00:36:56.552+0000 7f09979e5640 -1 mon.a@0(leader).osd e39 definitely_dead 0 2026-02-17T00:36:56.562 INFO:tasks.workunit.client.0.trial124.stderr:osd.0 is already down. osd.1 is already down. osd.2 is already down. osd.3 is already down. osd.4 is already down. osd.5 is already down. osd.6 is already down. osd.7 is already down. osd.8 is already down. 2026-02-17T00:36:56.572 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health detail 2026-02-17T00:36:56.723 INFO:tasks.ceph.osd.8.trial124.stderr:2026-02-17T00:36:56.716+0000 7f503d269640 -1 osd.8 39 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T00:36:56.841 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-17T00:36:56.841 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-17T00:36:56.841 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSD_DOWN: 9 osds down 2026-02-17T00:36:56.841 INFO:tasks.workunit.client.0.trial124.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T00:36:56.841 INFO:tasks.workunit.client.0.trial124.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T00:36:56.841 INFO:tasks.workunit.client.0.trial124.stdout: osd.2 (root=root,row=row0,rack=rack0,host=host1) is down 2026-02-17T00:36:56.841 INFO:tasks.workunit.client.0.trial124.stdout: osd.3 (root=root,row=row0,rack=rack0,host=host1) is down 2026-02-17T00:36:56.841 INFO:tasks.workunit.client.0.trial124.stdout: osd.4 (root=root,row=row0,rack=rack1,host=host2) is down 2026-02-17T00:36:56.841 INFO:tasks.workunit.client.0.trial124.stdout: osd.5 (root=root,row=row0,rack=rack1,host=host2) is down 2026-02-17T00:36:56.842 INFO:tasks.workunit.client.0.trial124.stdout: osd.6 (root=root,row=row0,rack=rack1,host=host3) is down 2026-02-17T00:36:56.842 INFO:tasks.workunit.client.0.trial124.stdout: osd.7 (root=root,row=row0,rack=rack1,host=host3) is down 2026-02-17T00:36:56.842 INFO:tasks.workunit.client.0.trial124.stdout: osd.8 (root=root,row=row1,rack=rack2,host=host4) is down 2026-02-17T00:36:56.842 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSD_HOST_DOWN: 4 hosts (8 osds) down 2026-02-17T00:36:56.842 INFO:tasks.workunit.client.0.trial124.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-17T00:36:56.842 INFO:tasks.workunit.client.0.trial124.stdout: host host1 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-17T00:36:56.842 INFO:tasks.workunit.client.0.trial124.stdout: host host2 (root=root,row=row0,rack=rack1) (2 osds) is down 2026-02-17T00:36:56.842 INFO:tasks.workunit.client.0.trial124.stdout: host host3 (root=root,row=row0,rack=rack1) (2 osds) is down 2026-02-17T00:36:56.842 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSD_RACK_DOWN: 2 racks (8 osds) down 2026-02-17T00:36:56.842 INFO:tasks.workunit.client.0.trial124.stdout: rack rack0 (root=root,row=row0) (4 osds) is down 2026-02-17T00:36:56.842 INFO:tasks.workunit.client.0.trial124.stdout: rack rack1 (root=root,row=row0) (4 osds) is down 2026-02-17T00:36:56.842 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSD_ROW_DOWN: 1 row (8 osds) down 2026-02-17T00:36:56.842 INFO:tasks.workunit.client.0.trial124.stdout: row row0 (root=root) (8 osds) is down 2026-02-17T00:36:56.851 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:36:56.851 INFO:tasks.workunit.client.0.trial124.stderr:+ grep '1 row' 2026-02-17T00:36:57.109 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-17T00:36:57.110 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:36:57.110 INFO:tasks.workunit.client.0.trial124.stderr:+ grep '2 racks' 2026-02-17T00:36:57.169 INFO:tasks.ceph.osd.2.trial124.stderr:2026-02-17T00:36:57.160+0000 7fdfa94f2640 -1 osd.2 39 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T00:36:57.252 INFO:tasks.ceph.osd.6.trial124.stderr:2026-02-17T00:36:57.244+0000 7f5635a75640 -1 osd.6 39 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T00:36:57.350 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-17T00:36:57.350 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:36:57.351 INFO:tasks.workunit.client.0.trial124.stderr:+ grep '4 hosts' 2026-02-17T00:36:57.515 INFO:tasks.ceph.osd.2.trial124.stderr:2026-02-17T00:36:57.508+0000 7fdf9c07e640 -1 osd.2 40 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T00:36:57.515 INFO:tasks.ceph.osd.8.trial124.stderr:2026-02-17T00:36:57.508+0000 7f502c5ee640 -1 osd.8 40 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T00:36:57.515 INFO:tasks.ceph.osd.6.trial124.stderr:2026-02-17T00:36:57.508+0000 7f56245f9640 -1 osd.6 40 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T00:36:57.590 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-17T00:36:57.591 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:36:57.591 INFO:tasks.workunit.client.0.trial124.stderr:+ grep '9 osds' 2026-02-17T00:36:57.624 INFO:tasks.ceph.osd.3.trial124.stderr:2026-02-17T00:36:57.616+0000 7fcc4d807640 -1 osd.3 40 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T00:36:57.831 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 9 osds down; 4 hosts (8 osds) down; 2 racks (8 osds) down; 1 row (8 osds) down 2026-02-17T00:36:57.831 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd unset noup 2026-02-17T00:36:58.518 INFO:tasks.ceph.osd.2.trial124.stderr:2026-02-17T00:36:58.508+0000 7fdfa43c8640 -1 osd.2 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:36:58.518 INFO:tasks.ceph.osd.3.trial124.stderr:2026-02-17T00:36:58.508+0000 7fcc486dd640 -1 osd.3 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:36:58.519 INFO:tasks.ceph.osd.6.trial124.stderr:2026-02-17T00:36:58.508+0000 7f562c943640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:36:58.519 INFO:tasks.ceph.osd.8.trial124.stderr:2026-02-17T00:36:58.508+0000 7f5034938640 -1 osd.8 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:36:58.615 INFO:tasks.ceph.osd.0.trial124.stderr:2026-02-17T00:36:58.608+0000 7fa9d30ef640 -1 osd.0 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:36:59.517 INFO:tasks.workunit.client.0.trial124.stderr:noup is unset 2026-02-17T00:36:59.531 INFO:tasks.workunit.client.0.trial124.stderr:+ wait_for_healthy 2026-02-17T00:36:59.531 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:36:59.532 INFO:tasks.workunit.client.0.trial124.stderr:+ grep down 2026-02-17T00:36:59.774 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noout flag(s) set; 4 osds down; 1 host (2 osds) down 2026-02-17T00:36:59.775 INFO:tasks.workunit.client.0.trial124.stderr:+ sleep 1 2026-02-17T00:37:00.063 INFO:tasks.ceph.osd.7.trial124.stderr:2026-02-17T00:37:00.056+0000 7f21f8723640 -1 osd.7 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:37:00.759 INFO:tasks.ceph.osd.1.trial124.stderr:2026-02-17T00:37:00.752+0000 7f3d97b07640 -1 osd.1 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:37:00.775 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:37:00.776 INFO:tasks.workunit.client.0.trial124.stderr:+ grep down 2026-02-17T00:37:00.819 INFO:tasks.ceph.osd.5.trial124.stderr:2026-02-17T00:37:00.812+0000 7f2f5a674640 -1 osd.5 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:37:01.018 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noout flag(s) set; 3 osds down; 1 host (2 osds) down 2026-02-17T00:37:01.018 INFO:tasks.workunit.client.0.trial124.stderr:+ sleep 1 2026-02-17T00:37:01.428 INFO:tasks.ceph.osd.4.trial124.stderr:2026-02-17T00:37:01.420+0000 7f1b894a2640 -1 osd.4 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:37:02.020 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:37:02.020 INFO:tasks.workunit.client.0.trial124.stderr:+ grep down 2026-02-17T00:37:02.262 INFO:tasks.workunit.client.0.trial124.stderr:+ test_mark_two_osds_same_host_down_with_classes 2026-02-17T00:37:02.262 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd set noup 2026-02-17T00:37:03.526 INFO:tasks.workunit.client.0.trial124.stderr:noup is set 2026-02-17T00:37:03.537 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd crush set-device-class ssd osd.0 osd.2 osd.4 osd.6 osd.8 2026-02-17T00:37:05.530 INFO:tasks.workunit.client.0.trial124.stderr:osd.0 already set to class ssd. set-device-class item id 0 name 'osd.0' device_class 'ssd': no change. osd.2 already set to class ssd. set-device-class item id 2 name 'osd.2' device_class 'ssd': no change. osd.4 already set to class ssd. set-device-class item id 4 name 'osd.4' device_class 'ssd': no change. osd.6 already set to class ssd. set-device-class item id 6 name 'osd.6' device_class 'ssd': no change. osd.8 already set to class ssd. set-device-class item id 8 name 'osd.8' device_class 'ssd': no change. set osd(s) to class 'ssd' 2026-02-17T00:37:05.542 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd crush set-device-class hdd osd.1 osd.3 osd.5 osd.7 osd.9 2026-02-17T00:37:07.535 INFO:tasks.workunit.client.0.trial124.stderr:osd.1 already set to class hdd. set-device-class item id 1 name 'osd.1' device_class 'hdd': no change. osd.3 already set to class hdd. set-device-class item id 3 name 'osd.3' device_class 'hdd': no change. osd.5 already set to class hdd. set-device-class item id 5 name 'osd.5' device_class 'hdd': no change. osd.7 already set to class hdd. set-device-class item id 7 name 'osd.7' device_class 'hdd': no change. osd.9 already set to class hdd. set-device-class item id 9 name 'osd.9' device_class 'hdd': no change. set osd(s) to class 'hdd' 2026-02-17T00:37:07.546 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd down osd.0 osd.1 2026-02-17T00:37:07.697 INFO:tasks.ceph.mon.a.trial124.stderr:2026-02-17T00:37:07.688+0000 7f09979e5640 -1 mon.a@0(leader).osd e50 definitely_dead 0 2026-02-17T00:37:08.590 INFO:tasks.ceph.mon.a.trial124.stderr:2026-02-17T00:37:08.580+0000 7f09979e5640 -1 mon.a@0(leader).osd e51 definitely_dead 0 2026-02-17T00:37:08.590 INFO:tasks.workunit.client.0.trial124.stderr:osd.0 is already down. osd.1 is already down. 2026-02-17T00:37:08.601 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health detail 2026-02-17T00:37:08.865 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-17T00:37:08.865 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSDMAP_FLAGS: noup,noout flag(s) set 2026-02-17T00:37:08.865 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSD_DOWN: 2 osds down 2026-02-17T00:37:08.866 INFO:tasks.workunit.client.0.trial124.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T00:37:08.866 INFO:tasks.workunit.client.0.trial124.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T00:37:08.866 INFO:tasks.workunit.client.0.trial124.stdout:[WRN] OSD_HOST_DOWN: 1 host (2 osds) down 2026-02-17T00:37:08.866 INFO:tasks.workunit.client.0.trial124.stdout: host host0 (root=root,row=row0,rack=rack0) (2 osds) is down 2026-02-17T00:37:08.875 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:37:08.875 INFO:tasks.workunit.client.0.trial124.stderr:+ grep '1 host' 2026-02-17T00:37:09.122 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-17T00:37:09.123 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:37:09.123 INFO:tasks.workunit.client.0.trial124.stderr:+ grep '2 osds' 2026-02-17T00:37:09.362 INFO:tasks.workunit.client.0.trial124.stdout:HEALTH_WARN noup,noout flag(s) set; 2 osds down; 1 host (2 osds) down 2026-02-17T00:37:09.362 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health detail 2026-02-17T00:37:09.362 INFO:tasks.workunit.client.0.trial124.stderr:+ grep osd.0 2026-02-17T00:37:09.632 INFO:tasks.workunit.client.0.trial124.stdout: osd.0 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T00:37:09.632 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health detail 2026-02-17T00:37:09.632 INFO:tasks.workunit.client.0.trial124.stderr:+ grep osd.1 2026-02-17T00:37:09.641 INFO:tasks.ceph.osd.0.trial124.stderr:2026-02-17T00:37:09.632+0000 7fa9d8219640 -1 osd.0 52 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T00:37:09.687 INFO:tasks.ceph.osd.1.trial124.stderr:2026-02-17T00:37:09.680+0000 7f3da0c39640 -1 osd.1 52 osdmap NOUP flag is set, waiting for it to clear 2026-02-17T00:37:09.897 INFO:tasks.workunit.client.0.trial124.stdout: osd.1 (root=root,row=row0,rack=rack0,host=host0) is down 2026-02-17T00:37:09.898 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph osd unset noup 2026-02-17T00:37:10.544 INFO:tasks.ceph.osd.0.trial124.stderr:2026-02-17T00:37:10.536+0000 7fa9d30ef640 -1 osd.0 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:37:10.545 INFO:tasks.ceph.osd.1.trial124.stderr:2026-02-17T00:37:10.536+0000 7f3d97b07640 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T00:37:11.543 INFO:tasks.workunit.client.0.trial124.stderr:noup is unset 2026-02-17T00:37:11.555 INFO:tasks.workunit.client.0.trial124.stderr:+ wait_for_healthy 2026-02-17T00:37:11.555 INFO:tasks.workunit.client.0.trial124.stderr:+ ceph health 2026-02-17T00:37:11.555 INFO:tasks.workunit.client.0.trial124.stderr:+ grep down 2026-02-17T00:37:11.796 INFO:tasks.workunit.client.0.trial124.stderr:+ exit 0 2026-02-17T00:37:11.796 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T00:37:11.797 DEBUG:teuthology.orchestra.run.trial124:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T00:37:11.851 INFO:tasks.workunit:Stopping ['rados/test_health_warnings.sh'] on client.0... 2026-02-17T00:37:11.852 DEBUG:teuthology.orchestra.run.trial124:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T00:37:12.205 DEBUG:teuthology.parallel:result is None 2026-02-17T00:37:12.206 DEBUG:teuthology.orchestra.run.trial124:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T00:37:12.213 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T00:37:12.214 DEBUG:teuthology.orchestra.run.trial124:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T00:37:12.258 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T00:37:12.259 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T00:37:12.321 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T00:37:12.321 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T00:37:12.476 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:12.477 INFO:teuthology.orchestra.run.trial124.stderr:dumped all 2026-02-17T00:37:12.487 INFO:teuthology.orchestra.run.trial124.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2026-02-17T00:37:11.595550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275344,"kb_used_data":5744,"kb_used_omap":224,"kb_used_meta":269215,"kb_avail":1048300656,"statfs":{"total":1073741824000,"available":1073459871744,"internally_reserved":0,"allocated":5881856,"data_stored":2777856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":229893,"internal_metadata":275676667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000411"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":71,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.538738+0000","last_change":"2026-02-17T00:37:02.526015+0000","last_active":"2026-02-17T00:37:09.538738+0000","last_peered":"2026-02-17T00:37:09.538738+0000","last_clean":"2026-02-17T00:37:09.538738+0000","last_became_active":"2026-02-17T00:37:02.525791+0000","last_became_peered":"2026-02-17T00:37:02.525791+0000","last_unstale":"2026-02-17T00:37:09.538738+0000","last_undegraded":"2026-02-17T00:37:09.538738+0000","last_fullsized":"2026-02-17T00:37:09.538738+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:46.165399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032515099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":94,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.538120+0000","last_change":"2026-02-17T00:37:02.525951+0000","last_active":"2026-02-17T00:37:09.538120+0000","last_peered":"2026-02-17T00:37:09.538120+0000","last_clean":"2026-02-17T00:37:09.538120+0000","last_became_active":"2026-02-17T00:37:02.525745+0000","last_became_peered":"2026-02-17T00:37:02.525745+0000","last_unstale":"2026-02-17T00:37:09.538120+0000","last_undegraded":"2026-02-17T00:37:09.538120+0000","last_fullsized":"2026-02-17T00:37:09.538120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:16:51.675193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028708100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":52,"state":"active+undersized","last_fresh":"2026-02-17T00:37:09.538474+0000","last_change":"2026-02-17T00:37:09.538349+0000","last_active":"2026-02-17T00:37:09.538474+0000","last_peered":"2026-02-17T00:37:09.538474+0000","last_clean":"2026-02-17T00:37:07.989888+0000","last_became_active":"2026-02-17T00:37:09.538349+0000","last_became_peered":"2026-02-17T00:37:09.538349+0000","last_unstale":"2026-02-17T00:37:09.538474+0000","last_undegraded":"2026-02-17T00:37:09.538474+0000","last_fullsized":"2026-02-17T00:37:09.538072+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:21:17.728256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000260332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":52,"state":"active+undersized","last_fresh":"2026-02-17T00:37:09.538515+0000","last_change":"2026-02-17T00:37:09.538393+0000","last_active":"2026-02-17T00:37:09.538515+0000","last_peered":"2026-02-17T00:37:09.538515+0000","last_clean":"2026-02-17T00:36:00.429301+0000","last_became_active":"2026-02-17T00:37:09.538393+0000","last_became_peered":"2026-02-17T00:37:09.538393+0000","last_unstale":"2026-02-17T00:37:09.538515+0000","last_undegraded":"2026-02-17T00:37:09.538515+0000","last_fullsized":"2026-02-17T00:37:09.538132+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:32:50.102318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":88,"reported_epoch":52,"state":"active+undersized+degraded","last_fresh":"2026-02-17T00:37:09.539166+0000","last_change":"2026-02-17T00:37:09.539057+0000","last_active":"2026-02-17T00:37:09.539166+0000","last_peered":"2026-02-17T00:37:09.539166+0000","last_clean":"2026-02-17T00:37:07.989853+0000","last_became_active":"2026-02-17T00:37:09.539057+0000","last_became_peered":"2026-02-17T00:37:09.539057+0000","last_unstale":"2026-02-17T00:37:09.539166+0000","last_undegraded":"2026-02-17T00:37:09.538822+0000","last_fullsized":"2026-02-17T00:37:09.538778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:06:59.333199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":83,"reported_epoch":52,"state":"active+undersized+degraded","last_fresh":"2026-02-17T00:37:09.538544+0000","last_change":"2026-02-17T00:37:09.538399+0000","last_active":"2026-02-17T00:37:09.538544+0000","last_peered":"2026-02-17T00:37:09.538544+0000","last_clean":"2026-02-17T00:37:07.989821+0000","last_became_active":"2026-02-17T00:37:09.538399+0000","last_became_peered":"2026-02-17T00:37:09.538399+0000","last_unstale":"2026-02-17T00:37:09.538544+0000","last_undegraded":"2026-02-17T00:37:09.538153+0000","last_fullsized":"2026-02-17T00:37:09.538110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:29:28.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000798166,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.701366+0000","last_change":"2026-02-17T00:37:01.790450+0000","last_active":"2026-02-17T00:37:09.701366+0000","last_peered":"2026-02-17T00:37:09.701366+0000","last_clean":"2026-02-17T00:37:09.701366+0000","last_became_active":"2026-02-17T00:37:01.790253+0000","last_became_peered":"2026-02-17T00:37:01.790253+0000","last_unstale":"2026-02-17T00:37:09.701366+0000","last_undegraded":"2026-02-17T00:37:09.701366+0000","last_fullsized":"2026-02-17T00:37:09.701366+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:37:58.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029884300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.538039+0000","last_change":"2026-02-17T00:37:02.525244+0000","last_active":"2026-02-17T00:37:09.538039+0000","last_peered":"2026-02-17T00:37:09.538039+0000","last_clean":"2026-02-17T00:37:09.538039+0000","last_became_active":"2026-02-17T00:37:02.525057+0000","last_became_peered":"2026-02-17T00:37:02.525057+0000","last_unstale":"2026-02-17T00:37:09.538039+0000","last_undegraded":"2026-02-17T00:37:09.538039+0000","last_fullsized":"2026-02-17T00:37:09.538039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:58:40.824463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":36,"seq":154618822674,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20586,"internal_metadata":27570070},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":42,"seq":180388626450,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27524,"kb_used_data":564,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":104830076,"statfs":{"total":107374182400,"available":107345997824,"internally_reserved":0,"allocated":577536,"data_stored":271569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15373,"internal_metadata":27575283},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593745,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19274,"internal_metadata":27571382},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626450,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24486,"internal_metadata":27566170},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561042,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25138,"internal_metadata":27565518},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":42,"seq":180388626449,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26438,"internal_metadata":27564218},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626449,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27524,"kb_used_data":564,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830076,"statfs":{"total":107374182400,"available":107345997824,"internally_reserved":0,"allocated":577536,"data_stored":271569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":17,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":17,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:37:12.490 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T00:37:12.648 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:12.649 INFO:teuthology.orchestra.run.trial124.stderr:dumped all 2026-02-17T00:37:12.659 INFO:teuthology.orchestra.run.trial124.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2026-02-17T00:37:12.543520+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275344,"kb_used_data":5744,"kb_used_omap":224,"kb_used_meta":269215,"kb_avail":1048300656,"statfs":{"total":1073741824000,"available":1073459871744,"internally_reserved":0,"allocated":5881856,"data_stored":2777856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":229893,"internal_metadata":275676667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.008641"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":71,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.538738+0000","last_change":"2026-02-17T00:37:02.526015+0000","last_active":"2026-02-17T00:37:09.538738+0000","last_peered":"2026-02-17T00:37:09.538738+0000","last_clean":"2026-02-17T00:37:09.538738+0000","last_became_active":"2026-02-17T00:37:02.525791+0000","last_became_peered":"2026-02-17T00:37:02.525791+0000","last_unstale":"2026-02-17T00:37:09.538738+0000","last_undegraded":"2026-02-17T00:37:09.538738+0000","last_fullsized":"2026-02-17T00:37:09.538738+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:46.165399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032515099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":94,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.538120+0000","last_change":"2026-02-17T00:37:02.525951+0000","last_active":"2026-02-17T00:37:09.538120+0000","last_peered":"2026-02-17T00:37:09.538120+0000","last_clean":"2026-02-17T00:37:09.538120+0000","last_became_active":"2026-02-17T00:37:02.525745+0000","last_became_peered":"2026-02-17T00:37:02.525745+0000","last_unstale":"2026-02-17T00:37:09.538120+0000","last_undegraded":"2026-02-17T00:37:09.538120+0000","last_fullsized":"2026-02-17T00:37:09.538120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:16:51.675193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028708100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":52,"state":"active+undersized","last_fresh":"2026-02-17T00:37:09.538474+0000","last_change":"2026-02-17T00:37:09.538349+0000","last_active":"2026-02-17T00:37:09.538474+0000","last_peered":"2026-02-17T00:37:09.538474+0000","last_clean":"2026-02-17T00:37:07.989888+0000","last_became_active":"2026-02-17T00:37:09.538349+0000","last_became_peered":"2026-02-17T00:37:09.538349+0000","last_unstale":"2026-02-17T00:37:09.538474+0000","last_undegraded":"2026-02-17T00:37:09.538474+0000","last_fullsized":"2026-02-17T00:37:09.538072+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:21:17.728256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000260332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":52,"state":"active+undersized","last_fresh":"2026-02-17T00:37:09.538515+0000","last_change":"2026-02-17T00:37:09.538393+0000","last_active":"2026-02-17T00:37:09.538515+0000","last_peered":"2026-02-17T00:37:09.538515+0000","last_clean":"2026-02-17T00:36:00.429301+0000","last_became_active":"2026-02-17T00:37:09.538393+0000","last_became_peered":"2026-02-17T00:37:09.538393+0000","last_unstale":"2026-02-17T00:37:09.538515+0000","last_undegraded":"2026-02-17T00:37:09.538515+0000","last_fullsized":"2026-02-17T00:37:09.538132+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:32:50.102318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":88,"reported_epoch":52,"state":"active+undersized+degraded","last_fresh":"2026-02-17T00:37:09.539166+0000","last_change":"2026-02-17T00:37:09.539057+0000","last_active":"2026-02-17T00:37:09.539166+0000","last_peered":"2026-02-17T00:37:09.539166+0000","last_clean":"2026-02-17T00:37:07.989853+0000","last_became_active":"2026-02-17T00:37:09.539057+0000","last_became_peered":"2026-02-17T00:37:09.539057+0000","last_unstale":"2026-02-17T00:37:09.539166+0000","last_undegraded":"2026-02-17T00:37:09.538822+0000","last_fullsized":"2026-02-17T00:37:09.538778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:06:59.333199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":83,"reported_epoch":52,"state":"active+undersized+degraded","last_fresh":"2026-02-17T00:37:09.538544+0000","last_change":"2026-02-17T00:37:09.538399+0000","last_active":"2026-02-17T00:37:09.538544+0000","last_peered":"2026-02-17T00:37:09.538544+0000","last_clean":"2026-02-17T00:37:07.989821+0000","last_became_active":"2026-02-17T00:37:09.538399+0000","last_became_peered":"2026-02-17T00:37:09.538399+0000","last_unstale":"2026-02-17T00:37:09.538544+0000","last_undegraded":"2026-02-17T00:37:09.538153+0000","last_fullsized":"2026-02-17T00:37:09.538110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:29:28.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000798166,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.701366+0000","last_change":"2026-02-17T00:37:01.790450+0000","last_active":"2026-02-17T00:37:09.701366+0000","last_peered":"2026-02-17T00:37:09.701366+0000","last_clean":"2026-02-17T00:37:09.701366+0000","last_became_active":"2026-02-17T00:37:01.790253+0000","last_became_peered":"2026-02-17T00:37:01.790253+0000","last_unstale":"2026-02-17T00:37:09.701366+0000","last_undegraded":"2026-02-17T00:37:09.701366+0000","last_fullsized":"2026-02-17T00:37:09.701366+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:37:58.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029884300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.538039+0000","last_change":"2026-02-17T00:37:02.525244+0000","last_active":"2026-02-17T00:37:09.538039+0000","last_peered":"2026-02-17T00:37:09.538039+0000","last_clean":"2026-02-17T00:37:09.538039+0000","last_became_active":"2026-02-17T00:37:02.525057+0000","last_became_peered":"2026-02-17T00:37:02.525057+0000","last_unstale":"2026-02-17T00:37:09.538039+0000","last_undegraded":"2026-02-17T00:37:09.538039+0000","last_fullsized":"2026-02-17T00:37:09.538039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:58:40.824463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":36,"seq":154618822674,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20586,"internal_metadata":27570070},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":42,"seq":180388626450,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27524,"kb_used_data":564,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":104830076,"statfs":{"total":107374182400,"available":107345997824,"internally_reserved":0,"allocated":577536,"data_stored":271569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15373,"internal_metadata":27575283},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593745,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19274,"internal_metadata":27571382},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626450,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24486,"internal_metadata":27566170},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561042,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25138,"internal_metadata":27565518},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":42,"seq":180388626449,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26438,"internal_metadata":27564218},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626449,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27524,"kb_used_data":564,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830076,"statfs":{"total":107374182400,"available":107345997824,"internally_reserved":0,"allocated":577536,"data_stored":271569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":17,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":17,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:37:12.662 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T00:37:12.814 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:12.814 INFO:teuthology.orchestra.run.trial124.stderr:dumped all 2026-02-17T00:37:12.824 INFO:teuthology.orchestra.run.trial124.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2026-02-17T00:37:12.543520+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275344,"kb_used_data":5744,"kb_used_omap":224,"kb_used_meta":269215,"kb_avail":1048300656,"statfs":{"total":1073741824000,"available":1073459871744,"internally_reserved":0,"allocated":5881856,"data_stored":2777856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":229893,"internal_metadata":275676667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.008641"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":71,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.538738+0000","last_change":"2026-02-17T00:37:02.526015+0000","last_active":"2026-02-17T00:37:09.538738+0000","last_peered":"2026-02-17T00:37:09.538738+0000","last_clean":"2026-02-17T00:37:09.538738+0000","last_became_active":"2026-02-17T00:37:02.525791+0000","last_became_peered":"2026-02-17T00:37:02.525791+0000","last_unstale":"2026-02-17T00:37:09.538738+0000","last_undegraded":"2026-02-17T00:37:09.538738+0000","last_fullsized":"2026-02-17T00:37:09.538738+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:46.165399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032515099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":94,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.538120+0000","last_change":"2026-02-17T00:37:02.525951+0000","last_active":"2026-02-17T00:37:09.538120+0000","last_peered":"2026-02-17T00:37:09.538120+0000","last_clean":"2026-02-17T00:37:09.538120+0000","last_became_active":"2026-02-17T00:37:02.525745+0000","last_became_peered":"2026-02-17T00:37:02.525745+0000","last_unstale":"2026-02-17T00:37:09.538120+0000","last_undegraded":"2026-02-17T00:37:09.538120+0000","last_fullsized":"2026-02-17T00:37:09.538120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:16:51.675193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028708100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":52,"state":"active+undersized","last_fresh":"2026-02-17T00:37:09.538474+0000","last_change":"2026-02-17T00:37:09.538349+0000","last_active":"2026-02-17T00:37:09.538474+0000","last_peered":"2026-02-17T00:37:09.538474+0000","last_clean":"2026-02-17T00:37:07.989888+0000","last_became_active":"2026-02-17T00:37:09.538349+0000","last_became_peered":"2026-02-17T00:37:09.538349+0000","last_unstale":"2026-02-17T00:37:09.538474+0000","last_undegraded":"2026-02-17T00:37:09.538474+0000","last_fullsized":"2026-02-17T00:37:09.538072+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:21:17.728256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000260332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":52,"state":"active+undersized","last_fresh":"2026-02-17T00:37:09.538515+0000","last_change":"2026-02-17T00:37:09.538393+0000","last_active":"2026-02-17T00:37:09.538515+0000","last_peered":"2026-02-17T00:37:09.538515+0000","last_clean":"2026-02-17T00:36:00.429301+0000","last_became_active":"2026-02-17T00:37:09.538393+0000","last_became_peered":"2026-02-17T00:37:09.538393+0000","last_unstale":"2026-02-17T00:37:09.538515+0000","last_undegraded":"2026-02-17T00:37:09.538515+0000","last_fullsized":"2026-02-17T00:37:09.538132+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:32:50.102318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":88,"reported_epoch":52,"state":"active+undersized+degraded","last_fresh":"2026-02-17T00:37:09.539166+0000","last_change":"2026-02-17T00:37:09.539057+0000","last_active":"2026-02-17T00:37:09.539166+0000","last_peered":"2026-02-17T00:37:09.539166+0000","last_clean":"2026-02-17T00:37:07.989853+0000","last_became_active":"2026-02-17T00:37:09.539057+0000","last_became_peered":"2026-02-17T00:37:09.539057+0000","last_unstale":"2026-02-17T00:37:09.539166+0000","last_undegraded":"2026-02-17T00:37:09.538822+0000","last_fullsized":"2026-02-17T00:37:09.538778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:06:59.333199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":83,"reported_epoch":52,"state":"active+undersized+degraded","last_fresh":"2026-02-17T00:37:09.538544+0000","last_change":"2026-02-17T00:37:09.538399+0000","last_active":"2026-02-17T00:37:09.538544+0000","last_peered":"2026-02-17T00:37:09.538544+0000","last_clean":"2026-02-17T00:37:07.989821+0000","last_became_active":"2026-02-17T00:37:09.538399+0000","last_became_peered":"2026-02-17T00:37:09.538399+0000","last_unstale":"2026-02-17T00:37:09.538544+0000","last_undegraded":"2026-02-17T00:37:09.538153+0000","last_fullsized":"2026-02-17T00:37:09.538110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:29:28.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000798166,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.701366+0000","last_change":"2026-02-17T00:37:01.790450+0000","last_active":"2026-02-17T00:37:09.701366+0000","last_peered":"2026-02-17T00:37:09.701366+0000","last_clean":"2026-02-17T00:37:09.701366+0000","last_became_active":"2026-02-17T00:37:01.790253+0000","last_became_peered":"2026-02-17T00:37:01.790253+0000","last_unstale":"2026-02-17T00:37:09.701366+0000","last_undegraded":"2026-02-17T00:37:09.701366+0000","last_fullsized":"2026-02-17T00:37:09.701366+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:37:58.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029884300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.538039+0000","last_change":"2026-02-17T00:37:02.525244+0000","last_active":"2026-02-17T00:37:09.538039+0000","last_peered":"2026-02-17T00:37:09.538039+0000","last_clean":"2026-02-17T00:37:09.538039+0000","last_became_active":"2026-02-17T00:37:02.525057+0000","last_became_peered":"2026-02-17T00:37:02.525057+0000","last_unstale":"2026-02-17T00:37:09.538039+0000","last_undegraded":"2026-02-17T00:37:09.538039+0000","last_fullsized":"2026-02-17T00:37:09.538039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:58:40.824463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":36,"seq":154618822674,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20586,"internal_metadata":27570070},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":42,"seq":180388626450,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27524,"kb_used_data":564,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":104830076,"statfs":{"total":107374182400,"available":107345997824,"internally_reserved":0,"allocated":577536,"data_stored":271569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15373,"internal_metadata":27575283},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593745,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19274,"internal_metadata":27571382},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626450,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24486,"internal_metadata":27566170},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561042,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25138,"internal_metadata":27565518},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":42,"seq":180388626449,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26438,"internal_metadata":27564218},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626449,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27524,"kb_used_data":564,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830076,"statfs":{"total":107374182400,"available":107345997824,"internally_reserved":0,"allocated":577536,"data_stored":271569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":17,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":17,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:37:12.825 INFO:tasks.ceph.ceph_manager.ceph:PG 1.5 is not active+clean 2026-02-17T00:37:12.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.5', 'version': "0'0", 'reported_seq': 93, 'reported_epoch': 52, 'state': 'active+undersized', 'last_fresh': '2026-02-17T00:37:09.538474+0000', 'last_change': '2026-02-17T00:37:09.538349+0000', 'last_active': '2026-02-17T00:37:09.538474+0000', 'last_peered': '2026-02-17T00:37:09.538474+0000', 'last_clean': '2026-02-17T00:37:07.989888+0000', 'last_became_active': '2026-02-17T00:37:09.538349+0000', 'last_became_peered': '2026-02-17T00:37:09.538349+0000', 'last_unstale': '2026-02-17T00:37:09.538474+0000', 'last_undegraded': '2026-02-17T00:37:09.538474+0000', 'last_fullsized': '2026-02-17T00:37:09.538072+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 43, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'last_clean_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-18T05:21:17.728256+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.000260332, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9], 'acting': [9], 'avail_no_missing': ['9'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2026-02-17T00:37:12.825 INFO:tasks.ceph.ceph_manager.ceph:PG 1.4 is not active+clean 2026-02-17T00:37:12.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.4', 'version': "0'0", 'reported_seq': 54, 'reported_epoch': 52, 'state': 'active+undersized', 'last_fresh': '2026-02-17T00:37:09.538515+0000', 'last_change': '2026-02-17T00:37:09.538393+0000', 'last_active': '2026-02-17T00:37:09.538515+0000', 'last_peered': '2026-02-17T00:37:09.538515+0000', 'last_clean': '2026-02-17T00:36:00.429301+0000', 'last_became_active': '2026-02-17T00:37:09.538393+0000', 'last_became_peered': '2026-02-17T00:37:09.538393+0000', 'last_unstale': '2026-02-17T00:37:09.538515+0000', 'last_undegraded': '2026-02-17T00:37:09.538515+0000', 'last_fullsized': '2026-02-17T00:37:09.538132+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 45, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'last_clean_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-18T08:32:50.102318+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6], 'acting': [6], 'avail_no_missing': ['6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2026-02-17T00:37:12.825 INFO:tasks.ceph.ceph_manager.ceph:PG 1.3 is not active+clean 2026-02-17T00:37:12.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.3', 'version': "17'1", 'reported_seq': 88, 'reported_epoch': 52, 'state': 'active+undersized+degraded', 'last_fresh': '2026-02-17T00:37:09.539166+0000', 'last_change': '2026-02-17T00:37:09.539057+0000', 'last_active': '2026-02-17T00:37:09.539166+0000', 'last_peered': '2026-02-17T00:37:09.539166+0000', 'last_clean': '2026-02-17T00:37:07.989853+0000', 'last_became_active': '2026-02-17T00:37:09.539057+0000', 'last_became_peered': '2026-02-17T00:37:09.539057+0000', 'last_unstale': '2026-02-17T00:37:09.539166+0000', 'last_undegraded': '2026-02-17T00:37:09.538822+0000', 'last_fullsized': '2026-02-17T00:37:09.538778+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 45, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'last_clean_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'objects_scrubbed': 0, 'log_size': 1, 'log_dups_size': 0, 'ondisk_log_size': 1, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-18T08:06:59.333199+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 2, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 1, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3], 'acting': [3], 'avail_no_missing': ['3'], 'object_location_counts': [{'shards': '3', 'objects': 1}], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2026-02-17T00:37:12.825 INFO:tasks.ceph.ceph_manager.ceph:PG 1.2 is not active+clean 2026-02-17T00:37:12.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.2', 'version': "19'2", 'reported_seq': 83, 'reported_epoch': 52, 'state': 'active+undersized+degraded', 'last_fresh': '2026-02-17T00:37:09.538544+0000', 'last_change': '2026-02-17T00:37:09.538399+0000', 'last_active': '2026-02-17T00:37:09.538544+0000', 'last_peered': '2026-02-17T00:37:09.538544+0000', 'last_clean': '2026-02-17T00:37:07.989821+0000', 'last_became_active': '2026-02-17T00:37:09.538399+0000', 'last_became_peered': '2026-02-17T00:37:09.538399+0000', 'last_unstale': '2026-02-17T00:37:09.538544+0000', 'last_undegraded': '2026-02-17T00:37:09.538153+0000', 'last_fullsized': '2026-02-17T00:37:09.538110+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 45, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'last_clean_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'objects_scrubbed': 0, 'log_size': 2, 'log_dups_size': 0, 'ondisk_log_size': 2, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-18T09:29:28.137077+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.000798166, 'stat_sum': {'num_bytes': 19, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 2, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 2, 'num_write_kb': 2, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 1, 'num_bytes_recovered': 19, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4], 'acting': [4], 'avail_no_missing': ['4'], 'object_location_counts': [{'shards': '4', 'objects': 1}], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2026-02-17T00:37:12.826 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2026-02-17T00:37:13.015 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:13.015 INFO:teuthology.orchestra.run.trial124.stdout:{"fsid":"f197ec5f-226a-4c0a-a1e0-350b07c62afb","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noout flag(s) set","count":5},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2/4 objects degraded (50.000%), 2 pgs degraded","count":2},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":83,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":55,"num_osds":10,"num_up_osds":10,"osd_up_since":1771288631,"num_in_osds":10,"osd_in_since":1771288551,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":4},{"state_name":"active+undersized+degraded","count":2},{"state_name":"active+undersized","count":2}],"num_pgs":8,"num_pools":1,"num_objects":2,"data_bytes":19,"bytes_used":281952256,"bytes_avail":1073459871744,"bytes_total":1073741824000,"degraded_objects":2,"degraded_total":4,"degraded_ratio":0.5},"fsmap":{"epoch":1,"btime":"2026-02-17T00:35:49:408131+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs"],"services":{}},"servicemap":{"epoch":4,"modified":"2026-02-17T00:36:57.594174+0000","services":{}},"progress_events":{}} 2026-02-17T00:37:13.028 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-17T00:37:13.029 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T00:37:13.194 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:13.194 INFO:teuthology.orchestra.run.trial124.stderr:dumped all 2026-02-17T00:37:13.206 INFO:teuthology.orchestra.run.trial124.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2026-02-17T00:37:12.543520+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275344,"kb_used_data":5744,"kb_used_omap":224,"kb_used_meta":269215,"kb_avail":1048300656,"statfs":{"total":1073741824000,"available":1073459871744,"internally_reserved":0,"allocated":5881856,"data_stored":2777856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":229893,"internal_metadata":275676667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.008641"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":71,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.538738+0000","last_change":"2026-02-17T00:37:02.526015+0000","last_active":"2026-02-17T00:37:09.538738+0000","last_peered":"2026-02-17T00:37:09.538738+0000","last_clean":"2026-02-17T00:37:09.538738+0000","last_became_active":"2026-02-17T00:37:02.525791+0000","last_became_peered":"2026-02-17T00:37:02.525791+0000","last_unstale":"2026-02-17T00:37:09.538738+0000","last_undegraded":"2026-02-17T00:37:09.538738+0000","last_fullsized":"2026-02-17T00:37:09.538738+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:46.165399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032515099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":94,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.538120+0000","last_change":"2026-02-17T00:37:02.525951+0000","last_active":"2026-02-17T00:37:09.538120+0000","last_peered":"2026-02-17T00:37:09.538120+0000","last_clean":"2026-02-17T00:37:09.538120+0000","last_became_active":"2026-02-17T00:37:02.525745+0000","last_became_peered":"2026-02-17T00:37:02.525745+0000","last_unstale":"2026-02-17T00:37:09.538120+0000","last_undegraded":"2026-02-17T00:37:09.538120+0000","last_fullsized":"2026-02-17T00:37:09.538120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:16:51.675193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028708100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":52,"state":"active+undersized","last_fresh":"2026-02-17T00:37:09.538474+0000","last_change":"2026-02-17T00:37:09.538349+0000","last_active":"2026-02-17T00:37:09.538474+0000","last_peered":"2026-02-17T00:37:09.538474+0000","last_clean":"2026-02-17T00:37:07.989888+0000","last_became_active":"2026-02-17T00:37:09.538349+0000","last_became_peered":"2026-02-17T00:37:09.538349+0000","last_unstale":"2026-02-17T00:37:09.538474+0000","last_undegraded":"2026-02-17T00:37:09.538474+0000","last_fullsized":"2026-02-17T00:37:09.538072+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:21:17.728256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000260332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":52,"state":"active+undersized","last_fresh":"2026-02-17T00:37:09.538515+0000","last_change":"2026-02-17T00:37:09.538393+0000","last_active":"2026-02-17T00:37:09.538515+0000","last_peered":"2026-02-17T00:37:09.538515+0000","last_clean":"2026-02-17T00:36:00.429301+0000","last_became_active":"2026-02-17T00:37:09.538393+0000","last_became_peered":"2026-02-17T00:37:09.538393+0000","last_unstale":"2026-02-17T00:37:09.538515+0000","last_undegraded":"2026-02-17T00:37:09.538515+0000","last_fullsized":"2026-02-17T00:37:09.538132+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:32:50.102318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":88,"reported_epoch":52,"state":"active+undersized+degraded","last_fresh":"2026-02-17T00:37:09.539166+0000","last_change":"2026-02-17T00:37:09.539057+0000","last_active":"2026-02-17T00:37:09.539166+0000","last_peered":"2026-02-17T00:37:09.539166+0000","last_clean":"2026-02-17T00:37:07.989853+0000","last_became_active":"2026-02-17T00:37:09.539057+0000","last_became_peered":"2026-02-17T00:37:09.539057+0000","last_unstale":"2026-02-17T00:37:09.539166+0000","last_undegraded":"2026-02-17T00:37:09.538822+0000","last_fullsized":"2026-02-17T00:37:09.538778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:06:59.333199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":1}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":83,"reported_epoch":52,"state":"active+undersized+degraded","last_fresh":"2026-02-17T00:37:09.538544+0000","last_change":"2026-02-17T00:37:09.538399+0000","last_active":"2026-02-17T00:37:09.538544+0000","last_peered":"2026-02-17T00:37:09.538544+0000","last_clean":"2026-02-17T00:37:07.989821+0000","last_became_active":"2026-02-17T00:37:09.538399+0000","last_became_peered":"2026-02-17T00:37:09.538399+0000","last_unstale":"2026-02-17T00:37:09.538544+0000","last_undegraded":"2026-02-17T00:37:09.538153+0000","last_fullsized":"2026-02-17T00:37:09.538110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T09:29:28.137077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000798166,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":1}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.701366+0000","last_change":"2026-02-17T00:37:01.790450+0000","last_active":"2026-02-17T00:37:09.701366+0000","last_peered":"2026-02-17T00:37:09.701366+0000","last_clean":"2026-02-17T00:37:09.701366+0000","last_became_active":"2026-02-17T00:37:01.790253+0000","last_became_peered":"2026-02-17T00:37:01.790253+0000","last_unstale":"2026-02-17T00:37:09.701366+0000","last_undegraded":"2026-02-17T00:37:09.701366+0000","last_fullsized":"2026-02-17T00:37:09.701366+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:37:58.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029884300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T00:37:09.538039+0000","last_change":"2026-02-17T00:37:02.525244+0000","last_active":"2026-02-17T00:37:09.538039+0000","last_peered":"2026-02-17T00:37:09.538039+0000","last_clean":"2026-02-17T00:37:09.538039+0000","last_became_active":"2026-02-17T00:37:02.525057+0000","last_became_peered":"2026-02-17T00:37:02.525057+0000","last_unstale":"2026-02-17T00:37:09.538039+0000","last_undegraded":"2026-02-17T00:37:09.538039+0000","last_fullsized":"2026-02-17T00:37:09.538039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:58:40.824463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":36,"seq":154618822674,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20586,"internal_metadata":27570070},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":42,"seq":180388626450,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27524,"kb_used_data":564,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":104830076,"statfs":{"total":107374182400,"available":107345997824,"internally_reserved":0,"allocated":577536,"data_stored":271569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15373,"internal_metadata":27575283},"hb_peers":[2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593745,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19274,"internal_metadata":27571382},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626450,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27741,"internal_metadata":27562915},"hb_peers":[2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":23,"kb_used_meta":26920,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24486,"internal_metadata":27566170},"hb_peers":[2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561042,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25138,"internal_metadata":27565518},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":42,"seq":180388626449,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26438,"internal_metadata":27564218},"hb_peers":[2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626449,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27524,"kb_used_data":564,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830076,"statfs":{"total":107374182400,"available":107345997824,"internally_reserved":0,"allocated":577536,"data_stored":271569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25789,"internal_metadata":27564867},"hb_peers":[3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":0,"seq":17,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27540,"kb_used_data":580,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830060,"statfs":{"total":107374182400,"available":107345981440,"internally_reserved":0,"allocated":593920,"data_stored":279354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":17,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:37:16.208 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T00:37:16.367 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:16.368 INFO:teuthology.orchestra.run.trial124.stderr:dumped all 2026-02-17T00:37:16.377 INFO:teuthology.orchestra.run.trial124.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2026-02-17T00:37:15.596005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275692,"kb_used_data":6092,"kb_used_omap":239,"kb_used_meta":269200,"kb_avail":1048300308,"statfs":{"total":1073741824000,"available":1073459515392,"internally_reserved":0,"allocated":6238208,"data_stored":3007354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244866,"internal_metadata":275661694},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000658"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.545380+0000","last_change":"2026-02-17T00:37:02.526015+0000","last_active":"2026-02-17T00:37:12.545380+0000","last_peered":"2026-02-17T00:37:12.545380+0000","last_clean":"2026-02-17T00:37:12.545380+0000","last_became_active":"2026-02-17T00:37:02.525791+0000","last_became_peered":"2026-02-17T00:37:02.525791+0000","last_unstale":"2026-02-17T00:37:12.545380+0000","last_undegraded":"2026-02-17T00:37:12.545380+0000","last_fullsized":"2026-02-17T00:37:12.545380+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:46.165399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032515099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.751413+0000","last_change":"2026-02-17T00:37:02.525951+0000","last_active":"2026-02-17T00:37:12.751413+0000","last_peered":"2026-02-17T00:37:12.751413+0000","last_clean":"2026-02-17T00:37:12.751413+0000","last_became_active":"2026-02-17T00:37:02.525745+0000","last_became_peered":"2026-02-17T00:37:02.525745+0000","last_unstale":"2026-02-17T00:37:12.751413+0000","last_undegraded":"2026-02-17T00:37:12.751413+0000","last_fullsized":"2026-02-17T00:37:12.751413+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:16:51.675193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028708100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":52,"state":"active+undersized","last_fresh":"2026-02-17T00:37:09.538474+0000","last_change":"2026-02-17T00:37:09.538349+0000","last_active":"2026-02-17T00:37:09.538474+0000","last_peered":"2026-02-17T00:37:09.538474+0000","last_clean":"2026-02-17T00:37:07.989888+0000","last_became_active":"2026-02-17T00:37:09.538349+0000","last_became_peered":"2026-02-17T00:37:09.538349+0000","last_unstale":"2026-02-17T00:37:09.538474+0000","last_undegraded":"2026-02-17T00:37:09.538474+0000","last_fullsized":"2026-02-17T00:37:09.538072+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:21:17.728256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000260332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.752231+0000","last_change":"2026-02-17T00:37:12.752168+0000","last_active":"2026-02-17T00:37:12.752231+0000","last_peered":"2026-02-17T00:37:12.752231+0000","last_clean":"2026-02-17T00:37:12.752231+0000","last_became_active":"2026-02-17T00:37:12.751989+0000","last_became_peered":"2026-02-17T00:37:12.751989+0000","last_unstale":"2026-02-17T00:37:12.752231+0000","last_undegraded":"2026-02-17T00:37:12.752231+0000","last_fullsized":"2026-02-17T00:37:12.752231+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T00:50:37.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":99,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.546319+0000","last_change":"2026-02-17T00:37:12.546241+0000","last_active":"2026-02-17T00:37:12.546319+0000","last_peered":"2026-02-17T00:37:12.546319+0000","last_clean":"2026-02-17T00:37:12.546319+0000","last_became_active":"2026-02-17T00:37:12.546088+0000","last_became_peered":"2026-02-17T00:37:12.546088+0000","last_unstale":"2026-02-17T00:37:12.546319+0000","last_undegraded":"2026-02-17T00:37:12.546319+0000","last_fullsized":"2026-02-17T00:37:12.546319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T04:53:21.495787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.546311+0000","last_change":"2026-02-17T00:37:12.546261+0000","last_active":"2026-02-17T00:37:12.546311+0000","last_peered":"2026-02-17T00:37:12.546311+0000","last_clean":"2026-02-17T00:37:12.546311+0000","last_became_active":"2026-02-17T00:37:12.546110+0000","last_became_peered":"2026-02-17T00:37:12.546110+0000","last_unstale":"2026-02-17T00:37:12.546311+0000","last_undegraded":"2026-02-17T00:37:12.546311+0000","last_fullsized":"2026-02-17T00:37:12.546311+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:01:17.351303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000798166,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.689568+0000","last_change":"2026-02-17T00:37:01.790450+0000","last_active":"2026-02-17T00:37:12.689568+0000","last_peered":"2026-02-17T00:37:12.689568+0000","last_clean":"2026-02-17T00:37:12.689568+0000","last_became_active":"2026-02-17T00:37:01.790253+0000","last_became_peered":"2026-02-17T00:37:01.790253+0000","last_unstale":"2026-02-17T00:37:12.689568+0000","last_undegraded":"2026-02-17T00:37:12.689568+0000","last_fullsized":"2026-02-17T00:37:12.689568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:37:58.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029884300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":80,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:13.190199+0000","last_change":"2026-02-17T00:37:02.525244+0000","last_active":"2026-02-17T00:37:13.190199+0000","last_peered":"2026-02-17T00:37:13.190199+0000","last_clean":"2026-02-17T00:37:13.190199+0000","last_became_active":"2026-02-17T00:37:02.525057+0000","last_became_peered":"2026-02-17T00:37:02.525057+0000","last_unstale":"2026-02-17T00:37:13.190199+0000","last_undegraded":"2026-02-17T00:37:13.190199+0000","last_fullsized":"2026-02-17T00:37:13.190199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:58:40.824463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":36,"seq":154618822674,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20586,"internal_metadata":27570070},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":42,"seq":180388626451,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15373,"internal_metadata":27575283},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593746,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19274,"internal_metadata":27571382},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626451,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29694,"internal_metadata":27560962},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":42,"seq":180388626450,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27740,"internal_metadata":27562916},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626450,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":54,"seq":231928234002,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":54,"seq":231928234002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:37:16.378 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T00:37:16.532 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:16.532 INFO:teuthology.orchestra.run.trial124.stderr:dumped all 2026-02-17T00:37:16.544 INFO:teuthology.orchestra.run.trial124.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2026-02-17T00:37:15.596005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275692,"kb_used_data":6092,"kb_used_omap":239,"kb_used_meta":269200,"kb_avail":1048300308,"statfs":{"total":1073741824000,"available":1073459515392,"internally_reserved":0,"allocated":6238208,"data_stored":3007354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244866,"internal_metadata":275661694},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000658"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.545380+0000","last_change":"2026-02-17T00:37:02.526015+0000","last_active":"2026-02-17T00:37:12.545380+0000","last_peered":"2026-02-17T00:37:12.545380+0000","last_clean":"2026-02-17T00:37:12.545380+0000","last_became_active":"2026-02-17T00:37:02.525791+0000","last_became_peered":"2026-02-17T00:37:02.525791+0000","last_unstale":"2026-02-17T00:37:12.545380+0000","last_undegraded":"2026-02-17T00:37:12.545380+0000","last_fullsized":"2026-02-17T00:37:12.545380+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:46.165399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032515099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.751413+0000","last_change":"2026-02-17T00:37:02.525951+0000","last_active":"2026-02-17T00:37:12.751413+0000","last_peered":"2026-02-17T00:37:12.751413+0000","last_clean":"2026-02-17T00:37:12.751413+0000","last_became_active":"2026-02-17T00:37:02.525745+0000","last_became_peered":"2026-02-17T00:37:02.525745+0000","last_unstale":"2026-02-17T00:37:12.751413+0000","last_undegraded":"2026-02-17T00:37:12.751413+0000","last_fullsized":"2026-02-17T00:37:12.751413+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:16:51.675193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028708100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":52,"state":"active+undersized","last_fresh":"2026-02-17T00:37:09.538474+0000","last_change":"2026-02-17T00:37:09.538349+0000","last_active":"2026-02-17T00:37:09.538474+0000","last_peered":"2026-02-17T00:37:09.538474+0000","last_clean":"2026-02-17T00:37:07.989888+0000","last_became_active":"2026-02-17T00:37:09.538349+0000","last_became_peered":"2026-02-17T00:37:09.538349+0000","last_unstale":"2026-02-17T00:37:09.538474+0000","last_undegraded":"2026-02-17T00:37:09.538474+0000","last_fullsized":"2026-02-17T00:37:09.538072+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:21:17.728256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000260332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.752231+0000","last_change":"2026-02-17T00:37:12.752168+0000","last_active":"2026-02-17T00:37:12.752231+0000","last_peered":"2026-02-17T00:37:12.752231+0000","last_clean":"2026-02-17T00:37:12.752231+0000","last_became_active":"2026-02-17T00:37:12.751989+0000","last_became_peered":"2026-02-17T00:37:12.751989+0000","last_unstale":"2026-02-17T00:37:12.752231+0000","last_undegraded":"2026-02-17T00:37:12.752231+0000","last_fullsized":"2026-02-17T00:37:12.752231+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T00:50:37.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":99,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.546319+0000","last_change":"2026-02-17T00:37:12.546241+0000","last_active":"2026-02-17T00:37:12.546319+0000","last_peered":"2026-02-17T00:37:12.546319+0000","last_clean":"2026-02-17T00:37:12.546319+0000","last_became_active":"2026-02-17T00:37:12.546088+0000","last_became_peered":"2026-02-17T00:37:12.546088+0000","last_unstale":"2026-02-17T00:37:12.546319+0000","last_undegraded":"2026-02-17T00:37:12.546319+0000","last_fullsized":"2026-02-17T00:37:12.546319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T04:53:21.495787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.546311+0000","last_change":"2026-02-17T00:37:12.546261+0000","last_active":"2026-02-17T00:37:12.546311+0000","last_peered":"2026-02-17T00:37:12.546311+0000","last_clean":"2026-02-17T00:37:12.546311+0000","last_became_active":"2026-02-17T00:37:12.546110+0000","last_became_peered":"2026-02-17T00:37:12.546110+0000","last_unstale":"2026-02-17T00:37:12.546311+0000","last_undegraded":"2026-02-17T00:37:12.546311+0000","last_fullsized":"2026-02-17T00:37:12.546311+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:01:17.351303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000798166,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.689568+0000","last_change":"2026-02-17T00:37:01.790450+0000","last_active":"2026-02-17T00:37:12.689568+0000","last_peered":"2026-02-17T00:37:12.689568+0000","last_clean":"2026-02-17T00:37:12.689568+0000","last_became_active":"2026-02-17T00:37:01.790253+0000","last_became_peered":"2026-02-17T00:37:01.790253+0000","last_unstale":"2026-02-17T00:37:12.689568+0000","last_undegraded":"2026-02-17T00:37:12.689568+0000","last_fullsized":"2026-02-17T00:37:12.689568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:37:58.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029884300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":80,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:13.190199+0000","last_change":"2026-02-17T00:37:02.525244+0000","last_active":"2026-02-17T00:37:13.190199+0000","last_peered":"2026-02-17T00:37:13.190199+0000","last_clean":"2026-02-17T00:37:13.190199+0000","last_became_active":"2026-02-17T00:37:02.525057+0000","last_became_peered":"2026-02-17T00:37:02.525057+0000","last_unstale":"2026-02-17T00:37:13.190199+0000","last_undegraded":"2026-02-17T00:37:13.190199+0000","last_fullsized":"2026-02-17T00:37:13.190199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:58:40.824463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":36,"seq":154618822674,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20586,"internal_metadata":27570070},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":42,"seq":180388626451,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15373,"internal_metadata":27575283},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593746,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19274,"internal_metadata":27571382},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626451,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29694,"internal_metadata":27560962},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":42,"seq":180388626450,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27740,"internal_metadata":27562916},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626450,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":54,"seq":231928234002,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":54,"seq":231928234002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:37:16.544 INFO:tasks.ceph.ceph_manager.ceph:PG 1.5 is not active+clean 2026-02-17T00:37:16.544 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '1.5', 'version': "0'0", 'reported_seq': 93, 'reported_epoch': 52, 'state': 'active+undersized', 'last_fresh': '2026-02-17T00:37:09.538474+0000', 'last_change': '2026-02-17T00:37:09.538349+0000', 'last_active': '2026-02-17T00:37:09.538474+0000', 'last_peered': '2026-02-17T00:37:09.538474+0000', 'last_clean': '2026-02-17T00:37:07.989888+0000', 'last_became_active': '2026-02-17T00:37:09.538349+0000', 'last_became_peered': '2026-02-17T00:37:09.538349+0000', 'last_unstale': '2026-02-17T00:37:09.538474+0000', 'last_undegraded': '2026-02-17T00:37:09.538474+0000', 'last_fullsized': '2026-02-17T00:37:09.538072+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 43, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'last_clean_scrub_stamp': '2026-02-17T00:36:00.429301+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2026-02-18T05:21:17.728256+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0.000260332, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9], 'acting': [9], 'avail_no_missing': ['9'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2026-02-17T00:37:16.545 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2026-02-17T00:37:16.741 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:16.741 INFO:teuthology.orchestra.run.trial124.stdout:{"fsid":"f197ec5f-226a-4c0a-a1e0-350b07c62afb","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noout flag(s) set","count":5},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":87,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":55,"num_osds":10,"num_up_osds":10,"osd_up_since":1771288631,"num_in_osds":10,"osd_in_since":1771288551,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":7},{"state_name":"active+undersized","count":1}],"num_pgs":8,"num_pools":1,"num_objects":2,"data_bytes":19,"bytes_used":282308608,"bytes_avail":1073459515392,"bytes_total":1073741824000},"fsmap":{"epoch":1,"btime":"2026-02-17T00:35:49:408131+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs"],"services":{}},"servicemap":{"epoch":4,"modified":"2026-02-17T00:36:57.594174+0000","services":{}},"progress_events":{}} 2026-02-17T00:37:16.752 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-17T00:37:16.752 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T00:37:16.915 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:16.915 INFO:teuthology.orchestra.run.trial124.stderr:dumped all 2026-02-17T00:37:16.928 INFO:teuthology.orchestra.run.trial124.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2026-02-17T00:37:15.596005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275692,"kb_used_data":6092,"kb_used_omap":239,"kb_used_meta":269200,"kb_avail":1048300308,"statfs":{"total":1073741824000,"available":1073459515392,"internally_reserved":0,"allocated":6238208,"data_stored":3007354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244866,"internal_metadata":275661694},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000658"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.545380+0000","last_change":"2026-02-17T00:37:02.526015+0000","last_active":"2026-02-17T00:37:12.545380+0000","last_peered":"2026-02-17T00:37:12.545380+0000","last_clean":"2026-02-17T00:37:12.545380+0000","last_became_active":"2026-02-17T00:37:02.525791+0000","last_became_peered":"2026-02-17T00:37:02.525791+0000","last_unstale":"2026-02-17T00:37:12.545380+0000","last_undegraded":"2026-02-17T00:37:12.545380+0000","last_fullsized":"2026-02-17T00:37:12.545380+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:46.165399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032515099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.751413+0000","last_change":"2026-02-17T00:37:02.525951+0000","last_active":"2026-02-17T00:37:12.751413+0000","last_peered":"2026-02-17T00:37:12.751413+0000","last_clean":"2026-02-17T00:37:12.751413+0000","last_became_active":"2026-02-17T00:37:02.525745+0000","last_became_peered":"2026-02-17T00:37:02.525745+0000","last_unstale":"2026-02-17T00:37:12.751413+0000","last_undegraded":"2026-02-17T00:37:12.751413+0000","last_fullsized":"2026-02-17T00:37:12.751413+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:16:51.675193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028708100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":93,"reported_epoch":52,"state":"active+undersized","last_fresh":"2026-02-17T00:37:09.538474+0000","last_change":"2026-02-17T00:37:09.538349+0000","last_active":"2026-02-17T00:37:09.538474+0000","last_peered":"2026-02-17T00:37:09.538474+0000","last_clean":"2026-02-17T00:37:07.989888+0000","last_became_active":"2026-02-17T00:37:09.538349+0000","last_became_peered":"2026-02-17T00:37:09.538349+0000","last_unstale":"2026-02-17T00:37:09.538474+0000","last_undegraded":"2026-02-17T00:37:09.538474+0000","last_fullsized":"2026-02-17T00:37:09.538072+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:21:17.728256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000260332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9],"acting":[9],"avail_no_missing":["9"],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.752231+0000","last_change":"2026-02-17T00:37:12.752168+0000","last_active":"2026-02-17T00:37:12.752231+0000","last_peered":"2026-02-17T00:37:12.752231+0000","last_clean":"2026-02-17T00:37:12.752231+0000","last_became_active":"2026-02-17T00:37:12.751989+0000","last_became_peered":"2026-02-17T00:37:12.751989+0000","last_unstale":"2026-02-17T00:37:12.752231+0000","last_undegraded":"2026-02-17T00:37:12.752231+0000","last_fullsized":"2026-02-17T00:37:12.752231+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T00:50:37.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":99,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.546319+0000","last_change":"2026-02-17T00:37:12.546241+0000","last_active":"2026-02-17T00:37:12.546319+0000","last_peered":"2026-02-17T00:37:12.546319+0000","last_clean":"2026-02-17T00:37:12.546319+0000","last_became_active":"2026-02-17T00:37:12.546088+0000","last_became_peered":"2026-02-17T00:37:12.546088+0000","last_unstale":"2026-02-17T00:37:12.546319+0000","last_undegraded":"2026-02-17T00:37:12.546319+0000","last_fullsized":"2026-02-17T00:37:12.546319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T04:53:21.495787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.546311+0000","last_change":"2026-02-17T00:37:12.546261+0000","last_active":"2026-02-17T00:37:12.546311+0000","last_peered":"2026-02-17T00:37:12.546311+0000","last_clean":"2026-02-17T00:37:12.546311+0000","last_became_active":"2026-02-17T00:37:12.546110+0000","last_became_peered":"2026-02-17T00:37:12.546110+0000","last_unstale":"2026-02-17T00:37:12.546311+0000","last_undegraded":"2026-02-17T00:37:12.546311+0000","last_fullsized":"2026-02-17T00:37:12.546311+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:01:17.351303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000798166,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.689568+0000","last_change":"2026-02-17T00:37:01.790450+0000","last_active":"2026-02-17T00:37:12.689568+0000","last_peered":"2026-02-17T00:37:12.689568+0000","last_clean":"2026-02-17T00:37:12.689568+0000","last_became_active":"2026-02-17T00:37:01.790253+0000","last_became_peered":"2026-02-17T00:37:01.790253+0000","last_unstale":"2026-02-17T00:37:12.689568+0000","last_undegraded":"2026-02-17T00:37:12.689568+0000","last_fullsized":"2026-02-17T00:37:12.689568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:37:58.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029884300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":80,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:13.190199+0000","last_change":"2026-02-17T00:37:02.525244+0000","last_active":"2026-02-17T00:37:13.190199+0000","last_peered":"2026-02-17T00:37:13.190199+0000","last_clean":"2026-02-17T00:37:13.190199+0000","last_became_active":"2026-02-17T00:37:02.525057+0000","last_became_peered":"2026-02-17T00:37:02.525057+0000","last_unstale":"2026-02-17T00:37:13.190199+0000","last_undegraded":"2026-02-17T00:37:13.190199+0000","last_fullsized":"2026-02-17T00:37:13.190199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:58:40.824463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":15,"acting":15,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":36,"seq":154618822674,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27536,"kb_used_data":576,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":104830064,"statfs":{"total":107374182400,"available":107345985536,"internally_reserved":0,"allocated":589824,"data_stored":279335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20586,"internal_metadata":27570070},"hb_peers":[2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":42,"seq":180388626451,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15373,"internal_metadata":27575283},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593746,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19274,"internal_metadata":27571382},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626451,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29694,"internal_metadata":27560962},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":42,"seq":180388626450,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27740,"internal_metadata":27562916},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626450,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":54,"seq":231928234002,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":54,"seq":231928234002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:37:19.929 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T00:37:20.091 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:20.092 INFO:teuthology.orchestra.run.trial124.stderr:dumped all 2026-02-17T00:37:20.102 INFO:teuthology.orchestra.run.trial124.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2026-02-17T00:37:19.596452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275728,"kb_used_data":6128,"kb_used_omap":239,"kb_used_meta":269200,"kb_avail":1048300272,"statfs":{"total":1073741824000,"available":1073459478528,"internally_reserved":0,"allocated":6275072,"data_stored":3031128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244866,"internal_metadata":275661694},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.056224"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.545380+0000","last_change":"2026-02-17T00:37:02.526015+0000","last_active":"2026-02-17T00:37:12.545380+0000","last_peered":"2026-02-17T00:37:12.545380+0000","last_clean":"2026-02-17T00:37:12.545380+0000","last_became_active":"2026-02-17T00:37:02.525791+0000","last_became_peered":"2026-02-17T00:37:02.525791+0000","last_unstale":"2026-02-17T00:37:12.545380+0000","last_undegraded":"2026-02-17T00:37:12.545380+0000","last_fullsized":"2026-02-17T00:37:12.545380+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:46.165399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032515099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.751413+0000","last_change":"2026-02-17T00:37:02.525951+0000","last_active":"2026-02-17T00:37:12.751413+0000","last_peered":"2026-02-17T00:37:12.751413+0000","last_clean":"2026-02-17T00:37:12.751413+0000","last_became_active":"2026-02-17T00:37:02.525745+0000","last_became_peered":"2026-02-17T00:37:02.525745+0000","last_unstale":"2026-02-17T00:37:12.751413+0000","last_undegraded":"2026-02-17T00:37:12.751413+0000","last_fullsized":"2026-02-17T00:37:12.751413+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:16:51.675193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028708100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":104,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:13.191020+0000","last_change":"2026-02-17T00:37:13.190948+0000","last_active":"2026-02-17T00:37:13.191020+0000","last_peered":"2026-02-17T00:37:13.191020+0000","last_clean":"2026-02-17T00:37:13.191020+0000","last_became_active":"2026-02-17T00:37:13.190791+0000","last_became_peered":"2026-02-17T00:37:13.190791+0000","last_unstale":"2026-02-17T00:37:13.191020+0000","last_undegraded":"2026-02-17T00:37:13.191020+0000","last_fullsized":"2026-02-17T00:37:13.191020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:10:06.626656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000260332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.752231+0000","last_change":"2026-02-17T00:37:12.752168+0000","last_active":"2026-02-17T00:37:12.752231+0000","last_peered":"2026-02-17T00:37:12.752231+0000","last_clean":"2026-02-17T00:37:12.752231+0000","last_became_active":"2026-02-17T00:37:12.751989+0000","last_became_peered":"2026-02-17T00:37:12.751989+0000","last_unstale":"2026-02-17T00:37:12.752231+0000","last_undegraded":"2026-02-17T00:37:12.752231+0000","last_fullsized":"2026-02-17T00:37:12.752231+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T00:50:37.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":99,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.546319+0000","last_change":"2026-02-17T00:37:12.546241+0000","last_active":"2026-02-17T00:37:12.546319+0000","last_peered":"2026-02-17T00:37:12.546319+0000","last_clean":"2026-02-17T00:37:12.546319+0000","last_became_active":"2026-02-17T00:37:12.546088+0000","last_became_peered":"2026-02-17T00:37:12.546088+0000","last_unstale":"2026-02-17T00:37:12.546319+0000","last_undegraded":"2026-02-17T00:37:12.546319+0000","last_fullsized":"2026-02-17T00:37:12.546319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T04:53:21.495787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.546311+0000","last_change":"2026-02-17T00:37:12.546261+0000","last_active":"2026-02-17T00:37:12.546311+0000","last_peered":"2026-02-17T00:37:12.546311+0000","last_clean":"2026-02-17T00:37:12.546311+0000","last_became_active":"2026-02-17T00:37:12.546110+0000","last_became_peered":"2026-02-17T00:37:12.546110+0000","last_unstale":"2026-02-17T00:37:12.546311+0000","last_undegraded":"2026-02-17T00:37:12.546311+0000","last_fullsized":"2026-02-17T00:37:12.546311+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:01:17.351303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000798166,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.689568+0000","last_change":"2026-02-17T00:37:01.790450+0000","last_active":"2026-02-17T00:37:12.689568+0000","last_peered":"2026-02-17T00:37:12.689568+0000","last_clean":"2026-02-17T00:37:12.689568+0000","last_became_active":"2026-02-17T00:37:01.790253+0000","last_became_peered":"2026-02-17T00:37:01.790253+0000","last_unstale":"2026-02-17T00:37:12.689568+0000","last_undegraded":"2026-02-17T00:37:12.689568+0000","last_fullsized":"2026-02-17T00:37:12.689568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:37:58.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029884300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":80,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:13.190199+0000","last_change":"2026-02-17T00:37:02.525244+0000","last_active":"2026-02-17T00:37:13.190199+0000","last_peered":"2026-02-17T00:37:13.190199+0000","last_clean":"2026-02-17T00:37:13.190199+0000","last_became_active":"2026-02-17T00:37:02.525057+0000","last_became_peered":"2026-02-17T00:37:02.525057+0000","last_unstale":"2026-02-17T00:37:13.190199+0000","last_undegraded":"2026-02-17T00:37:13.190199+0000","last_fullsized":"2026-02-17T00:37:13.190199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:58:40.824463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":36,"seq":154618822675,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20586,"internal_metadata":27570070},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":42,"seq":180388626451,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15373,"internal_metadata":27575283},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593746,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19274,"internal_metadata":27571382},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626451,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29694,"internal_metadata":27560962},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":42,"seq":180388626450,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27740,"internal_metadata":27562916},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626450,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":54,"seq":231928234002,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":54,"seq":231928234002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:37:20.103 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T00:37:20.103 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T00:37:20.258 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:20.258 INFO:teuthology.orchestra.run.trial124.stderr:dumped all 2026-02-17T00:37:20.268 INFO:teuthology.orchestra.run.trial124.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2026-02-17T00:37:19.596452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275728,"kb_used_data":6128,"kb_used_omap":239,"kb_used_meta":269200,"kb_avail":1048300272,"statfs":{"total":1073741824000,"available":1073459478528,"internally_reserved":0,"allocated":6275072,"data_stored":3031128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244866,"internal_metadata":275661694},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.056224"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.545380+0000","last_change":"2026-02-17T00:37:02.526015+0000","last_active":"2026-02-17T00:37:12.545380+0000","last_peered":"2026-02-17T00:37:12.545380+0000","last_clean":"2026-02-17T00:37:12.545380+0000","last_became_active":"2026-02-17T00:37:02.525791+0000","last_became_peered":"2026-02-17T00:37:02.525791+0000","last_unstale":"2026-02-17T00:37:12.545380+0000","last_undegraded":"2026-02-17T00:37:12.545380+0000","last_fullsized":"2026-02-17T00:37:12.545380+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:46.165399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032515099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.751413+0000","last_change":"2026-02-17T00:37:02.525951+0000","last_active":"2026-02-17T00:37:12.751413+0000","last_peered":"2026-02-17T00:37:12.751413+0000","last_clean":"2026-02-17T00:37:12.751413+0000","last_became_active":"2026-02-17T00:37:02.525745+0000","last_became_peered":"2026-02-17T00:37:02.525745+0000","last_unstale":"2026-02-17T00:37:12.751413+0000","last_undegraded":"2026-02-17T00:37:12.751413+0000","last_fullsized":"2026-02-17T00:37:12.751413+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:16:51.675193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028708100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":104,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:13.191020+0000","last_change":"2026-02-17T00:37:13.190948+0000","last_active":"2026-02-17T00:37:13.191020+0000","last_peered":"2026-02-17T00:37:13.191020+0000","last_clean":"2026-02-17T00:37:13.191020+0000","last_became_active":"2026-02-17T00:37:13.190791+0000","last_became_peered":"2026-02-17T00:37:13.190791+0000","last_unstale":"2026-02-17T00:37:13.191020+0000","last_undegraded":"2026-02-17T00:37:13.191020+0000","last_fullsized":"2026-02-17T00:37:13.191020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:10:06.626656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000260332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.752231+0000","last_change":"2026-02-17T00:37:12.752168+0000","last_active":"2026-02-17T00:37:12.752231+0000","last_peered":"2026-02-17T00:37:12.752231+0000","last_clean":"2026-02-17T00:37:12.752231+0000","last_became_active":"2026-02-17T00:37:12.751989+0000","last_became_peered":"2026-02-17T00:37:12.751989+0000","last_unstale":"2026-02-17T00:37:12.752231+0000","last_undegraded":"2026-02-17T00:37:12.752231+0000","last_fullsized":"2026-02-17T00:37:12.752231+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T00:50:37.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":99,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.546319+0000","last_change":"2026-02-17T00:37:12.546241+0000","last_active":"2026-02-17T00:37:12.546319+0000","last_peered":"2026-02-17T00:37:12.546319+0000","last_clean":"2026-02-17T00:37:12.546319+0000","last_became_active":"2026-02-17T00:37:12.546088+0000","last_became_peered":"2026-02-17T00:37:12.546088+0000","last_unstale":"2026-02-17T00:37:12.546319+0000","last_undegraded":"2026-02-17T00:37:12.546319+0000","last_fullsized":"2026-02-17T00:37:12.546319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T04:53:21.495787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.546311+0000","last_change":"2026-02-17T00:37:12.546261+0000","last_active":"2026-02-17T00:37:12.546311+0000","last_peered":"2026-02-17T00:37:12.546311+0000","last_clean":"2026-02-17T00:37:12.546311+0000","last_became_active":"2026-02-17T00:37:12.546110+0000","last_became_peered":"2026-02-17T00:37:12.546110+0000","last_unstale":"2026-02-17T00:37:12.546311+0000","last_undegraded":"2026-02-17T00:37:12.546311+0000","last_fullsized":"2026-02-17T00:37:12.546311+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:01:17.351303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000798166,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.689568+0000","last_change":"2026-02-17T00:37:01.790450+0000","last_active":"2026-02-17T00:37:12.689568+0000","last_peered":"2026-02-17T00:37:12.689568+0000","last_clean":"2026-02-17T00:37:12.689568+0000","last_became_active":"2026-02-17T00:37:01.790253+0000","last_became_peered":"2026-02-17T00:37:01.790253+0000","last_unstale":"2026-02-17T00:37:12.689568+0000","last_undegraded":"2026-02-17T00:37:12.689568+0000","last_fullsized":"2026-02-17T00:37:12.689568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:37:58.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029884300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":80,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:13.190199+0000","last_change":"2026-02-17T00:37:02.525244+0000","last_active":"2026-02-17T00:37:13.190199+0000","last_peered":"2026-02-17T00:37:13.190199+0000","last_clean":"2026-02-17T00:37:13.190199+0000","last_became_active":"2026-02-17T00:37:02.525057+0000","last_became_peered":"2026-02-17T00:37:02.525057+0000","last_unstale":"2026-02-17T00:37:13.190199+0000","last_undegraded":"2026-02-17T00:37:13.190199+0000","last_fullsized":"2026-02-17T00:37:13.190199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:58:40.824463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":36,"seq":154618822675,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20586,"internal_metadata":27570070},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":42,"seq":180388626451,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15373,"internal_metadata":27575283},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593746,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19274,"internal_metadata":27571382},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626451,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29694,"internal_metadata":27560962},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":42,"seq":180388626450,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27740,"internal_metadata":27562916},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626450,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":54,"seq":231928234002,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":54,"seq":231928234002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:37:20.270 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T00:37:20.434 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:20.434 INFO:teuthology.orchestra.run.trial124.stdout:{"epoch":55,"fsid":"f197ec5f-226a-4c0a-a1e0-350b07c62afb","created":"2026-02-17T00:35:49.408352+0000","modified":"2026-02-17T00:37:12.541364+0000","last_up_change":"2026-02-17T00:37:11.539183+0000","last_in_change":"2026-02-17T00:35:51.250518+0000","flags":"noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800064,"flags_set":["noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":10,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T00:35:59.803458+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":0.80000001192092896,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1.0000001192092896,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92f5e876-06b7-432d-a823-9d17528babae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":53,"up_from":54,"up_thru":33,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6826","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6827","nonce":2275529749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6810","nonce":2278529749},{"type":"v1","addr":"10.20.193.124:6868","nonce":2278529749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6832","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6833","nonce":2275529749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6830","nonce":2275529749},{"type":"v1","addr":"10.20.193.124:6831","nonce":2275529749}]},"public_addr":"10.20.193.124:6827/2275529749","cluster_addr":"10.20.193.124:6868/2278529749","heartbeat_back_addr":"10.20.193.124:6833/2275529749","heartbeat_front_addr":"10.20.193.124:6831/2275529749","state":["exists","up"]},{"osd":1,"uuid":"a4f08285-6e02-4daf-ab7b-dccfbfde038e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":53,"up_from":54,"up_thru":54,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6834","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6835","nonce":1827517214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6844","nonce":1830517214},{"type":"v1","addr":"10.20.193.124:6845","nonce":1830517214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6840","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6841","nonce":1827517214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6838","nonce":1827517214},{"type":"v1","addr":"10.20.193.124:6839","nonce":1827517214}]},"public_addr":"10.20.193.124:6835/1827517214","cluster_addr":"10.20.193.124:6845/1830517214","heartbeat_back_addr":"10.20.193.124:6841/1827517214","heartbeat_front_addr":"10.20.193.124:6839/1827517214","state":["exists","up"]},{"osd":2,"uuid":"90375a99-4b6c-4fae-b94c-9f4b71cdb262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":41,"up_from":42,"up_thru":0,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6802","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6805","nonce":2907939377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6852","nonce":2908939377},{"type":"v1","addr":"10.20.193.124:6853","nonce":2908939377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6820","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6823","nonce":2907939377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6814","nonce":2907939377},{"type":"v1","addr":"10.20.193.124:6817","nonce":2907939377}]},"public_addr":"10.20.193.124:6805/2907939377","cluster_addr":"10.20.193.124:6853/2908939377","heartbeat_back_addr":"10.20.193.124:6823/2907939377","heartbeat_front_addr":"10.20.193.124:6817/2907939377","state":["exists","up"]},{"osd":3,"uuid":"524f3b52-cf39-4421-9542-6f573e3008b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":41,"up_from":42,"up_thru":54,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6803","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6806","nonce":3904026978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6808","nonce":3905026978},{"type":"v1","addr":"10.20.193.124:6811","nonce":3905026978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6819","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6821","nonce":3904026978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6815","nonce":3904026978},{"type":"v1","addr":"10.20.193.124:6816","nonce":3904026978}]},"public_addr":"10.20.193.124:6806/3904026978","cluster_addr":"10.20.193.124:6811/3905026978","heartbeat_back_addr":"10.20.193.124:6821/3904026978","heartbeat_front_addr":"10.20.193.124:6816/3904026978","state":["exists","up"]},{"osd":4,"uuid":"a8687dcc-5b7c-48f9-a282-d58a26195f7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":43,"up_from":44,"up_thru":54,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6804","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6807","nonce":786547060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6828","nonce":787547060},{"type":"v1","addr":"10.20.193.124:6869","nonce":787547060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6824","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6825","nonce":786547060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6818","nonce":786547060},{"type":"v1","addr":"10.20.193.124:6822","nonce":786547060}]},"public_addr":"10.20.193.124:6807/786547060","cluster_addr":"10.20.193.124:6869/787547060","heartbeat_back_addr":"10.20.193.124:6825/786547060","heartbeat_front_addr":"10.20.193.124:6822/786547060","state":["exists","up"]},{"osd":5,"uuid":"921cfb10-f16c-4ed3-a69c-95c58816c1c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":43,"up_from":44,"up_thru":44,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6866","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6867","nonce":1783893241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6813","nonce":1784893241},{"type":"v1","addr":"10.20.193.124:6829","nonce":1784893241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6872","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6873","nonce":1783893241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6870","nonce":1783893241},{"type":"v1","addr":"10.20.193.124:6871","nonce":1783893241}]},"public_addr":"10.20.193.124:6867/1783893241","cluster_addr":"10.20.193.124:6829/1784893241","heartbeat_back_addr":"10.20.193.124:6873/1783893241","heartbeat_front_addr":"10.20.193.124:6871/1783893241","state":["exists","up"]},{"osd":6,"uuid":"69312bec-4a05-4b6d-bf26-e25d5dd67449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":41,"up_from":42,"up_thru":51,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6855","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6857","nonce":957442686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6836","nonce":958442686},{"type":"v1","addr":"10.20.193.124:6837","nonce":958442686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6864","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6865","nonce":957442686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6862","nonce":957442686},{"type":"v1","addr":"10.20.193.124:6863","nonce":957442686}]},"public_addr":"10.20.193.124:6857/957442686","cluster_addr":"10.20.193.124:6837/958442686","heartbeat_back_addr":"10.20.193.124:6865/957442686","heartbeat_front_addr":"10.20.193.124:6863/957442686","state":["exists","up"]},{"osd":7,"uuid":"4af8fd69-8238-494a-b710-e4eefb7abf63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":42,"up_from":43,"up_thru":43,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6842","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6843","nonce":951373869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6882","nonce":952373869},{"type":"v1","addr":"10.20.193.124:6883","nonce":952373869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6848","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6849","nonce":951373869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6846","nonce":951373869},{"type":"v1","addr":"10.20.193.124:6847","nonce":951373869}]},"public_addr":"10.20.193.124:6843/951373869","cluster_addr":"10.20.193.124:6883/952373869","heartbeat_back_addr":"10.20.193.124:6849/951373869","heartbeat_front_addr":"10.20.193.124:6847/951373869","state":["exists","up"]},{"osd":8,"uuid":"cb7ac6aa-c85e-436a-b78e-edc15c84d83f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":41,"up_from":42,"up_thru":16,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6874","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6875","nonce":2712194498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6809","nonce":2714194498},{"type":"v1","addr":"10.20.193.124:6812","nonce":2714194498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6880","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6881","nonce":2712194498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6878","nonce":2712194498},{"type":"v1","addr":"10.20.193.124:6879","nonce":2712194498}]},"public_addr":"10.20.193.124:6875/2712194498","cluster_addr":"10.20.193.124:6812/2714194498","heartbeat_back_addr":"10.20.193.124:6881/2712194498","heartbeat_front_addr":"10.20.193.124:6879/2712194498","state":["exists","up"]},{"osd":9,"uuid":"f26cc0f5-ab7a-42da-9b9f-2f8845df5d2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":35,"up_from":36,"up_thru":54,"down_at":33,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6850","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6851","nonce":132817667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6876","nonce":133817667},{"type":"v1","addr":"10.20.193.124:6877","nonce":133817667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6858","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6860","nonce":132817667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.124:6854","nonce":132817667},{"type":"v1","addr":"10.20.193.124:6856","nonce":132817667}]},"public_addr":"10.20.193.124:6851/132817667","cluster_addr":"10.20.193.124:6877/133817667","heartbeat_back_addr":"10.20.193.124:6860/132817667","heartbeat_front_addr":"10.20.193.124:6856/132817667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2026-02-17T00:37:08.532718+0000","laggy_probability":0.65700000524520874,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:35:53.650584+0000","dead_epoch":51},{"osd":1,"down_stamp":"2026-02-17T00:37:08.532718+0000","laggy_probability":0.65700000524520874,"laggy_interval":1,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:35:53.650559+0000","dead_epoch":51},{"osd":2,"down_stamp":"2026-02-17T00:36:56.505567+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:35:53.577001+0000","dead_epoch":39},{"osd":3,"down_stamp":"2026-02-17T00:36:56.505567+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:35:53.566136+0000","dead_epoch":39},{"osd":4,"down_stamp":"2026-02-17T00:36:56.505567+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:35:53.554689+0000","dead_epoch":41},{"osd":5,"down_stamp":"2026-02-17T00:36:56.505567+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:35:53.663567+0000","dead_epoch":41},{"osd":6,"down_stamp":"2026-02-17T00:36:56.505567+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:35:53.542886+0000","dead_epoch":39},{"osd":7,"down_stamp":"2026-02-17T00:36:56.505567+0000","laggy_probability":0.30000001192092896,"laggy_interval":1,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:35:53.606069+0000","dead_epoch":42},{"osd":8,"down_stamp":"2026-02-17T00:36:56.505567+0000","laggy_probability":0.50999999046325684,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:35:53.600635+0000","dead_epoch":39},{"osd":9,"down_stamp":"2026-02-17T00:36:49.491836+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T00:35:53.600647+0000","dead_epoch":34}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T00:37:21.446 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T00:37:21.447 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T00:37:21.534 INFO:teuthology.orchestra.run.trial124.stdout:{ 2026-02-17T00:37:21.534 INFO:teuthology.orchestra.run.trial124.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T00:37:21.534 INFO:teuthology.orchestra.run.trial124.stdout:} 2026-02-17T00:37:21.545 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T00:37:21.698 INFO:teuthology.orchestra.run.trial124.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T00:37:21.710 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T00:37:21.711 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T00:37:21.795 INFO:teuthology.orchestra.run.trial124.stdout:{ 2026-02-17T00:37:21.795 INFO:teuthology.orchestra.run.trial124.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T00:37:21.795 INFO:teuthology.orchestra.run.trial124.stdout:} 2026-02-17T00:37:21.804 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T00:37:21.960 INFO:teuthology.orchestra.run.trial124.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T00:37:21.971 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T00:37:21.971 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T00:37:22.054 INFO:teuthology.orchestra.run.trial124.stdout:{ 2026-02-17T00:37:22.055 INFO:teuthology.orchestra.run.trial124.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T00:37:22.055 INFO:teuthology.orchestra.run.trial124.stdout:} 2026-02-17T00:37:22.064 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T00:37:22.227 INFO:teuthology.orchestra.run.trial124.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T00:37:22.241 INFO:tasks.ceph:Scrubbing osd.3 2026-02-17T00:37:22.241 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-17T00:37:22.317 INFO:teuthology.orchestra.run.trial124.stdout:{ 2026-02-17T00:37:22.317 INFO:teuthology.orchestra.run.trial124.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T00:37:22.317 INFO:teuthology.orchestra.run.trial124.stdout:} 2026-02-17T00:37:22.327 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-17T00:37:22.488 INFO:teuthology.orchestra.run.trial124.stderr:instructed osd(s) 3 to deep-scrub 2026-02-17T00:37:22.500 INFO:tasks.ceph:Scrubbing osd.4 2026-02-17T00:37:22.500 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-17T00:37:22.583 INFO:teuthology.orchestra.run.trial124.stdout:{ 2026-02-17T00:37:22.584 INFO:teuthology.orchestra.run.trial124.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T00:37:22.584 INFO:teuthology.orchestra.run.trial124.stdout:} 2026-02-17T00:37:22.595 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-17T00:37:22.760 INFO:teuthology.orchestra.run.trial124.stderr:instructed osd(s) 4 to deep-scrub 2026-02-17T00:37:22.772 INFO:tasks.ceph:Scrubbing osd.5 2026-02-17T00:37:22.772 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-17T00:37:22.849 INFO:teuthology.orchestra.run.trial124.stdout:{ 2026-02-17T00:37:22.849 INFO:teuthology.orchestra.run.trial124.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T00:37:22.849 INFO:teuthology.orchestra.run.trial124.stdout:} 2026-02-17T00:37:22.858 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-17T00:37:23.014 INFO:teuthology.orchestra.run.trial124.stderr:instructed osd(s) 5 to deep-scrub 2026-02-17T00:37:23.025 INFO:tasks.ceph:Scrubbing osd.6 2026-02-17T00:37:23.026 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-17T00:37:23.103 INFO:teuthology.orchestra.run.trial124.stdout:{ 2026-02-17T00:37:23.104 INFO:teuthology.orchestra.run.trial124.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T00:37:23.104 INFO:teuthology.orchestra.run.trial124.stdout:} 2026-02-17T00:37:23.113 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-17T00:37:23.269 INFO:teuthology.orchestra.run.trial124.stderr:instructed osd(s) 6 to deep-scrub 2026-02-17T00:37:23.281 INFO:tasks.ceph:Scrubbing osd.7 2026-02-17T00:37:23.281 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-17T00:37:23.366 INFO:teuthology.orchestra.run.trial124.stdout:{ 2026-02-17T00:37:23.366 INFO:teuthology.orchestra.run.trial124.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T00:37:23.366 INFO:teuthology.orchestra.run.trial124.stdout:} 2026-02-17T00:37:23.378 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-17T00:37:23.540 INFO:teuthology.orchestra.run.trial124.stderr:instructed osd(s) 7 to deep-scrub 2026-02-17T00:37:23.551 INFO:tasks.ceph:Scrubbing osd.8 2026-02-17T00:37:23.551 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-17T00:37:23.633 INFO:teuthology.orchestra.run.trial124.stdout:{ 2026-02-17T00:37:23.633 INFO:teuthology.orchestra.run.trial124.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T00:37:23.633 INFO:teuthology.orchestra.run.trial124.stdout:} 2026-02-17T00:37:23.642 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-17T00:37:23.793 INFO:teuthology.orchestra.run.trial124.stderr:instructed osd(s) 8 to deep-scrub 2026-02-17T00:37:23.804 INFO:tasks.ceph:Scrubbing osd.9 2026-02-17T00:37:23.804 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-17T00:37:23.880 INFO:teuthology.orchestra.run.trial124.stdout:{ 2026-02-17T00:37:23.881 INFO:teuthology.orchestra.run.trial124.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T00:37:23.881 INFO:teuthology.orchestra.run.trial124.stdout:} 2026-02-17T00:37:23.890 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-17T00:37:24.053 INFO:teuthology.orchestra.run.trial124.stderr:instructed osd(s) 9 to deep-scrub 2026-02-17T00:37:24.064 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T00:37:24.226 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:24.226 INFO:teuthology.orchestra.run.trial124.stderr:dumped all 2026-02-17T00:37:24.236 INFO:teuthology.orchestra.run.trial124.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2026-02-17T00:37:23.596892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275728,"kb_used_data":6128,"kb_used_omap":239,"kb_used_meta":269200,"kb_avail":1048300272,"statfs":{"total":1073741824000,"available":1073459478528,"internally_reserved":0,"allocated":6275072,"data_stored":3031128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244866,"internal_metadata":275661694},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.053371"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.545380+0000","last_change":"2026-02-17T00:37:02.526015+0000","last_active":"2026-02-17T00:37:12.545380+0000","last_peered":"2026-02-17T00:37:12.545380+0000","last_clean":"2026-02-17T00:37:12.545380+0000","last_became_active":"2026-02-17T00:37:02.525791+0000","last_became_peered":"2026-02-17T00:37:02.525791+0000","last_unstale":"2026-02-17T00:37:12.545380+0000","last_undegraded":"2026-02-17T00:37:12.545380+0000","last_fullsized":"2026-02-17T00:37:12.545380+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:01:46.165399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032515099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.751413+0000","last_change":"2026-02-17T00:37:02.525951+0000","last_active":"2026-02-17T00:37:12.751413+0000","last_peered":"2026-02-17T00:37:12.751413+0000","last_clean":"2026-02-17T00:37:12.751413+0000","last_became_active":"2026-02-17T00:37:02.525745+0000","last_became_peered":"2026-02-17T00:37:02.525745+0000","last_unstale":"2026-02-17T00:37:12.751413+0000","last_undegraded":"2026-02-17T00:37:12.751413+0000","last_fullsized":"2026-02-17T00:37:12.751413+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:16:51.675193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028708100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":104,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:13.191020+0000","last_change":"2026-02-17T00:37:13.190948+0000","last_active":"2026-02-17T00:37:13.191020+0000","last_peered":"2026-02-17T00:37:13.191020+0000","last_clean":"2026-02-17T00:37:13.191020+0000","last_became_active":"2026-02-17T00:37:13.190791+0000","last_became_peered":"2026-02-17T00:37:13.190791+0000","last_unstale":"2026-02-17T00:37:13.191020+0000","last_undegraded":"2026-02-17T00:37:13.191020+0000","last_fullsized":"2026-02-17T00:37:13.191020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:10:06.626656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000260332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.752231+0000","last_change":"2026-02-17T00:37:12.752168+0000","last_active":"2026-02-17T00:37:12.752231+0000","last_peered":"2026-02-17T00:37:12.752231+0000","last_clean":"2026-02-17T00:37:12.752231+0000","last_became_active":"2026-02-17T00:37:12.751989+0000","last_became_peered":"2026-02-17T00:37:12.751989+0000","last_unstale":"2026-02-17T00:37:12.752231+0000","last_undegraded":"2026-02-17T00:37:12.752231+0000","last_fullsized":"2026-02-17T00:37:12.752231+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T00:50:37.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"17'1","reported_seq":99,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.546319+0000","last_change":"2026-02-17T00:37:12.546241+0000","last_active":"2026-02-17T00:37:12.546319+0000","last_peered":"2026-02-17T00:37:12.546319+0000","last_clean":"2026-02-17T00:37:12.546319+0000","last_became_active":"2026-02-17T00:37:12.546088+0000","last_became_peered":"2026-02-17T00:37:12.546088+0000","last_unstale":"2026-02-17T00:37:12.546319+0000","last_undegraded":"2026-02-17T00:37:12.546319+0000","last_fullsized":"2026-02-17T00:37:12.546319+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T04:53:21.495787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"19'2","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.546311+0000","last_change":"2026-02-17T00:37:12.546261+0000","last_active":"2026-02-17T00:37:12.546311+0000","last_peered":"2026-02-17T00:37:12.546311+0000","last_clean":"2026-02-17T00:37:12.546311+0000","last_became_active":"2026-02-17T00:37:12.546110+0000","last_became_peered":"2026-02-17T00:37:12.546110+0000","last_unstale":"2026-02-17T00:37:12.546311+0000","last_undegraded":"2026-02-17T00:37:12.546311+0000","last_fullsized":"2026-02-17T00:37:12.546311+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:01:17.351303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000798166,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:12.689568+0000","last_change":"2026-02-17T00:37:01.790450+0000","last_active":"2026-02-17T00:37:12.689568+0000","last_peered":"2026-02-17T00:37:12.689568+0000","last_clean":"2026-02-17T00:37:12.689568+0000","last_became_active":"2026-02-17T00:37:01.790253+0000","last_became_peered":"2026-02-17T00:37:01.790253+0000","last_unstale":"2026-02-17T00:37:12.689568+0000","last_undegraded":"2026-02-17T00:37:12.689568+0000","last_fullsized":"2026-02-17T00:37:12.689568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T05:37:58.625503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029884300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":80,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:13.190199+0000","last_change":"2026-02-17T00:37:02.525244+0000","last_active":"2026-02-17T00:37:13.190199+0000","last_peered":"2026-02-17T00:37:13.190199+0000","last_clean":"2026-02-17T00:37:13.190199+0000","last_became_active":"2026-02-17T00:37:02.525057+0000","last_became_peered":"2026-02-17T00:37:02.525057+0000","last_unstale":"2026-02-17T00:37:13.190199+0000","last_undegraded":"2026-02-17T00:37:13.190199+0000","last_fullsized":"2026-02-17T00:37:13.190199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:36:00.429301+0000","last_clean_scrub_stamp":"2026-02-17T00:36:00.429301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T03:58:40.824463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":36,"seq":154618822676,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20586,"internal_metadata":27570070},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":42,"seq":180388626452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15373,"internal_metadata":27575283},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593747,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19274,"internal_metadata":27571382},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626452,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29694,"internal_metadata":27560962},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561044,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":42,"seq":180388626451,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27740,"internal_metadata":27562916},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626451,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":54,"seq":231928234003,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":54,"seq":231928234003,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:37:24.240 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-17T00:36:00.429301+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=37, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T00:37:24.240 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-17T00:36:00.429301+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=37, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T00:37:24.240 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-17T00:36:00.429301+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=37, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T00:37:24.240 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-17T00:36:00.429301+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=37, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T00:37:24.240 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-17T00:36:00.429301+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=37, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T00:37:24.240 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-17T00:36:00.429301+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=37, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T00:37:24.241 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-17T00:36:00.429301+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=37, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T00:37:24.241 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T00:36:00.429301+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=0, tm_min=37, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T00:37:24.241 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T00:37:44.242 DEBUG:teuthology.orchestra.run.trial124:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T00:37:44.396 INFO:teuthology.orchestra.run.trial124.stdout: 2026-02-17T00:37:44.397 INFO:teuthology.orchestra.run.trial124.stderr:dumped all 2026-02-17T00:37:44.408 INFO:teuthology.orchestra.run.trial124.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2026-02-17T00:37:43.598858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":10,"num_per_pool_osds":10,"num_per_pool_omap_osds":8,"kb":1048576000,"kb_used":275728,"kb_used_data":6128,"kb_used_omap":239,"kb_used_meta":269200,"kb_avail":1048300272,"statfs":{"total":1073741824000,"available":1073459478528,"internally_reserved":0,"allocated":6275072,"data_stored":3031128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":244866,"internal_metadata":275661694},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001184"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":84,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:23.717356+0000","last_change":"2026-02-17T00:37:23.717356+0000","last_active":"2026-02-17T00:37:23.717356+0000","last_peered":"2026-02-17T00:37:23.717356+0000","last_clean":"2026-02-17T00:37:23.717356+0000","last_became_active":"2026-02-17T00:37:02.525791+0000","last_became_peered":"2026-02-17T00:37:02.525791+0000","last_unstale":"2026-02-17T00:37:23.717356+0000","last_undegraded":"2026-02-17T00:37:23.717356+0000","last_fullsized":"2026-02-17T00:37:23.717356+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:37:23.717303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:37:23.717303+0000","last_clean_scrub_stamp":"2026-02-17T00:37:23.717303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T02:03:06.305063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032515099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":108,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:23.717711+0000","last_change":"2026-02-17T00:37:23.717711+0000","last_active":"2026-02-17T00:37:23.717711+0000","last_peered":"2026-02-17T00:37:23.717711+0000","last_clean":"2026-02-17T00:37:23.717711+0000","last_became_active":"2026-02-17T00:37:02.525745+0000","last_became_peered":"2026-02-17T00:37:02.525745+0000","last_unstale":"2026-02-17T00:37:23.717711+0000","last_undegraded":"2026-02-17T00:37:23.717711+0000","last_fullsized":"2026-02-17T00:37:23.717711+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:37:23.717685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:37:23.717685+0000","last_clean_scrub_stamp":"2026-02-17T00:37:23.717685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:06:51.093876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028708100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":112,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:24.493565+0000","last_change":"2026-02-17T00:37:24.493565+0000","last_active":"2026-02-17T00:37:24.493565+0000","last_peered":"2026-02-17T00:37:24.493565+0000","last_clean":"2026-02-17T00:37:24.493565+0000","last_became_active":"2026-02-17T00:37:13.190791+0000","last_became_peered":"2026-02-17T00:37:13.190791+0000","last_unstale":"2026-02-17T00:37:24.493565+0000","last_undegraded":"2026-02-17T00:37:24.493565+0000","last_fullsized":"2026-02-17T00:37:24.493565+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:37:24.493524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:37:24.493524+0000","last_clean_scrub_stamp":"2026-02-17T00:37:24.493524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T07:54:45.846715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000260332,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":85,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:22.438027+0000","last_change":"2026-02-17T00:37:22.438027+0000","last_active":"2026-02-17T00:37:22.438027+0000","last_peered":"2026-02-17T00:37:22.438027+0000","last_clean":"2026-02-17T00:37:22.438027+0000","last_became_active":"2026-02-17T00:37:12.751989+0000","last_became_peered":"2026-02-17T00:37:12.751989+0000","last_unstale":"2026-02-17T00:37:22.438027+0000","last_undegraded":"2026-02-17T00:37:22.438027+0000","last_fullsized":"2026-02-17T00:37:22.438027+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:37:22.437969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:37:22.437969+0000","last_clean_scrub_stamp":"2026-02-17T00:37:22.437969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:44:12.577933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"55'2","reported_seq":108,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:22.696414+0000","last_change":"2026-02-17T00:37:22.696414+0000","last_active":"2026-02-17T00:37:22.696414+0000","last_peered":"2026-02-17T00:37:22.696414+0000","last_clean":"2026-02-17T00:37:22.696414+0000","last_became_active":"2026-02-17T00:37:12.546088+0000","last_became_peered":"2026-02-17T00:37:12.546088+0000","last_unstale":"2026-02-17T00:37:22.696414+0000","last_undegraded":"2026-02-17T00:37:22.696414+0000","last_fullsized":"2026-02-17T00:37:22.696414+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'2","last_scrub_stamp":"2026-02-17T00:37:22.696367+0000","last_deep_scrub":"55'2","last_deep_scrub_stamp":"2026-02-17T00:37:22.696367+0000","last_clean_scrub_stamp":"2026-02-17T00:37:22.696367+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:10:16.625745+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"55'3","reported_seq":104,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:23.329965+0000","last_change":"2026-02-17T00:37:23.329965+0000","last_active":"2026-02-17T00:37:23.329965+0000","last_peered":"2026-02-17T00:37:23.329965+0000","last_clean":"2026-02-17T00:37:23.329965+0000","last_became_active":"2026-02-17T00:37:12.546110+0000","last_became_peered":"2026-02-17T00:37:12.546110+0000","last_unstale":"2026-02-17T00:37:23.329965+0000","last_undegraded":"2026-02-17T00:37:23.329965+0000","last_fullsized":"2026-02-17T00:37:23.329965+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'3","last_scrub_stamp":"2026-02-17T00:37:23.329928+0000","last_deep_scrub":"55'3","last_deep_scrub_stamp":"2026-02-17T00:37:23.329928+0000","last_clean_scrub_stamp":"2026-02-17T00:37:23.329928+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T06:53:41.714432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000798166,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:24.371424+0000","last_change":"2026-02-17T00:37:24.371424+0000","last_active":"2026-02-17T00:37:24.371424+0000","last_peered":"2026-02-17T00:37:24.371424+0000","last_clean":"2026-02-17T00:37:24.371424+0000","last_became_active":"2026-02-17T00:37:01.790253+0000","last_became_peered":"2026-02-17T00:37:01.790253+0000","last_unstale":"2026-02-17T00:37:24.371424+0000","last_undegraded":"2026-02-17T00:37:24.371424+0000","last_fullsized":"2026-02-17T00:37:24.371424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:37:24.371380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:37:24.371380+0000","last_clean_scrub_stamp":"2026-02-17T00:37:24.371380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:51:21.721660+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.00029884300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":55,"state":"active+clean","last_fresh":"2026-02-17T00:37:23.972153+0000","last_change":"2026-02-17T00:37:23.972153+0000","last_active":"2026-02-17T00:37:23.972153+0000","last_peered":"2026-02-17T00:37:23.972153+0000","last_clean":"2026-02-17T00:37:23.972153+0000","last_became_active":"2026-02-17T00:37:02.525057+0000","last_became_peered":"2026-02-17T00:37:02.525057+0000","last_unstale":"2026-02-17T00:37:23.972153+0000","last_undegraded":"2026-02-17T00:37:23.972153+0000","last_fullsized":"2026-02-17T00:37:23.972153+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T00:37:23.972112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T00:37:23.972112+0000","last_clean_scrub_stamp":"2026-02-17T00:37:23.972112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T08:39:33.581896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":9}],"osd_stats":[{"osd":9,"up_from":36,"seq":154618822680,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20586,"internal_metadata":27570070},"hb_peers":[0,1,2,3,4,5,6,7,8],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":42,"seq":180388626456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":15,"kb_used_meta":26928,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15373,"internal_metadata":27575283},"hb_peers":[0,1,2,3,4,5,6,7,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":43,"seq":184683593751,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":18,"kb_used_meta":26925,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19274,"internal_metadata":27571382},"hb_peers":[0,1,2,3,4,5,6,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29694,"internal_metadata":27560962},"hb_peers":[0,1,2,3,4,5,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":44,"seq":188978561047,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25788,"internal_metadata":27564868},"hb_peers":[0,1,2,3,4,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":44,"seq":188978561048,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27091,"internal_metadata":27563565},"hb_peers":[0,1,2,3,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":42,"seq":180388626455,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27740,"internal_metadata":27562916},"hb_peers":[0,1,2,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":42,"seq":180388626455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[0,1,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":54,"seq":231928234007,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27576,"kb_used_data":616,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":104830024,"statfs":{"total":107374182400,"available":107345944576,"internally_reserved":0,"allocated":630784,"data_stored":303128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22534,"internal_metadata":27568122},"hb_peers":[0,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":54,"seq":231928234007,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27572,"kb_used_data":612,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":104830028,"statfs":{"total":107374182400,"available":107345948672,"internally_reserved":0,"allocated":626688,"data_stored":303109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28393,"internal_metadata":27562263},"hb_peers":[1,2,3,4,5,6,7,8,9],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T00:37:44.409 DEBUG:teuthology.orchestra.run.trial124:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T00:37:44.576 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T00:37:44.576 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T00:37:44.576 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T00:37:44.576 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T00:37:44.655 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T00:37:44.655 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T00:37:44.656 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T00:37:44.752 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T00:37:44.752 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T00:37:44.752 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T00:37:44.831 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T00:37:44.831 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-17T00:37:44.831 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T00:37:49.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-17T00:37:50.932 INFO:tasks.ceph.osd.3:Stopped 2026-02-17T00:37:50.933 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-17T00:37:50.933 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T00:37:51.001 INFO:tasks.ceph.osd.4:Stopped 2026-02-17T00:37:51.001 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-17T00:37:51.001 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T00:37:51.094 INFO:tasks.ceph.osd.5:Stopped 2026-02-17T00:37:51.094 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-17T00:37:51.094 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T00:37:51.170 INFO:tasks.ceph.osd.6:Stopped 2026-02-17T00:37:51.171 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-17T00:37:51.171 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T00:37:51.239 INFO:tasks.ceph.osd.7:Stopped 2026-02-17T00:37:51.239 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-17T00:37:51.240 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T00:37:51.317 INFO:tasks.ceph.osd.8:Stopped 2026-02-17T00:37:51.317 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-17T00:37:51.317 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T00:37:51.398 INFO:tasks.ceph.osd.9:Stopped 2026-02-17T00:37:51.398 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T00:37:51.399 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T00:37:51.399 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T00:37:51.425 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T00:37:51.425 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T00:37:51.426 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T00:37:51.426 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T00:37:51.484 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T00:37:51.484 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T00:37:51.485 DEBUG:teuthology.orchestra.run.trial124:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v 'but it is still running' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2026-02-17T00:37:51.540 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial124.front.sepia.ceph.com 2026-02-17T00:37:51.540 DEBUG:teuthology.orchestra.run.trial124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T00:37:51.598 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial124.front.sepia.ceph.com 2026-02-17T00:37:51.598 DEBUG:teuthology.orchestra.run.trial124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T00:37:51.648 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial124.front.sepia.ceph.com 2026-02-17T00:37:51.649 DEBUG:teuthology.orchestra.run.trial124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T00:37:51.700 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial124.front.sepia.ceph.com 2026-02-17T00:37:51.701 DEBUG:teuthology.orchestra.run.trial124:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-17T00:37:51.752 INFO:tasks.ceph:Archiving mon data... 2026-02-17T00:37:51.754 DEBUG:teuthology.misc:Transferring archived files from trial124:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48611/data/mon.a.tgz 2026-02-17T00:37:51.754 DEBUG:teuthology.orchestra.run.trial124:> mktemp 2026-02-17T00:37:51.797 INFO:teuthology.orchestra.run.trial124.stdout:/tmp/tmp.iQqtkgbuQf 2026-02-17T00:37:51.797 DEBUG:teuthology.orchestra.run.trial124:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.iQqtkgbuQf 2026-02-17T00:37:51.874 DEBUG:teuthology.orchestra.run.trial124:> sudo chmod 0666 /tmp/tmp.iQqtkgbuQf 2026-02-17T00:37:51.972 DEBUG:teuthology.orchestra.remote:trial124:/tmp/tmp.iQqtkgbuQf is 217KB 2026-02-17T00:37:52.027 DEBUG:teuthology.orchestra.run.trial124:> rm -fr /tmp/tmp.iQqtkgbuQf 2026-02-17T00:37:52.031 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T00:37:52.031 DEBUG:teuthology.orchestra.run.trial124:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T00:37:52.126 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T00:37:52.126 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T00:37:52.129 DEBUG:teuthology.misc:Transferring archived files from trial124:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48611/remote/trial124/crash 2026-02-17T00:37:52.130 DEBUG:teuthology.orchestra.run.trial124:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T00:37:52.174 INFO:tasks.ceph:Compressing logs... 2026-02-17T00:37:52.175 DEBUG:teuthology.orchestra.run.trial124:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T00:37:52.227 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26509.log 2026-02-17T00:37:52.233 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25251.log 2026-02-17T00:37:52.233 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19534.log 2026-02-17T00:37:52.233 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26509.log.gz 2026-02-17T00:37:52.233 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25251.log.gz 2026-02-17T00:37:52.233 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25255.log 2026-02-17T00:37:52.233 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.19534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19534.log.gz 2026-02-17T00:37:52.233 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26360.log 2026-02-17T00:37:52.233 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27875.log 2026-02-17T00:37:52.234 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25255.log: /var/log/ceph/ceph-client.admin.26360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26360.log.gz 2026-02-17T00:37:52.234 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25255.log.gz 2026-02-17T00:37:52.234 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26017.log 2026-02-17T00:37:52.234 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25507.log 2026-02-17T00:37:52.234 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27875.log.gz 2026-02-17T00:37:52.234 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27433.log 2026-02-17T00:37:52.234 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26017.log.gz 2026-02-17T00:37:52.234 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26262.log 2026-02-17T00:37:52.234 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25507.log.gz 2026-02-17T00:37:52.234 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24747.log 2026-02-17T00:37:52.234 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27433.log.gz 2026-02-17T00:37:52.234 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27172.log 2026-02-17T00:37:52.235 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26262.log.gz 2026-02-17T00:37:52.235 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24747.log.gz 2026-02-17T00:37:52.235 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27667.log 2026-02-17T00:37:52.235 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27172.log.gz 2026-02-17T00:37:52.235 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27303.log 2026-02-17T00:37:52.235 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25510.log 2026-02-17T00:37:52.235 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27667.log.gz 2026-02-17T00:37:52.235 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27303.log.gz 2026-02-17T00:37:52.235 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27355.log 2026-02-17T00:37:52.235 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25808.log 2026-02-17T00:37:52.235 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25510.log.gz 2026-02-17T00:37:52.235 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27355.log.gz 2026-02-17T00:37:52.235 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24611.log 2026-02-17T00:37:52.236 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25808.log.gz 2026-02-17T00:37:52.236 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25254.log 2026-02-17T00:37:52.266 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26583.log 2026-02-17T00:37:52.266 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24611.log.gz 2026-02-17T00:37:52.266 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25254.log.gz 2026-02-17T00:37:52.266 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27563.log 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26310.log 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26583.log.gz 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27563.log.gz 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24750.log 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27485.log 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26310.log.gz 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24750.log.gz 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26608.log 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27615.log 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27485.log.gz 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26886.log 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26608.log.gz 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27615.log.gz 2026-02-17T00:37:52.267 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25027.log 2026-02-17T00:37:52.268 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-17T00:37:52.268 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26886.log.gz 2026-02-17T00:37:52.268 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25027.log.gz 2026-02-17T00:37:52.268 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27034.log 2026-02-17T00:37:52.268 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27901.log 2026-02-17T00:37:52.268 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27034.log.gz 2026-02-17T00:37:52.268 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24638.log 2026-02-17T00:37:52.268 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25512.log 2026-02-17T00:37:52.268 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27901.log.gz 2026-02-17T00:37:52.268 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25256.log 2026-02-17T00:37:52.268 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24638.log.gz 2026-02-17T00:37:52.268 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26114.log 2026-02-17T00:37:52.268 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25512.log.gz 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25916.log 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25256.log.gz 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25391.log 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26114.log.gz 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25916.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25916.log.gz 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25391.log.gz 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26460.log 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26959.log 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26460.log.gz 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24989.log 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25511.log 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26959.log.gz 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24989.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24989.log.gz 2026-02-17T00:37:52.269 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25511.log.gz 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26410.log 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24737.log 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26410.log.gz 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25632.log 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24737.log.gz 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19655.log 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27849.log 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25632.log.gz 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.19655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27797.log 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19655.log.gz 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27849.log.gz 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.11411.log 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27058.log 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27797.log.gz 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph.tmp-client.admin.11411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24994.log 2026-02-17T00:37:52.270 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.11411.log.gz 2026-02-17T00:37:52.271 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26559.log 2026-02-17T00:37:52.271 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27058.log.gz 2026-02-17T00:37:52.271 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19559.log 2026-02-17T00:37:52.271 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24994.log.gz 2026-02-17T00:37:52.271 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24541.log 2026-02-17T00:37:52.271 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26559.log.gz 2026-02-17T00:37:52.271 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.19559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27407.log 2026-02-17T00:37:52.271 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19559.log.gz 2026-02-17T00:37:52.271 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26910.log 2026-02-17T00:37:52.271 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24541.log.gz 2026-02-17T00:37:52.271 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25392.log 2026-02-17T00:37:52.271 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27407.log.gz 2026-02-17T00:37:52.271 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26910.log.gz 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25392.log.gz 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26041.log 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27198.log 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26041.log.gz 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25390.log 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27979.log 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27198.log.gz 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25390.log.gz 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19607.log 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27979.log.gz 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20396.log 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.19607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19607.log.gz 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25782.log 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.20396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19727.log 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20396.log.gz 2026-02-17T00:37:52.272 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25782.log.gz 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24739.log 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26189.log 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.19727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19727.log.gz 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24739.log.gz 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19510.log 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25630.log 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26189.log: /var/log/ceph/ceph-client.admin.19510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26189.log.gz 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19510.log.gz 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27120.log 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27329.log 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25630.log.gz 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27120.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.27120.log.gz --verbose 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr: -- /var/log/ceph/ceph-client.admin.25236.log 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27329.log.gz 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24745.log 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25236.log.gz 2026-02-17T00:37:52.273 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24664.log 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24751.log 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24745.log.gz 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24664.log.gz 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19783.log 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27719.log 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24751.log.gz 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.19783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19783.log.gz 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27641.log 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24566.log 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27719.log.gz 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27641.log.gz 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26238.log 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24990.log 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24566.log.gz 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26238.log.gz 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25888.log 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26760.log 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24990.log.gz 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25000.log 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25888.log.gz 2026-02-17T00:37:52.274 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26484.log 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26760.log.gz 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25000.log.gz 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27094.log 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26164.log 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26484.log.gz 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27277.log 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27094.log.gz 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26164.log.gz 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25539.log 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24591.log 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27277.log.gz 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25496.log 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25539.log.gz 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24591.log.gz 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27225.log 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25496.log: /var/log/ceph/ceph.audit.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25496.log.gz 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26787.log 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27225.log: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24690.log 2026-02-17T00:37:52.275 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27225.log.gz 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24740.log 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26787.log.gz 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24690.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24690.log.gz 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24986.log 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24740.log.gz 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26813.log 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24986.log.gz 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26861.log 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19418.log 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26813.log: 0.0%/var/log/ceph/ceph-client.admin.26861.log: -- replaced with /var/log/ceph/ceph-client.admin.26813.log.gz 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26861.log.gz 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27009.log 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19631.log 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.19418.log: /var/log/ceph/ceph-client.admin.27009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19418.log.gz 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27009.log.gz 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25992.log 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.19631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19631.log.gz 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25540.log 2026-02-17T00:37:52.276 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25992.log.gz 2026-02-17T00:37:52.277 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26089.log 2026-02-17T00:37:52.277 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25540.log: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T00:37:52.277 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26534.log 2026-02-17T00:37:52.277 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25540.log.gz 2026-02-17T00:37:52.277 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27537.log 2026-02-17T00:37:52.277 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26089.log.gz 2026-02-17T00:37:52.285 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24736.log 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26534.log.gz 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27537.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27537.log.gz -5 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr: --verbose -- /var/log/ceph/ceph-client.admin.27589.log 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24736.log.gz 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27693.log 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27589.log.gz 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-osd.4.log: 92.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26837.log 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25033.log 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27693.log: /var/log/ceph/ceph-client.admin.26837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27693.log.gz 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26837.log.gz 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27823.log 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25033.log.gz 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24995.log 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19703.log 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27823.log.gz 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24995.log.gz 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27146.log 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.19703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24997.log 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19703.log.gz 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26139.log 2026-02-17T00:37:52.286 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27146.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27745.log 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24997.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26139.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26286.log 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26984.log 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27745.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26435.log 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26286.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26286.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26984.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26934.log 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26435.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27511.log 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27955.log 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26934.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19466.log 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27511.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24752.log 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27955.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.19466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27771.log 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19466.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25631.log 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24752.log: 92.5% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24752.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27771.log.gz 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19583.log 2026-02-17T00:37:52.287 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25631.log.gz 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26708.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.19583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19583.log.gz 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27927.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26708.log.gz 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27927.log.gz 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24749.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26213.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.24749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24749.log.gz 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26633.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27459.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26213.log.gz 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26633.log.gz 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26683.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27251.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27459.log.gz 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26683.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.26683.log.gz -- 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr: /var/log/ceph/ceph-client.admin.25940.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.27251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27251.log.gz 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26335.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19352.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25940.log: /var/log/ceph/ceph-client.admin.26335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25940.log.gz 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26335.log.gz 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25035.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.19352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19352.log.gz 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25253.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.19679.log 2026-02-17T00:37:52.288 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25035.log.gz 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25253.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25253.log.gz 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.19679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.19679.log.gz 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26658.log 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26385.log 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27381.log 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26658.log.gz 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26732.log 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26385.log: /var/log/ceph/ceph-client.admin.27381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27381.log.gz 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26385.log.gz 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26065.log 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25284.log 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26732.log.gz 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.26065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25756.log 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26065.log.gz 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25284.log.gz 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr:/var/log/ceph/ceph-client.admin.25756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25756.log.gz 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-17T00:37:52.289 INFO:teuthology.orchestra.run.trial124.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T00:37:52.301 INFO:teuthology.orchestra.run.trial124.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T00:37:52.305 INFO:teuthology.orchestra.run.trial124.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-17T00:37:52.309 INFO:teuthology.orchestra.run.trial124.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T00:37:52.338 INFO:teuthology.orchestra.run.trial124.stderr: 88.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T00:37:52.339 INFO:teuthology.orchestra.run.trial124.stderr: 2026-02-17T00:37:52.339 INFO:teuthology.orchestra.run.trial124.stderr:real 0m0.119s 2026-02-17T00:37:52.339 INFO:teuthology.orchestra.run.trial124.stderr:user 0m0.481s 2026-02-17T00:37:52.339 INFO:teuthology.orchestra.run.trial124.stderr:sys 0m0.068s 2026-02-17T00:37:52.340 INFO:tasks.ceph:Archiving logs... 2026-02-17T00:37:52.341 DEBUG:teuthology.misc:Transferring archived files from trial124:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48611/remote/trial124/log 2026-02-17T00:37:52.342 DEBUG:teuthology.orchestra.run.trial124:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T00:37:52.596 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T00:37:52.619 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T00:37:52.619 DEBUG:teuthology.orchestra.run.trial124:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T00:37:52.711 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T00:37:52.724 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T00:37:52.724 DEBUG:teuthology.orchestra.run.trial124:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T00:37:52.779 INFO:teuthology.orchestra.run.trial124.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T00:37:52.779 INFO:teuthology.orchestra.run.trial124.stdout:============================================================================== 2026-02-17T00:37:52.779 INFO:teuthology.orchestra.run.trial124.stdout: time.cloudflare 10.138.8.13 3 u 63 64 7 3.063 +0.506 0.552 2026-02-17T00:37:52.779 INFO:teuthology.orchestra.run.trial124.stdout: as393746.mci.tr 132.163.97.6 2 u 58 64 7 29.862 +3.019 0.714 2026-02-17T00:37:52.779 INFO:teuthology.orchestra.run.trial124.stdout: 23.186.168.132 132.163.97.4 2 u 57 64 7 88.325 -9.158 8.648 2026-02-17T00:37:52.780 INFO:teuthology.orchestra.run.trial124.stdout: ntp.netlinkify. 214.176.184.39 2 u 61 64 7 13.358 +0.492 0.535 2026-02-17T00:37:52.780 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T00:37:52.792 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T00:37:52.792 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T00:37:52.806 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T00:37:52.820 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T00:37:52.833 INFO:teuthology.task.internal:Duration was 341.263149 seconds 2026-02-17T00:37:52.833 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T00:37:52.849 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T00:37:52.849 DEBUG:teuthology.orchestra.run.trial124:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T00:37:52.872 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T00:37:52.872 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial124.front.sepia.ceph.com 2026-02-17T00:37:52.872 DEBUG:teuthology.orchestra.run.trial124:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T00:37:52.920 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T00:37:52.920 DEBUG:teuthology.orchestra.run.trial124:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T00:37:53.115 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T00:37:53.115 DEBUG:teuthology.orchestra.run.trial124:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T00:37:53.123 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T00:37:53.124 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T00:37:53.124 INFO:teuthology.orchestra.run.trial124.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T00:37:53.124 INFO:teuthology.orchestra.run.trial124.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T00:37:53.124 INFO:teuthology.orchestra.run.trial124.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T00:37:53.171 INFO:teuthology.orchestra.run.trial124.stderr: 81.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T00:37:53.172 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T00:37:53.184 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T00:37:53.184 DEBUG:teuthology.orchestra.run.trial124:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T00:37:53.221 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T00:37:53.233 DEBUG:teuthology.orchestra.run.trial124:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:37:53.269 INFO:teuthology.orchestra.run.trial124.stdout:kernel.core_pattern = core 2026-02-17T00:37:53.279 DEBUG:teuthology.orchestra.run.trial124:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:37:53.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:37:53.326 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T00:37:53.349 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T00:37:53.350 DEBUG:teuthology.misc:Transferring archived files from trial124:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48611/remote/trial124 2026-02-17T00:37:53.351 DEBUG:teuthology.orchestra.run.trial124:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T00:37:53.389 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T00:37:53.390 DEBUG:teuthology.orchestra.run.trial124:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T00:37:53.426 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T00:37:53.444 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T00:37:53.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T00:37:53.460 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T00:37:53.460 DEBUG:teuthology.orchestra.run.trial124:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T00:37:53.470 INFO:teuthology.orchestra.run.trial124.stdout: 1180220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 00:37 /home/ubuntu/cephtest 2026-02-17T00:37:53.471 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T00:37:53.488 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T00:37:53.525 INFO:teuthology.run:Summary data: description: rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} duration: 341.2631485462189 flavor: default owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com success: true 2026-02-17T00:37:53.525 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T00:37:53.654 INFO:teuthology.run:pass