2026-02-17T08:50:59.522 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T08:50:59.536 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:50:59.615 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51202 branch: wip-bharath19-testing-2026-02-13-0903-squid description: rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51202' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-bharath19-testing-2026-02-13-0903-squid ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd debug verify cached snaps: true osd debug verify missing on start: true osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd op queue: debug_random osd op queue cut off: debug_random flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - but it is still running - overall HEALTH_ - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e workunit: branch: wip-bharath19-testing-2026-02-13-0903-squid sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 3603 sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath19-testing-2026-02-13-0903-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e targets: trial025.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGgSf3Mf0SMWohTpVAtJqzO4WEK0MvVgl7p+ItsSZGWQB/NidB4jWewYRDB4sJLiM8PH+loyvZMWKfQO99+bPZY= tasks: - install: null - ceph: log-ignorelist: - \(POOL_APP_NOT_ENABLED\) - workunit: clients: all: - cephtool/test_kvstore_tool.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:03:08 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T08:50:59.616 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa; will attempt to use it 2026-02-17T08:50:59.616 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks 2026-02-17T08:50:59.616 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T08:50:59.619 INFO:teuthology.task.internal:Checking packages... 2026-02-17T08:50:59.619 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e' 2026-02-17T08:50:59.619 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T08:50:59.619 INFO:teuthology.packaging:ref: None 2026-02-17T08:50:59.619 INFO:teuthology.packaging:tag: None 2026-02-17T08:50:59.619 INFO:teuthology.packaging:branch: wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T08:50:59.620 INFO:teuthology.packaging:sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:50:59.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T08:50:59.742 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:50:59.743 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T08:50:59.755 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T08:50:59.756 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T08:50:59.766 INFO:teuthology.task.internal:Saving configuration 2026-02-17T08:50:59.774 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T08:50:59.786 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T08:50:59.863 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial025.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51202', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 08:47:26.320522', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILJx5UfjBVH0/bnW1zjGrpfExwQm5eBzO4lfAHXcYexS'} 2026-02-17T08:50:59.863 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T08:50:59.875 INFO:teuthology.task.internal:roles: ubuntu@trial025.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T08:50:59.875 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T08:50:59.961 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe0a35de020>, signals=[15]) 2026-02-17T08:50:59.961 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T08:50:59.973 INFO:teuthology.task.internal:Opening connections... 2026-02-17T08:50:59.973 DEBUG:teuthology.task.internal:connecting to ubuntu@trial025.front.sepia.ceph.com 2026-02-17T08:50:59.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:51:00.034 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T08:51:00.046 DEBUG:teuthology.orchestra.run.trial025:> uname -m 2026-02-17T08:51:00.113 INFO:teuthology.orchestra.run.trial025.stdout:x86_64 2026-02-17T08:51:00.113 DEBUG:teuthology.orchestra.run.trial025:> cat /etc/os-release 2026-02-17T08:51:00.157 INFO:teuthology.orchestra.run.trial025.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-17T08:51:00.157 INFO:teuthology.orchestra.run.trial025.stdout:NAME="Ubuntu" 2026-02-17T08:51:00.157 INFO:teuthology.orchestra.run.trial025.stdout:VERSION_ID="22.04" 2026-02-17T08:51:00.157 INFO:teuthology.orchestra.run.trial025.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-17T08:51:00.157 INFO:teuthology.orchestra.run.trial025.stdout:VERSION_CODENAME=jammy 2026-02-17T08:51:00.158 INFO:teuthology.orchestra.run.trial025.stdout:ID=ubuntu 2026-02-17T08:51:00.158 INFO:teuthology.orchestra.run.trial025.stdout:ID_LIKE=debian 2026-02-17T08:51:00.158 INFO:teuthology.orchestra.run.trial025.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-17T08:51:00.158 INFO:teuthology.orchestra.run.trial025.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-17T08:51:00.158 INFO:teuthology.orchestra.run.trial025.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-17T08:51:00.158 INFO:teuthology.orchestra.run.trial025.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-17T08:51:00.158 INFO:teuthology.orchestra.run.trial025.stdout:UBUNTU_CODENAME=jammy 2026-02-17T08:51:00.159 INFO:teuthology.lock.ops:Updating trial025.front.sepia.ceph.com on lock server 2026-02-17T08:51:00.250 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T08:51:00.263 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T08:51:00.275 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T08:51:00.275 DEBUG:teuthology.orchestra.run.trial025:> test '!' -e /home/ubuntu/cephtest 2026-02-17T08:51:00.279 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T08:51:00.290 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T08:51:00.290 DEBUG:teuthology.orchestra.run.trial025:> test -z $(ls -A /var/lib/ceph) 2026-02-17T08:51:00.329 INFO:teuthology.orchestra.run.trial025.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-17T08:51:00.329 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T08:51:00.428 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T08:51:00.450 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T08:51:00.450 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T08:51:00.450 DEBUG:teuthology.orchestra.run.trial025:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T08:51:00.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:51:00.453 DEBUG:teuthology.orchestra.run.trial025:> uname -r 2026-02-17T08:51:00.500 INFO:teuthology.orchestra.run.trial025.stdout:5.15.0-164-generic 2026-02-17T08:51:00.500 INFO:teuthology.task.kernel:Running kernel on trial025: 5.15.0-164-generic 2026-02-17T08:51:00.501 DEBUG:teuthology.orchestra.run.trial025:> sudo apt-get clean 2026-02-17T08:51:00.558 DEBUG:teuthology.orchestra.run.trial025:> sudo apt-get update 2026-02-17T08:51:00.762 INFO:teuthology.orchestra.run.trial025.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T08:51:00.769 INFO:teuthology.orchestra.run.trial025.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-17T08:51:00.807 INFO:teuthology.orchestra.run.trial025.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-17T08:51:00.823 INFO:teuthology.orchestra.run.trial025.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-17T08:51:00.893 INFO:teuthology.orchestra.run.trial025.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3237 kB] 2026-02-17T08:51:00.955 INFO:teuthology.orchestra.run.trial025.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [493 kB] 2026-02-17T08:51:00.959 INFO:teuthology.orchestra.run.trial025.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-17T08:51:00.960 INFO:teuthology.orchestra.run.trial025.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1255 kB] 2026-02-17T08:51:00.968 INFO:teuthology.orchestra.run.trial025.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-17T08:51:00.970 INFO:teuthology.orchestra.run.trial025.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-17T08:51:00.971 INFO:teuthology.orchestra.run.trial025.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5287 kB] 2026-02-17T08:51:01.002 INFO:teuthology.orchestra.run.trial025.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [997 kB] 2026-02-17T08:51:01.003 INFO:teuthology.orchestra.run.trial025.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2966 kB] 2026-02-17T08:51:01.013 INFO:teuthology.orchestra.run.trial025.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [426 kB] 2026-02-17T08:51:01.014 INFO:teuthology.orchestra.run.trial025.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-17T08:51:01.014 INFO:teuthology.orchestra.run.trial025.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-17T08:51:01.017 INFO:teuthology.orchestra.run.trial025.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-17T08:51:01.018 INFO:teuthology.orchestra.run.trial025.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-17T08:51:01.018 INFO:teuthology.orchestra.run.trial025.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5096 kB] 2026-02-17T08:51:01.038 INFO:teuthology.orchestra.run.trial025.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [964 kB] 2026-02-17T08:51:04.728 INFO:teuthology.orchestra.run.trial025.stdout:Fetched 22.7 MB in 2s (13.7 MB/s) 2026-02-17T08:51:05.248 INFO:teuthology.orchestra.run.trial025.stdout:Reading package lists... 2026-02-17T08:51:05.261 DEBUG:teuthology.orchestra.run.trial025:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T08:51:05.294 INFO:teuthology.orchestra.run.trial025.stdout:Reading package lists... 2026-02-17T08:51:05.397 INFO:teuthology.orchestra.run.trial025.stdout:Building dependency tree... 2026-02-17T08:51:05.398 INFO:teuthology.orchestra.run.trial025.stdout:Reading state information... 2026-02-17T08:51:05.481 INFO:teuthology.orchestra.run.trial025.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T08:51:05.481 INFO:teuthology.orchestra.run.trial025.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T08:51:05.481 INFO:teuthology.orchestra.run.trial025.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T08:51:05.481 INFO:teuthology.orchestra.run.trial025.stdout: sg3-utils-udev 2026-02-17T08:51:05.482 INFO:teuthology.orchestra.run.trial025.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T08:51:05.482 INFO:teuthology.orchestra.run.trial025.stdout:The following additional packages will be installed: 2026-02-17T08:51:05.482 INFO:teuthology.orchestra.run.trial025.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T08:51:05.482 INFO:teuthology.orchestra.run.trial025.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-17T08:51:05.482 INFO:teuthology.orchestra.run.trial025.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-17T08:51:05.482 INFO:teuthology.orchestra.run.trial025.stdout:Suggested packages: 2026-02-17T08:51:05.482 INFO:teuthology.orchestra.run.trial025.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-17T08:51:05.495 INFO:teuthology.orchestra.run.trial025.stdout:The following NEW packages will be installed: 2026-02-17T08:51:05.495 INFO:teuthology.orchestra.run.trial025.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T08:51:05.495 INFO:teuthology.orchestra.run.trial025.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-17T08:51:05.495 INFO:teuthology.orchestra.run.trial025.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-17T08:51:05.495 INFO:teuthology.orchestra.run.trial025.stdout:The following packages will be upgraded: 2026-02-17T08:51:05.495 INFO:teuthology.orchestra.run.trial025.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-17T08:51:05.604 INFO:teuthology.orchestra.run.trial025.stdout:3 upgraded, 5 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T08:51:05.604 INFO:teuthology.orchestra.run.trial025.stdout:Need to get 113 MB of archives. 2026-02-17T08:51:05.604 INFO:teuthology.orchestra.run.trial025.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-17T08:51:05.604 INFO:teuthology.orchestra.run.trial025.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-17T08:51:05.775 INFO:teuthology.orchestra.run.trial025.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-17T08:51:05.819 INFO:teuthology.orchestra.run.trial025.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-17T08:51:06.064 INFO:teuthology.orchestra.run.trial025.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-17T08:51:06.064 INFO:teuthology.orchestra.run.trial025.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-17T08:51:06.064 INFO:teuthology.orchestra.run.trial025.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-17T08:51:06.113 INFO:teuthology.orchestra.run.trial025.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-17T08:51:06.123 INFO:teuthology.orchestra.run.trial025.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-17T08:51:06.320 INFO:teuthology.orchestra.run.trial025.stdout:Fetched 113 MB in 1s (181 MB/s) 2026-02-17T08:51:06.341 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-17T08:51:06.504 INFO:teuthology.orchestra.run.trial025.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-17T08:51:06.506 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T08:51:06.507 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:51:06.847 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-17T08:51:06.854 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T08:51:06.874 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:51:06.915 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-17T08:51:06.921 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T08:51:06.922 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:51:08.016 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T08:51:08.017 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T08:51:08.039 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T08:51:08.039 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T08:51:08.056 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-17T08:51:08.064 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-17T08:51:08.064 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T08:51:09.411 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-17T08:51:09.423 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T08:51:09.423 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:51:10.007 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T08:51:10.007 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T08:51:10.032 INFO:teuthology.orchestra.run.trial025.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T08:51:10.033 INFO:teuthology.orchestra.run.trial025.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:51:10.035 INFO:teuthology.orchestra.run.trial025.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-17T08:51:10.036 INFO:teuthology.orchestra.run.trial025.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:51:10.801 INFO:teuthology.orchestra.run.trial025.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:51:11.620 INFO:teuthology.orchestra.run.trial025.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-17T08:51:11.621 INFO:teuthology.orchestra.run.trial025.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-17T08:51:11.627 INFO:teuthology.orchestra.run.trial025.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:51:12.415 INFO:teuthology.orchestra.run.trial025.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-17T08:51:12.416 INFO:teuthology.orchestra.run.trial025.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-17T08:51:12.417 INFO:teuthology.orchestra.run.trial025.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T08:51:12.422 INFO:teuthology.orchestra.run.trial025.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-17T08:51:12.422 INFO:teuthology.orchestra.run.trial025.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-17T08:51:19.484 INFO:teuthology.orchestra.run.trial025.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-17T08:51:26.121 INFO:teuthology.orchestra.run.trial025.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-17T08:51:26.122 INFO:teuthology.orchestra.run.trial025.stdout:Sourcing file `/etc/default/grub' 2026-02-17T08:51:26.141 INFO:teuthology.orchestra.run.trial025.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T08:51:26.142 INFO:teuthology.orchestra.run.trial025.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T08:51:26.145 INFO:teuthology.orchestra.run.trial025.stdout:Generating grub configuration file ... 2026-02-17T08:51:26.225 INFO:teuthology.orchestra.run.trial025.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T08:51:26.232 INFO:teuthology.orchestra.run.trial025.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T08:51:26.403 INFO:teuthology.orchestra.run.trial025.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T08:51:26.408 INFO:teuthology.orchestra.run.trial025.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T08:51:26.479 INFO:teuthology.orchestra.run.trial025.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T08:51:26.479 INFO:teuthology.orchestra.run.trial025.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T08:51:26.479 INFO:teuthology.orchestra.run.trial025.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T08:51:26.481 INFO:teuthology.orchestra.run.trial025.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T08:51:26.489 INFO:teuthology.orchestra.run.trial025.stdout:done 2026-02-17T08:51:26.867 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:51:26.867 INFO:teuthology.orchestra.run.trial025.stdout:Pending kernel upgrade! 2026-02-17T08:51:26.867 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:51:26.867 INFO:teuthology.orchestra.run.trial025.stdout:Running kernel version: 2026-02-17T08:51:26.868 INFO:teuthology.orchestra.run.trial025.stdout: 5.15.0-164-generic 2026-02-17T08:51:26.868 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:51:26.868 INFO:teuthology.orchestra.run.trial025.stdout:Diagnostics: 2026-02-17T08:51:26.868 INFO:teuthology.orchestra.run.trial025.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-17T08:51:26.868 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:51:26.868 INFO:teuthology.orchestra.run.trial025.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-17T08:51:26.868 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:51:26.868 INFO:teuthology.orchestra.run.trial025.stdout:The processor microcode seems to be up-to-date. 2026-02-17T08:51:26.868 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:51:26.868 INFO:teuthology.orchestra.run.trial025.stdout:No services need to be restarted. 2026-02-17T08:51:26.868 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:51:26.869 INFO:teuthology.orchestra.run.trial025.stdout:No containers need to be restarted. 2026-02-17T08:51:26.869 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:51:26.869 INFO:teuthology.orchestra.run.trial025.stdout:No user sessions are running outdated binaries. 2026-02-17T08:51:26.869 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:51:26.869 INFO:teuthology.orchestra.run.trial025.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T08:51:27.516 DEBUG:teuthology.orchestra.run.trial025:> dpkg -s linux-image-generic 2026-02-17T08:51:27.526 INFO:teuthology.orchestra.run.trial025.stdout:Package: linux-image-generic 2026-02-17T08:51:27.526 INFO:teuthology.orchestra.run.trial025.stdout:Status: install ok installed 2026-02-17T08:51:27.526 INFO:teuthology.orchestra.run.trial025.stdout:Priority: optional 2026-02-17T08:51:27.526 INFO:teuthology.orchestra.run.trial025.stdout:Section: kernel 2026-02-17T08:51:27.526 INFO:teuthology.orchestra.run.trial025.stdout:Installed-Size: 21 2026-02-17T08:51:27.526 INFO:teuthology.orchestra.run.trial025.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T08:51:27.526 INFO:teuthology.orchestra.run.trial025.stdout:Architecture: amd64 2026-02-17T08:51:27.526 INFO:teuthology.orchestra.run.trial025.stdout:Source: linux-meta 2026-02-17T08:51:27.527 INFO:teuthology.orchestra.run.trial025.stdout:Version: 5.15.0.170.159 2026-02-17T08:51:27.527 INFO:teuthology.orchestra.run.trial025.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T08:51:27.527 INFO:teuthology.orchestra.run.trial025.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T08:51:27.527 INFO:teuthology.orchestra.run.trial025.stdout:Recommends: thermald 2026-02-17T08:51:27.527 INFO:teuthology.orchestra.run.trial025.stdout:Description: Generic Linux kernel image 2026-02-17T08:51:27.527 INFO:teuthology.orchestra.run.trial025.stdout: This package will always depend on the latest generic kernel image 2026-02-17T08:51:27.527 INFO:teuthology.orchestra.run.trial025.stdout: available. 2026-02-17T08:51:27.528 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-17T08:51:27.528 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T08:51:27.528 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T08:51:27.529 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T08:51:27.529 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial025.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T08:51:27.529 DEBUG:teuthology.orchestra.run.trial025:> sudo apt-get clean 2026-02-17T08:51:27.609 DEBUG:teuthology.orchestra.run.trial025:> sudo apt-get update 2026-02-17T08:51:28.100 INFO:teuthology.orchestra.run.trial025.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T08:51:28.182 INFO:teuthology.orchestra.run.trial025.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T08:51:28.270 INFO:teuthology.orchestra.run.trial025.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T08:51:28.358 INFO:teuthology.orchestra.run.trial025.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T08:51:29.017 INFO:teuthology.orchestra.run.trial025.stdout:Reading package lists... 2026-02-17T08:51:29.032 DEBUG:teuthology.orchestra.run.trial025:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T08:51:29.066 INFO:teuthology.orchestra.run.trial025.stdout:Reading package lists... 2026-02-17T08:51:29.179 INFO:teuthology.orchestra.run.trial025.stdout:Building dependency tree... 2026-02-17T08:51:29.180 INFO:teuthology.orchestra.run.trial025.stdout:Reading state information... 2026-02-17T08:51:29.268 INFO:teuthology.orchestra.run.trial025.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-17T08:51:29.268 INFO:teuthology.orchestra.run.trial025.stdout:linux-image-generic set to manually installed. 2026-02-17T08:51:29.269 INFO:teuthology.orchestra.run.trial025.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T08:51:29.269 INFO:teuthology.orchestra.run.trial025.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T08:51:29.269 INFO:teuthology.orchestra.run.trial025.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T08:51:29.269 INFO:teuthology.orchestra.run.trial025.stdout: sg3-utils-udev 2026-02-17T08:51:29.269 INFO:teuthology.orchestra.run.trial025.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T08:51:29.288 INFO:teuthology.orchestra.run.trial025.stdout:0 upgraded, 0 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T08:51:29.290 DEBUG:teuthology.orchestra.run.trial025:> dpkg -s linux-image-generic 2026-02-17T08:51:29.343 INFO:teuthology.orchestra.run.trial025.stdout:Package: linux-image-generic 2026-02-17T08:51:29.343 INFO:teuthology.orchestra.run.trial025.stdout:Status: install ok installed 2026-02-17T08:51:29.343 INFO:teuthology.orchestra.run.trial025.stdout:Priority: optional 2026-02-17T08:51:29.343 INFO:teuthology.orchestra.run.trial025.stdout:Section: kernel 2026-02-17T08:51:29.343 INFO:teuthology.orchestra.run.trial025.stdout:Installed-Size: 21 2026-02-17T08:51:29.343 INFO:teuthology.orchestra.run.trial025.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T08:51:29.343 INFO:teuthology.orchestra.run.trial025.stdout:Architecture: amd64 2026-02-17T08:51:29.344 INFO:teuthology.orchestra.run.trial025.stdout:Source: linux-meta 2026-02-17T08:51:29.344 INFO:teuthology.orchestra.run.trial025.stdout:Version: 5.15.0.170.159 2026-02-17T08:51:29.344 INFO:teuthology.orchestra.run.trial025.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T08:51:29.344 INFO:teuthology.orchestra.run.trial025.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T08:51:29.344 INFO:teuthology.orchestra.run.trial025.stdout:Recommends: thermald 2026-02-17T08:51:29.344 INFO:teuthology.orchestra.run.trial025.stdout:Description: Generic Linux kernel image 2026-02-17T08:51:29.344 INFO:teuthology.orchestra.run.trial025.stdout: This package will always depend on the latest generic kernel image 2026-02-17T08:51:29.344 INFO:teuthology.orchestra.run.trial025.stdout: available. 2026-02-17T08:51:29.345 DEBUG:teuthology.orchestra.run.trial025:> mktemp 2026-02-17T08:51:29.389 INFO:teuthology.orchestra.run.trial025.stdout:/tmp/tmp.zfH13Lbxmg 2026-02-17T08:51:29.390 DEBUG:teuthology.orchestra.run.trial025:> sudo cp /boot/grub/grub.cfg /tmp/tmp.zfH13Lbxmg 2026-02-17T08:51:29.441 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 0666 /tmp/tmp.zfH13Lbxmg 2026-02-17T08:51:29.534 DEBUG:teuthology.orchestra.remote:trial025:/tmp/tmp.zfH13Lbxmg is 7KB 2026-02-17T08:51:29.539 DEBUG:teuthology.orchestra.run.trial025:> rm -fr /tmp/tmp.zfH13Lbxmg 2026-02-17T08:51:29.542 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-17T08:51:29.596 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:51:29.596 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-17T08:51:29.596 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-17T08:51:29.651 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-17T08:51:29.652 DEBUG:teuthology.orchestra.run.trial025:> sudo update-grub 2026-02-17T08:51:29.889 INFO:teuthology.orchestra.run.trial025.stderr:Sourcing file `/etc/default/grub' 2026-02-17T08:51:29.907 INFO:teuthology.orchestra.run.trial025.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T08:51:29.908 INFO:teuthology.orchestra.run.trial025.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T08:51:29.910 INFO:teuthology.orchestra.run.trial025.stderr:Generating grub configuration file ... 2026-02-17T08:51:29.989 INFO:teuthology.orchestra.run.trial025.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T08:51:29.994 INFO:teuthology.orchestra.run.trial025.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T08:51:30.169 INFO:teuthology.orchestra.run.trial025.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T08:51:30.175 INFO:teuthology.orchestra.run.trial025.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T08:51:30.244 INFO:teuthology.orchestra.run.trial025.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T08:51:30.245 INFO:teuthology.orchestra.run.trial025.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T08:51:30.245 INFO:teuthology.orchestra.run.trial025.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T08:51:30.247 INFO:teuthology.orchestra.run.trial025.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T08:51:30.254 INFO:teuthology.orchestra.run.trial025.stderr:done 2026-02-17T08:51:30.256 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial025 2026-02-17T08:51:30.256 DEBUG:teuthology.orchestra.run.trial025:> sudo bash -c ' 2026-02-17T08:51:30.256 DEBUG:teuthology.orchestra.run.trial025:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T08:51:30.257 DEBUG:teuthology.orchestra.run.trial025:> ' 2026-02-17T08:52:00.259 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T08:52:00.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-17T08:52:00.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:53:00.318 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T08:53:09.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-17T08:53:09.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:53:09.454 DEBUG:teuthology.orchestra.run.trial025:> true 2026-02-17T08:53:09.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-17T08:53:09.863 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-17T08:53:09.863 DEBUG:teuthology.orchestra.run.trial025:> uname -r 2026-02-17T08:53:09.911 INFO:teuthology.orchestra.run.trial025.stdout:5.15.0-170-generic 2026-02-17T08:53:09.912 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-17T08:53:09.912 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T08:53:09.912 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-17T08:53:10.913 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T08:53:10.913 DEBUG:teuthology.orchestra.run.trial025:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T08:53:10.926 INFO:teuthology.orchestra.run.trial025.stdout:ttyS1 2026-02-17T08:53:10.958 DEBUG:teuthology.parallel:result is None 2026-02-17T08:53:10.958 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T08:53:10.965 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T08:53:10.965 DEBUG:teuthology.orchestra.run.trial025:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T08:53:11.004 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T08:53:11.016 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T08:53:11.028 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T08:53:11.028 DEBUG:teuthology.orchestra.run.trial025:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T08:53:11.054 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T08:53:11.065 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T08:53:11.065 DEBUG:teuthology.orchestra.run.trial025:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T08:53:11.101 INFO:teuthology.orchestra.run.trial025.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:53:11.107 INFO:teuthology.orchestra.run.trial025.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:53:11.109 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T08:53:11.124 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T08:53:11.124 DEBUG:teuthology.orchestra.run.trial025:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T08:53:11.160 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T08:53:11.179 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T08:53:11.179 DEBUG:teuthology.orchestra.run.trial025:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T08:53:11.208 DEBUG:teuthology.orchestra.run.trial025:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:53:11.252 DEBUG:teuthology.orchestra.run.trial025:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:53:11.296 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:53:11.296 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T08:53:11.345 DEBUG:teuthology.orchestra.run.trial025:> sudo service rsyslog restart 2026-02-17T08:53:11.406 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T08:53:11.417 INFO:teuthology.task.internal:Starting timer... 2026-02-17T08:53:11.417 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T08:53:11.434 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T08:53:11.447 DEBUG:teuthology.task.selinux:Excluding trial025: OS 'ubuntu' does not support SELinux 2026-02-17T08:53:11.447 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T08:53:11.447 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-17T08:53:11.447 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T08:53:11.447 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T08:53:11.459 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T08:53:11.468 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T08:53:11.468 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial025.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T08:55:39.880 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial025.front.sepia.ceph.com')] 2026-02-17T08:55:39.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-17T08:55:39.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:55:39.958 DEBUG:teuthology.orchestra.run.trial025:> true 2026-02-17T08:55:40.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial025.front.sepia.ceph.com' 2026-02-17T08:55:40.205 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T08:55:40.223 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T08:55:40.224 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T08:55:40.225 DEBUG:teuthology.orchestra.run.trial025:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T08:55:40.266 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-17T08:55:40.266 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: Command line: ntpd -gq 2026-02-17T08:55:40.266 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: ---------------------------------------------------- 2026-02-17T08:55:40.266 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: ntp-4 is maintained by Network Time Foundation, 2026-02-17T08:55:40.266 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-17T08:55:40.266 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: corporation. Support and training for ntp-4 are 2026-02-17T08:55:40.266 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: available at https://www.nwtime.org/support 2026-02-17T08:55:40.266 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: ---------------------------------------------------- 2026-02-17T08:55:40.267 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: proto: precision = 0.020 usec (-25) 2026-02-17T08:55:40.267 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: basedate set to 2022-02-04 2026-02-17T08:55:40.267 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: gps base set to 2022-02-06 (week 2196) 2026-02-17T08:55:40.267 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T08:55:40.267 INFO:teuthology.orchestra.run.trial025.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T08:55:40.267 INFO:teuthology.orchestra.run.trial025.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-17T08:55:40.269 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: restrict ::: KOD does nothing without LIMITED. 2026-02-17T08:55:40.269 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: Listen and drop on 0 v6wildcard [::]:123 2026-02-17T08:55:40.269 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-17T08:55:40.269 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: Listen normally on 2 lo 127.0.0.1:123 2026-02-17T08:55:40.269 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: Listen normally on 3 enp1s0f0 10.20.193.25:123 2026-02-17T08:55:40.269 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: Listen normally on 4 lo [::1]:123 2026-02-17T08:55:40.269 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:5fc8%2]:123 2026-02-17T08:55:40.269 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:40 ntpd[8683]: Listening on routing socket on fd #22 for interface updates 2026-02-17T08:55:41.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:41.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:41.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:41.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:41.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:41.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:41.268 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:41.269 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:41.269 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:55:41.269 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:55:41.329 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:41.329 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:41.329 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:55:41.329 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:55:41.343 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:41.343 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:41.343 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:55:41.343 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:41 ntpd[8683]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:55:43.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:43.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:43.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:43.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:43.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:43.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:43.268 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:43.269 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:43.269 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:55:43.269 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:55:43.328 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:43.328 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:43.329 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:55:43.329 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:55:43.342 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:43.343 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:43.343 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:55:43.343 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:43 ntpd[8683]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:55:44.265 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:44 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:44.265 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:44 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:44.302 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:44 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:44.303 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:44 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:44.303 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:44 ntpd[8683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:55:44.303 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:44 ntpd[8683]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:55:45.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:45.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:45.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:45.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:45.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:45.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:45.269 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:45.269 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:45.269 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:55:45.269 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:55:45.328 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:45.328 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:45.328 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:55:45.328 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:55:45.342 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:45.342 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:45.342 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:55:45.342 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:45 ntpd[8683]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:55:46.265 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:46 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:46.265 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:46 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:46.302 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:46 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:46.302 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:46 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:46.302 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:46 ntpd[8683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:55:46.302 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:46 ntpd[8683]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:55:47.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:47 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:47.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:47 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:47.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:47 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:47.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:47 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:47.266 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:47 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:47.267 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:47 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:47.268 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:47 ntpd[8683]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T08:55:47.269 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:47 ntpd[8683]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T08:55:47.269 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:47 ntpd[8683]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T08:55:47.269 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:47 ntpd[8683]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T08:55:47.269 INFO:teuthology.orchestra.run.trial025.stdout:17 Feb 08:55:47 ntpd[8683]: ntpd: time set -0.032725 s 2026-02-17T08:55:47.269 INFO:teuthology.orchestra.run.trial025.stdout:ntpd: time set -0.032725s 2026-02-17T08:55:47.270 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:47 ntpd[8683]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-17T08:55:47.270 INFO:teuthology.orchestra.run.trial025.stderr:17 Feb 08:55:47 ntpd[8683]: can't open /var/log/ntpstats/loopstats.20260217: Permission denied 2026-02-17T08:55:47.451 INFO:teuthology.orchestra.run.trial025.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T08:55:47.451 INFO:teuthology.orchestra.run.trial025.stdout:============================================================================== 2026-02-17T08:55:47.451 INFO:teuthology.orchestra.run.trial025.stdout: ntp.maxhost.io .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T08:55:47.452 INFO:teuthology.orchestra.run.trial025.stdout: 204.2.134.172 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T08:55:47.452 INFO:teuthology.orchestra.run.trial025.stdout: hou1.us.ntp.li .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T08:55:47.452 INFO:teuthology.orchestra.run.trial025.stdout: time1.lshiy.com .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T08:55:47.453 INFO:teuthology.run_tasks:Running task install... 2026-02-17T08:55:47.472 DEBUG:teuthology.task.install:project ceph 2026-02-17T08:55:47.473 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}} 2026-02-17T08:55:47.473 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-17T08:55:47.473 INFO:teuthology.task.install:Using flavor: default 2026-02-17T08:55:47.484 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T08:55:47.485 INFO:teuthology.task.install:extra packages: [] 2026-02-17T08:55:47.485 DEBUG:teuthology.orchestra.run.trial025:> sudo apt-key list | grep Ceph 2026-02-17T08:55:47.538 INFO:teuthology.orchestra.run.trial025.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-17T08:55:47.567 INFO:teuthology.orchestra.run.trial025.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-17T08:55:47.567 INFO:teuthology.orchestra.run.trial025.stdout:uid [ unknown] Ceph.com (release key) 2026-02-17T08:55:47.568 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-17T08:55:47.568 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:55:47.698 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default/ 2026-02-17T08:55:47.699 INFO:teuthology.task.install.deb:Package version is 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:55:47.841 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:55:47.841 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-17T08:55:47.850 DEBUG:teuthology.orchestra.run.trial025:> sudo apt-get update 2026-02-17T08:55:48.009 INFO:teuthology.orchestra.run.trial025.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy InRelease 2026-02-17T08:55:48.021 INFO:teuthology.orchestra.run.trial025.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy Release [7662 B] 2026-02-17T08:55:48.033 INFO:teuthology.orchestra.run.trial025.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-17T08:55:48.044 INFO:teuthology.orchestra.run.trial025.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2026-02-17T08:55:48.483 INFO:teuthology.orchestra.run.trial025.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T08:55:48.560 INFO:teuthology.orchestra.run.trial025.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T08:55:48.642 INFO:teuthology.orchestra.run.trial025.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T08:55:48.725 INFO:teuthology.orchestra.run.trial025.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T08:55:48.869 INFO:teuthology.orchestra.run.trial025.stdout:Fetched 25.8 kB in 1s (30.3 kB/s) 2026-02-17T08:55:49.395 INFO:teuthology.orchestra.run.trial025.stdout:Reading package lists... 2026-02-17T08:55:49.409 DEBUG:teuthology.orchestra.run.trial025:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.3-705-g04cf6dd4-1jammy cephadm=19.2.3-705-g04cf6dd4-1jammy ceph-mds=19.2.3-705-g04cf6dd4-1jammy ceph-mgr=19.2.3-705-g04cf6dd4-1jammy ceph-common=19.2.3-705-g04cf6dd4-1jammy ceph-fuse=19.2.3-705-g04cf6dd4-1jammy ceph-test=19.2.3-705-g04cf6dd4-1jammy ceph-volume=19.2.3-705-g04cf6dd4-1jammy radosgw=19.2.3-705-g04cf6dd4-1jammy python3-rados=19.2.3-705-g04cf6dd4-1jammy python3-rgw=19.2.3-705-g04cf6dd4-1jammy python3-cephfs=19.2.3-705-g04cf6dd4-1jammy python3-rbd=19.2.3-705-g04cf6dd4-1jammy libcephfs2=19.2.3-705-g04cf6dd4-1jammy libcephfs-dev=19.2.3-705-g04cf6dd4-1jammy librados2=19.2.3-705-g04cf6dd4-1jammy librbd1=19.2.3-705-g04cf6dd4-1jammy rbd-fuse=19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:55:49.444 INFO:teuthology.orchestra.run.trial025.stdout:Reading package lists... 2026-02-17T08:55:49.553 INFO:teuthology.orchestra.run.trial025.stdout:Building dependency tree... 2026-02-17T08:55:49.553 INFO:teuthology.orchestra.run.trial025.stdout:Reading state information... 2026-02-17T08:55:49.645 INFO:teuthology.orchestra.run.trial025.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T08:55:49.645 INFO:teuthology.orchestra.run.trial025.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T08:55:49.645 INFO:teuthology.orchestra.run.trial025.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T08:55:49.645 INFO:teuthology.orchestra.run.trial025.stdout: sg3-utils-udev 2026-02-17T08:55:49.645 INFO:teuthology.orchestra.run.trial025.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T08:55:49.646 INFO:teuthology.orchestra.run.trial025.stdout:The following additional packages will be installed: 2026-02-17T08:55:49.646 INFO:teuthology.orchestra.run.trial025.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-17T08:55:49.646 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-17T08:55:49.646 INFO:teuthology.orchestra.run.trial025.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 2026-02-17T08:55:49.646 INFO:teuthology.orchestra.run.trial025.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T08:55:49.646 INFO:teuthology.orchestra.run.trial025.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2026-02-17T08:55:49.646 INFO:teuthology.orchestra.run.trial025.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2026-02-17T08:55:49.646 INFO:teuthology.orchestra.run.trial025.stdout: pkg-config python-asyncssh-doc python-pastedeploy-tpl python3-asyncssh 2026-02-17T08:55:49.646 INFO:teuthology.orchestra.run.trial025.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cheroot 2026-02-17T08:55:49.646 INFO:teuthology.orchestra.run.trial025.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T08:55:49.646 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T08:55:49.647 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T08:55:49.647 INFO:teuthology.orchestra.run.trial025.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T08:55:49.647 INFO:teuthology.orchestra.run.trial025.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T08:55:49.647 INFO:teuthology.orchestra.run.trial025.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T08:55:49.647 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyinotify python3-pytest python3-repoze.lru 2026-02-17T08:55:49.647 INFO:teuthology.orchestra.run.trial025.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2026-02-17T08:55:49.647 INFO:teuthology.orchestra.run.trial025.stdout: python3-simplejson python3-singledispatch python3-sklearn 2026-02-17T08:55:49.647 INFO:teuthology.orchestra.run.trial025.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2026-02-17T08:55:49.647 INFO:teuthology.orchestra.run.trial025.stdout: python3-toml python3-waitress python3-wcwidth python3-webob 2026-02-17T08:55:49.647 INFO:teuthology.orchestra.run.trial025.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2026-02-17T08:55:49.647 INFO:teuthology.orchestra.run.trial025.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2026-02-17T08:55:49.647 INFO:teuthology.orchestra.run.trial025.stdout:Suggested packages: 2026-02-17T08:55:49.648 INFO:teuthology.orchestra.run.trial025.stdout: python3-influxdb readline-doc python3-beaker python-mako-doc 2026-02-17T08:55:49.648 INFO:teuthology.orchestra.run.trial025.stdout: python-natsort-doc httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2026-02-17T08:55:49.648 INFO:teuthology.orchestra.run.trial025.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2026-02-17T08:55:49.648 INFO:teuthology.orchestra.run.trial025.stdout: python-pygments-doc ttf-bitstream-vera python-pyinotify-doc python3-dap 2026-02-17T08:55:49.648 INFO:teuthology.orchestra.run.trial025.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2026-02-17T08:55:49.648 INFO:teuthology.orchestra.run.trial025.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2026-02-17T08:55:49.648 INFO:teuthology.orchestra.run.trial025.stdout:Recommended packages: 2026-02-17T08:55:49.648 INFO:teuthology.orchestra.run.trial025.stdout: btrfs-tools 2026-02-17T08:55:49.678 INFO:teuthology.orchestra.run.trial025.stdout:The following NEW packages will be installed: 2026-02-17T08:55:49.679 INFO:teuthology.orchestra.run.trial025.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-17T08:55:49.679 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-17T08:55:49.679 INFO:teuthology.orchestra.run.trial025.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-17T08:55:49.679 INFO:teuthology.orchestra.run.trial025.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 2026-02-17T08:55:49.679 INFO:teuthology.orchestra.run.trial025.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-17T08:55:49.679 INFO:teuthology.orchestra.run.trial025.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2026-02-17T08:55:49.679 INFO:teuthology.orchestra.run.trial025.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2026-02-17T08:55:49.680 INFO:teuthology.orchestra.run.trial025.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2026-02-17T08:55:49.680 INFO:teuthology.orchestra.run.trial025.stdout: python-pastedeploy-tpl python3-asyncssh python3-cachetools 2026-02-17T08:55:49.681 INFO:teuthology.orchestra.run.trial025.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cheroot 2026-02-17T08:55:49.681 INFO:teuthology.orchestra.run.trial025.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T08:55:49.681 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T08:55:49.681 INFO:teuthology.orchestra.run.trial025.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T08:55:49.681 INFO:teuthology.orchestra.run.trial025.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T08:55:49.681 INFO:teuthology.orchestra.run.trial025.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T08:55:49.681 INFO:teuthology.orchestra.run.trial025.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T08:55:49.681 INFO:teuthology.orchestra.run.trial025.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2026-02-17T08:55:49.681 INFO:teuthology.orchestra.run.trial025.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-17T08:55:49.681 INFO:teuthology.orchestra.run.trial025.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2026-02-17T08:55:49.681 INFO:teuthology.orchestra.run.trial025.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2026-02-17T08:55:49.682 INFO:teuthology.orchestra.run.trial025.stdout: python3-threadpoolctl python3-toml python3-waitress python3-wcwidth 2026-02-17T08:55:49.682 INFO:teuthology.orchestra.run.trial025.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2026-02-17T08:55:49.682 INFO:teuthology.orchestra.run.trial025.stdout: python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse socat unzip 2026-02-17T08:55:49.682 INFO:teuthology.orchestra.run.trial025.stdout: xmlstarlet zip 2026-02-17T08:55:49.758 INFO:teuthology.orchestra.run.trial025.stdout:0 upgraded, 108 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T08:55:49.758 INFO:teuthology.orchestra.run.trial025.stdout:Need to get 178 MB of archives. 2026-02-17T08:55:49.759 INFO:teuthology.orchestra.run.trial025.stdout:After this operation, 809 MB of additional disk space will be used. 2026-02-17T08:55:49.759 INFO:teuthology.orchestra.run.trial025.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.2.3-705-g04cf6dd4-1jammy [3593 kB] 2026-02-17T08:55:49.859 INFO:teuthology.orchestra.run.trial025.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.2.3-705-g04cf6dd4-1jammy [3257 kB] 2026-02-17T08:55:49.905 INFO:teuthology.orchestra.run.trial025.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.2.3-705-g04cf6dd4-1jammy [979 kB] 2026-02-17T08:55:49.920 INFO:teuthology.orchestra.run.trial025.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.2.3-705-g04cf6dd4-1jammy [357 kB] 2026-02-17T08:55:49.926 INFO:teuthology.orchestra.run.trial025.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.2.3-705-g04cf6dd4-1jammy [32.9 kB] 2026-02-17T08:55:49.926 INFO:teuthology.orchestra.run.trial025.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.2.3-705-g04cf6dd4-1jammy [184 kB] 2026-02-17T08:55:49.930 INFO:teuthology.orchestra.run.trial025.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.2.3-705-g04cf6dd4-1jammy [74.1 kB] 2026-02-17T08:55:49.931 INFO:teuthology.orchestra.run.trial025.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.2.3-705-g04cf6dd4-1jammy [337 kB] 2026-02-17T08:55:49.936 INFO:teuthology.orchestra.run.trial025.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.2.3-705-g04cf6dd4-1jammy [6935 kB] 2026-02-17T08:55:50.033 INFO:teuthology.orchestra.run.trial025.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-17T08:55:50.050 INFO:teuthology.orchestra.run.trial025.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.2.3-705-g04cf6dd4-1jammy [112 kB] 2026-02-17T08:55:50.051 INFO:teuthology.orchestra.run.trial025.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.2.3-705-g04cf6dd4-1jammy [470 kB] 2026-02-17T08:55:50.060 INFO:teuthology.orchestra.run.trial025.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.2.3-705-g04cf6dd4-1jammy [26.5 MB] 2026-02-17T08:55:50.372 INFO:teuthology.orchestra.run.trial025.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-17T08:55:50.382 INFO:teuthology.orchestra.run.trial025.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-17T08:55:50.452 INFO:teuthology.orchestra.run.trial025.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-17T08:55:50.497 INFO:teuthology.orchestra.run.trial025.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.2.3-705-g04cf6dd4-1jammy [5178 kB] 2026-02-17T08:55:50.578 INFO:teuthology.orchestra.run.trial025.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.2.3-705-g04cf6dd4-1jammy [248 kB] 2026-02-17T08:55:50.582 INFO:teuthology.orchestra.run.trial025.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.2.3-705-g04cf6dd4-1jammy [125 kB] 2026-02-17T08:55:50.583 INFO:teuthology.orchestra.run.trial025.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.2.3-705-g04cf6dd4-1jammy [1081 kB] 2026-02-17T08:55:50.602 INFO:teuthology.orchestra.run.trial025.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.2.3-705-g04cf6dd4-1jammy [6239 kB] 2026-02-17T08:55:50.654 INFO:teuthology.orchestra.run.trial025.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-17T08:55:50.664 INFO:teuthology.orchestra.run.trial025.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-17T08:55:50.691 INFO:teuthology.orchestra.run.trial025.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-17T08:55:50.699 INFO:teuthology.orchestra.run.trial025.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-17T08:55:50.701 INFO:teuthology.orchestra.run.trial025.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-17T08:55:50.701 INFO:teuthology.orchestra.run.trial025.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-17T08:55:50.702 INFO:teuthology.orchestra.run.trial025.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-17T08:55:50.705 INFO:teuthology.orchestra.run.trial025.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.2.3-705-g04cf6dd4-1jammy [23.0 MB] 2026-02-17T08:55:50.719 INFO:teuthology.orchestra.run.trial025.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2026-02-17T08:55:50.723 INFO:teuthology.orchestra.run.trial025.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2026-02-17T08:55:50.726 INFO:teuthology.orchestra.run.trial025.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2026-02-17T08:55:50.795 INFO:teuthology.orchestra.run.trial025.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5034 B] 2026-02-17T08:55:50.796 INFO:teuthology.orchestra.run.trial025.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2026-02-17T08:55:50.797 INFO:teuthology.orchestra.run.trial025.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2026-02-17T08:55:50.799 INFO:teuthology.orchestra.run.trial025.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2026-02-17T08:55:50.801 INFO:teuthology.orchestra.run.trial025.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-17T08:55:50.801 INFO:teuthology.orchestra.run.trial025.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-17T08:55:50.801 INFO:teuthology.orchestra.run.trial025.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-17T08:55:50.802 INFO:teuthology.orchestra.run.trial025.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-17T08:55:50.802 INFO:teuthology.orchestra.run.trial025.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-17T08:55:50.873 INFO:teuthology.orchestra.run.trial025.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-17T08:55:50.873 INFO:teuthology.orchestra.run.trial025.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-17T08:55:50.874 INFO:teuthology.orchestra.run.trial025.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-17T08:55:50.874 INFO:teuthology.orchestra.run.trial025.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-17T08:55:50.944 INFO:teuthology.orchestra.run.trial025.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-17T08:55:50.946 INFO:teuthology.orchestra.run.trial025.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-17T08:55:50.947 INFO:teuthology.orchestra.run.trial025.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2026-02-17T08:55:50.947 INFO:teuthology.orchestra.run.trial025.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2026-02-17T08:55:50.948 INFO:teuthology.orchestra.run.trial025.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2026-02-17T08:55:50.948 INFO:teuthology.orchestra.run.trial025.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7320 B] 2026-02-17T08:55:51.016 INFO:teuthology.orchestra.run.trial025.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-17T08:55:51.017 INFO:teuthology.orchestra.run.trial025.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-waitress all 1.4.4-1.1ubuntu1.1 [47.0 kB] 2026-02-17T08:55:51.018 INFO:teuthology.orchestra.run.trial025.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2026-02-17T08:55:51.018 INFO:teuthology.orchestra.run.trial025.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2026-02-17T08:55:51.083 INFO:teuthology.orchestra.run.trial025.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.2.3-705-g04cf6dd4-1jammy [14.2 kB] 2026-02-17T08:55:51.083 INFO:teuthology.orchestra.run.trial025.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.2.3-705-g04cf6dd4-1jammy [1173 kB] 2026-02-17T08:55:51.088 INFO:teuthology.orchestra.run.trial025.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4892 B] 2026-02-17T08:55:51.088 INFO:teuthology.orchestra.run.trial025.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2026-02-17T08:55:51.089 INFO:teuthology.orchestra.run.trial025.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2026-02-17T08:55:51.089 INFO:teuthology.orchestra.run.trial025.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2026-02-17T08:55:51.090 INFO:teuthology.orchestra.run.trial025.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.3 [181 kB] 2026-02-17T08:55:51.092 INFO:teuthology.orchestra.run.trial025.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-17T08:55:51.100 INFO:teuthology.orchestra.run.trial025.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.2.3-705-g04cf6dd4-1jammy [2503 kB] 2026-02-17T08:55:51.141 INFO:teuthology.orchestra.run.trial025.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.2.3-705-g04cf6dd4-1jammy [798 kB] 2026-02-17T08:55:51.153 INFO:teuthology.orchestra.run.trial025.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.2.3-705-g04cf6dd4-1jammy [157 kB] 2026-02-17T08:55:51.156 INFO:teuthology.orchestra.run.trial025.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.2.3-705-g04cf6dd4-1jammy [2396 kB] 2026-02-17T08:55:51.160 INFO:teuthology.orchestra.run.trial025.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-17T08:55:51.163 INFO:teuthology.orchestra.run.trial025.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-17T08:55:51.163 INFO:teuthology.orchestra.run.trial025.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-17T08:55:51.164 INFO:teuthology.orchestra.run.trial025.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-17T08:55:51.196 INFO:teuthology.orchestra.run.trial025.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.2.3-705-g04cf6dd4-1jammy [8625 kB] 2026-02-17T08:55:51.233 INFO:teuthology.orchestra.run.trial025.stdout:Get:73 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-17T08:55:51.235 INFO:teuthology.orchestra.run.trial025.stdout:Get:74 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-17T08:55:51.235 INFO:teuthology.orchestra.run.trial025.stdout:Get:75 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-17T08:55:51.255 INFO:teuthology.orchestra.run.trial025.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-17T08:55:51.256 INFO:teuthology.orchestra.run.trial025.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-17T08:55:51.256 INFO:teuthology.orchestra.run.trial025.stdout:Get:78 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-17T08:55:51.305 INFO:teuthology.orchestra.run.trial025.stdout:Get:79 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-17T08:55:51.305 INFO:teuthology.orchestra.run.trial025.stdout:Get:80 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-17T08:55:51.306 INFO:teuthology.orchestra.run.trial025.stdout:Get:81 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-17T08:55:51.309 INFO:teuthology.orchestra.run.trial025.stdout:Get:82 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-17T08:55:51.338 INFO:teuthology.orchestra.run.trial025.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.2.3-705-g04cf6dd4-1jammy [14.3 kB] 2026-02-17T08:55:51.339 INFO:teuthology.orchestra.run.trial025.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.2.3-705-g04cf6dd4-1jammy [52.1 MB] 2026-02-17T08:55:51.377 INFO:teuthology.orchestra.run.trial025.stdout:Get:85 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-17T08:55:51.378 INFO:teuthology.orchestra.run.trial025.stdout:Get:86 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-17T08:55:51.379 INFO:teuthology.orchestra.run.trial025.stdout:Get:87 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-17T08:55:51.382 INFO:teuthology.orchestra.run.trial025.stdout:Get:88 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-17T08:55:51.385 INFO:teuthology.orchestra.run.trial025.stdout:Get:89 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2026-02-17T08:55:51.386 INFO:teuthology.orchestra.run.trial025.stdout:Get:90 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2026-02-17T08:55:51.449 INFO:teuthology.orchestra.run.trial025.stdout:Get:91 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-17T08:55:51.454 INFO:teuthology.orchestra.run.trial025.stdout:Get:92 https://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2026-02-17T08:55:51.454 INFO:teuthology.orchestra.run.trial025.stdout:Get:93 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-17T08:55:51.458 INFO:teuthology.orchestra.run.trial025.stdout:Get:94 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-17T08:55:51.522 INFO:teuthology.orchestra.run.trial025.stdout:Get:95 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2026-02-17T08:55:51.522 INFO:teuthology.orchestra.run.trial025.stdout:Get:96 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-17T08:55:51.522 INFO:teuthology.orchestra.run.trial025.stdout:Get:97 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-17T08:55:51.524 INFO:teuthology.orchestra.run.trial025.stdout:Get:98 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-17T08:55:51.524 INFO:teuthology.orchestra.run.trial025.stdout:Get:99 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-17T08:55:51.532 INFO:teuthology.orchestra.run.trial025.stdout:Get:100 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2026-02-17T08:55:51.594 INFO:teuthology.orchestra.run.trial025.stdout:Get:101 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-17T08:55:51.594 INFO:teuthology.orchestra.run.trial025.stdout:Get:102 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-17T08:55:51.596 INFO:teuthology.orchestra.run.trial025.stdout:Get:103 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-17T08:55:51.596 INFO:teuthology.orchestra.run.trial025.stdout:Get:104 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-17T08:55:52.199 INFO:teuthology.orchestra.run.trial025.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.2.3-705-g04cf6dd4-1jammy [135 kB] 2026-02-17T08:55:52.200 INFO:teuthology.orchestra.run.trial025.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.2.3-705-g04cf6dd4-1jammy [41.0 kB] 2026-02-17T08:55:52.201 INFO:teuthology.orchestra.run.trial025.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.2.3-705-g04cf6dd4-1jammy [13.7 MB] 2026-02-17T08:55:52.420 INFO:teuthology.orchestra.run.trial025.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.2.3-705-g04cf6dd4-1jammy [92.1 kB] 2026-02-17T08:55:52.736 INFO:teuthology.orchestra.run.trial025.stdout:Fetched 178 MB in 3s (64.8 MB/s) 2026-02-17T08:55:52.752 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-17T08:55:52.908 INFO:teuthology.orchestra.run.trial025.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-17T08:55:52.910 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-17T08:55:52.911 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T08:55:52.932 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-17T08:55:52.945 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-17T08:55:52.946 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T08:55:52.960 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-17T08:55:52.972 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-17T08:55:52.973 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T08:55:52.993 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-17T08:55:53.001 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T08:55:53.006 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:55:53.045 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-17T08:55:53.052 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T08:55:53.053 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:55:53.069 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-17T08:55:53.077 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T08:55:53.077 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:55:53.096 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-17T08:55:53.105 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-17T08:55:53.105 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T08:55:53.121 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package librados2. 2026-02-17T08:55:53.129 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../007-librados2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:53.129 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking librados2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:53.169 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libnbd0. 2026-02-17T08:55:53.177 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2026-02-17T08:55:53.177 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-17T08:55:53.191 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package librbd1. 2026-02-17T08:55:53.199 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../009-librbd1_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:53.200 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking librbd1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:53.242 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libcephfs2. 2026-02-17T08:55:53.250 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../010-libcephfs2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:53.250 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libcephfs2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:53.271 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-rados. 2026-02-17T08:55:53.279 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../011-python3-rados_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:53.280 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-rados (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:53.296 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-17T08:55:53.304 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:55:53.305 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-ceph-argparse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:53.319 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-cephfs. 2026-02-17T08:55:53.327 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../013-python3-cephfs_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:53.328 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-cephfs (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:53.343 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-17T08:55:53.351 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../014-python3-ceph-common_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:55:53.351 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:53.368 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-17T08:55:53.376 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-17T08:55:53.376 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T08:55:53.392 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-prettytable. 2026-02-17T08:55:53.401 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2026-02-17T08:55:53.401 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-17T08:55:53.415 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-rbd. 2026-02-17T08:55:53.424 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../017-python3-rbd_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:53.424 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-rbd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:53.442 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-17T08:55:53.450 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-17T08:55:53.450 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T08:55:53.468 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libreadline-dev:amd64. 2026-02-17T08:55:53.476 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2026-02-17T08:55:53.477 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T08:55:53.495 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2026-02-17T08:55:53.503 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2026-02-17T08:55:53.503 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T08:55:53.520 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package lua5.1. 2026-02-17T08:55:53.529 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2026-02-17T08:55:53.529 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2026-02-17T08:55:53.548 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package lua-any. 2026-02-17T08:55:53.556 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2026-02-17T08:55:53.557 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking lua-any (27ubuntu1) ... 2026-02-17T08:55:53.570 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package zip. 2026-02-17T08:55:53.578 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2026-02-17T08:55:53.579 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking zip (3.0-12build2) ... 2026-02-17T08:55:53.595 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package unzip. 2026-02-17T08:55:53.603 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2026-02-17T08:55:53.603 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2026-02-17T08:55:53.620 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package luarocks. 2026-02-17T08:55:53.628 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2026-02-17T08:55:53.628 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2026-02-17T08:55:53.666 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package librgw2. 2026-02-17T08:55:53.674 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../026-librgw2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:53.674 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking librgw2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:53.749 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-rgw. 2026-02-17T08:55:53.758 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../027-python3-rgw_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:53.758 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-rgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:53.773 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-17T08:55:53.781 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../028-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-17T08:55:53.781 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T08:55:53.796 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libradosstriper1. 2026-02-17T08:55:53.804 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../029-libradosstriper1_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:53.805 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libradosstriper1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:53.823 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-common. 2026-02-17T08:55:53.831 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../030-ceph-common_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:53.832 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:54.047 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-base. 2026-02-17T08:55:54.056 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../031-ceph-base_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:54.061 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-base (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:54.124 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-17T08:55:54.133 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-17T08:55:54.133 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-17T08:55:54.148 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-cheroot. 2026-02-17T08:55:54.156 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-17T08:55:54.157 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T08:55:54.174 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-17T08:55:54.183 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-17T08:55:54.183 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-17T08:55:54.197 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-17T08:55:54.206 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-17T08:55:54.206 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-17T08:55:54.220 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-17T08:55:54.228 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-17T08:55:54.229 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-17T08:55:54.242 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-tempora. 2026-02-17T08:55:54.250 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2026-02-17T08:55:54.250 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-17T08:55:54.265 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-portend. 2026-02-17T08:55:54.273 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2026-02-17T08:55:54.274 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-17T08:55:54.288 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-17T08:55:54.296 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-17T08:55:54.297 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-17T08:55:54.311 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-17T08:55:54.319 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-17T08:55:54.319 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-17T08:55:54.341 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-natsort. 2026-02-17T08:55:54.349 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2026-02-17T08:55:54.349 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-17T08:55:54.365 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-logutils. 2026-02-17T08:55:54.373 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2026-02-17T08:55:54.374 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-logutils (0.3.3-8) ... 2026-02-17T08:55:54.388 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-mako. 2026-02-17T08:55:54.396 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2026-02-17T08:55:54.396 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T08:55:54.413 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-simplegeneric. 2026-02-17T08:55:54.421 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2026-02-17T08:55:54.422 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2026-02-17T08:55:54.436 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-singledispatch. 2026-02-17T08:55:54.444 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2026-02-17T08:55:54.444 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2026-02-17T08:55:54.458 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-webob. 2026-02-17T08:55:54.466 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-17T08:55:54.466 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T08:55:54.484 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-waitress. 2026-02-17T08:55:54.491 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1.1_all.deb ... 2026-02-17T08:55:54.493 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T08:55:54.509 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-tempita. 2026-02-17T08:55:54.517 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2026-02-17T08:55:54.517 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T08:55:54.532 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-paste. 2026-02-17T08:55:54.539 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2026-02-17T08:55:54.540 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T08:55:54.567 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2026-02-17T08:55:54.575 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2026-02-17T08:55:54.575 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T08:55:54.589 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-pastedeploy. 2026-02-17T08:55:54.597 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2026-02-17T08:55:54.598 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2026-02-17T08:55:54.613 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-webtest. 2026-02-17T08:55:54.621 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2026-02-17T08:55:54.622 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-webtest (2.0.35-1) ... 2026-02-17T08:55:54.637 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-pecan. 2026-02-17T08:55:54.645 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2026-02-17T08:55:54.645 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T08:55:54.670 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-werkzeug. 2026-02-17T08:55:54.678 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.3_all.deb ... 2026-02-17T08:55:54.679 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T08:55:54.698 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-17T08:55:54.706 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:55:54.706 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-mgr-modules-core (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:54.734 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-17T08:55:54.743 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:54.743 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libsqlite3-mod-ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:54.759 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-mgr. 2026-02-17T08:55:54.767 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../057-ceph-mgr_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:54.768 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-mgr (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:54.790 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-mon. 2026-02-17T08:55:54.798 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../058-ceph-mon_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:54.798 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-mon (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:54.856 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-17T08:55:54.865 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../059-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-17T08:55:54.865 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T08:55:54.881 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-osd. 2026-02-17T08:55:54.889 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../060-ceph-osd_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:54.890 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-osd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:55.042 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph. 2026-02-17T08:55:55.050 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../061-ceph_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:55.051 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:55.064 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-fuse. 2026-02-17T08:55:55.072 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../062-ceph-fuse_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:55.072 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:55.096 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-mds. 2026-02-17T08:55:55.105 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../063-ceph-mds_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:55.105 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-mds (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:55.138 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package cephadm. 2026-02-17T08:55:55.146 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../064-cephadm_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:55.146 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:55.162 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-17T08:55:55.170 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T08:55:55.171 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T08:55:55.191 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-17T08:55:55.200 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../066-ceph-mgr-cephadm_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:55:55.200 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-mgr-cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:55.220 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-17T08:55:55.229 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../067-python3-repoze.lru_0.7-2_all.deb ... 2026-02-17T08:55:55.229 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-17T08:55:55.244 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-routes. 2026-02-17T08:55:55.252 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../068-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-17T08:55:55.253 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T08:55:55.273 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-17T08:55:55.281 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../069-ceph-mgr-dashboard_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:55:55.281 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-mgr-dashboard (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:55.489 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-17T08:55:55.498 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-17T08:55:55.498 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T08:55:55.537 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-joblib. 2026-02-17T08:55:55.545 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../071-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-17T08:55:55.545 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T08:55:55.571 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-17T08:55:55.580 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../072-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-17T08:55:55.580 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-17T08:55:55.595 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-sklearn. 2026-02-17T08:55:55.603 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../073-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-17T08:55:55.603 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T08:55:55.686 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-17T08:55:55.694 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../074-ceph-mgr-diskprediction-local_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:55:55.695 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-mgr-diskprediction-local (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:55.860 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-cachetools. 2026-02-17T08:55:55.869 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../075-python3-cachetools_5.0.0-1_all.deb ... 2026-02-17T08:55:55.869 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-17T08:55:55.883 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-rsa. 2026-02-17T08:55:55.892 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../076-python3-rsa_4.8-1_all.deb ... 2026-02-17T08:55:55.892 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-17T08:55:55.909 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-google-auth. 2026-02-17T08:55:55.918 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-3_all.deb ... 2026-02-17T08:55:55.918 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-17T08:55:55.935 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-17T08:55:55.944 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-17T08:55:55.944 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T08:55:55.959 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-websocket. 2026-02-17T08:55:55.966 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../079-python3-websocket_1.2.3-1_all.deb ... 2026-02-17T08:55:55.967 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-17T08:55:55.984 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-17T08:55:55.993 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../080-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-17T08:55:55.993 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T08:55:56.087 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-17T08:55:56.096 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:55:56.097 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-mgr-k8sevents (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:56.110 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-17T08:55:56.119 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../082-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-17T08:55:56.126 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T08:55:56.142 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-17T08:55:56.150 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../083-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T08:55:56.151 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T08:55:56.165 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package jq. 2026-02-17T08:55:56.173 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../084-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T08:55:56.174 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-17T08:55:56.186 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package socat. 2026-02-17T08:55:56.195 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../085-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-17T08:55:56.196 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-17T08:55:56.214 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package xmlstarlet. 2026-02-17T08:55:56.222 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-17T08:55:56.223 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-17T08:55:56.258 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-test. 2026-02-17T08:55:56.267 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../087-ceph-test_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:56.267 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-test (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:56.740 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package ceph-volume. 2026-02-17T08:55:56.749 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../088-ceph-volume_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T08:55:56.749 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking ceph-volume (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:56.772 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-17T08:55:56.781 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../089-libcephfs-dev_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:56.781 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking libcephfs-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:56.796 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package lua-socket:amd64. 2026-02-17T08:55:56.804 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../090-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2026-02-17T08:55:56.805 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T08:55:56.826 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package lua-sec:amd64. 2026-02-17T08:55:56.834 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../091-lua-sec_1.0.2-1_amd64.deb ... 2026-02-17T08:55:56.835 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2026-02-17T08:55:56.851 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package nvme-cli. 2026-02-17T08:55:56.859 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../092-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-17T08:55:56.860 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T08:55:56.890 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package pkg-config. 2026-02-17T08:55:56.899 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../093-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2026-02-17T08:55:56.899 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T08:55:56.915 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-17T08:55:56.924 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../094-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T08:55:56.924 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T08:55:56.953 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-17T08:55:56.962 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../095-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-17T08:55:56.962 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-17T08:55:56.976 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-pastescript. 2026-02-17T08:55:56.985 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../096-python3-pastescript_2.0.2-4_all.deb ... 2026-02-17T08:55:56.985 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2026-02-17T08:55:57.003 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-pluggy. 2026-02-17T08:55:57.012 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../097-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-17T08:55:57.012 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-17T08:55:57.028 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-psutil. 2026-02-17T08:55:57.036 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../098-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-17T08:55:57.036 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-17T08:55:57.054 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-py. 2026-02-17T08:55:57.062 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../099-python3-py_1.10.0-1_all.deb ... 2026-02-17T08:55:57.063 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-17T08:55:57.083 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-pygments. 2026-02-17T08:55:57.092 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../100-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-17T08:55:57.092 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T08:55:57.133 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-pyinotify. 2026-02-17T08:55:57.142 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.3_all.deb ... 2026-02-17T08:55:57.143 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2026-02-17T08:55:57.158 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-toml. 2026-02-17T08:55:57.166 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../102-python3-toml_0.10.2-1_all.deb ... 2026-02-17T08:55:57.167 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-17T08:55:57.182 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-pytest. 2026-02-17T08:55:57.190 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../103-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-17T08:55:57.191 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T08:55:57.213 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package python3-simplejson. 2026-02-17T08:55:57.221 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../104-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-17T08:55:57.222 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-17T08:55:57.238 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-17T08:55:57.247 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../105-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-17T08:55:57.247 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-17T08:55:57.316 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package radosgw. 2026-02-17T08:55:57.325 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../106-radosgw_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:57.325 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking radosgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:57.441 INFO:teuthology.orchestra.run.trial025.stdout:Selecting previously unselected package rbd-fuse. 2026-02-17T08:55:57.449 INFO:teuthology.orchestra.run.trial025.stdout:Preparing to unpack .../107-rbd-fuse_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T08:55:57.450 INFO:teuthology.orchestra.run.trial025.stdout:Unpacking rbd-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:57.479 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-17T08:55:57.548 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T08:55:57.549 INFO:teuthology.orchestra.run.trial025.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T08:55:57.622 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T08:55:57.905 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-17T08:55:58.288 INFO:teuthology.orchestra.run.trial025.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-17T08:55:58.299 INFO:teuthology.orchestra.run.trial025.stdout:Setting up cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:58.341 INFO:teuthology.orchestra.run.trial025.stdout:Adding system user cephadm....done 2026-02-17T08:55:58.350 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T08:55:58.422 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-17T08:55:58.496 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T08:55:58.497 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-17T08:55:58.567 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-17T08:55:58.643 INFO:teuthology.orchestra.run.trial025.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T08:55:58.643 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-17T08:55:58.739 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T08:55:58.863 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-17T08:55:58.938 INFO:teuthology.orchestra.run.trial025.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2026-02-17T08:55:58.949 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2026-02-17T08:55:59.028 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-17T08:55:59.102 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-ceph-argparse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:55:59.169 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T08:55:59.169 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-17T08:55:59.171 INFO:teuthology.orchestra.run.trial025.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T08:55:59.171 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T08:55:59.172 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T08:55:59.173 INFO:teuthology.orchestra.run.trial025.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2026-02-17T08:55:59.191 INFO:teuthology.orchestra.run.trial025.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2026-02-17T08:55:59.193 INFO:teuthology.orchestra.run.trial025.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2026-02-17T08:55:59.194 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T08:55:59.196 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-17T08:55:59.322 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-17T08:55:59.402 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T08:55:59.478 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-17T08:55:59.568 INFO:teuthology.orchestra.run.trial025.stdout:Setting up zip (3.0-12build2) ... 2026-02-17T08:55:59.569 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T08:55:59.824 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T08:55:59.902 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T08:55:59.903 INFO:teuthology.orchestra.run.trial025.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-17T08:55:59.904 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T08:55:59.998 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T08:56:00.123 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T08:56:00.253 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T08:56:00.337 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T08:56:00.445 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-17T08:56:00.520 INFO:teuthology.orchestra.run.trial025.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-17T08:56:00.521 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:00.605 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T08:56:01.113 INFO:teuthology.orchestra.run.trial025.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T08:56:01.133 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:56:01.137 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-17T08:56:01.216 INFO:teuthology.orchestra.run.trial025.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T08:56:01.217 INFO:teuthology.orchestra.run.trial025.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-17T08:56:01.218 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-17T08:56:01.297 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-17T08:56:01.371 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:56:01.372 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-17T08:56:01.452 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2026-02-17T08:56:01.526 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-logutils (0.3.3-8) ... 2026-02-17T08:56:01.604 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-17T08:56:01.680 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2026-02-17T08:56:01.752 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-17T08:56:01.831 INFO:teuthology.orchestra.run.trial025.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T08:56:01.832 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-17T08:56:01.917 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T08:56:01.918 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T08:56:01.995 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T08:56:02.075 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T08:56:02.160 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-17T08:56:02.237 INFO:teuthology.orchestra.run.trial025.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T08:56:02.238 INFO:teuthology.orchestra.run.trial025.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2026-02-17T08:56:02.239 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T08:56:02.239 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T08:56:02.374 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2026-02-17T08:56:02.453 INFO:teuthology.orchestra.run.trial025.stdout:Setting up lua-any (27ubuntu1) ... 2026-02-17T08:56:02.453 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-17T08:56:02.527 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T08:56:02.528 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-17T08:56:02.613 INFO:teuthology.orchestra.run.trial025.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-17T08:56:02.613 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-webtest (2.0.35-1) ... 2026-02-17T08:56:02.697 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-17T08:56:02.830 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-pastescript (2.0.2-4) ... 2026-02-17T08:56:02.923 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T08:56:03.040 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T08:56:03.041 INFO:teuthology.orchestra.run.trial025.stdout:Setting up librados2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:03.042 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libsqlite3-mod-ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:03.043 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T08:56:03.570 INFO:teuthology.orchestra.run.trial025.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2026-02-17T08:56:03.580 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libcephfs2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:03.581 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libradosstriper1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:03.582 INFO:teuthology.orchestra.run.trial025.stdout:Setting up librbd1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:03.583 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-mgr-modules-core (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:03.584 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:03.660 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T08:56:03.660 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T08:56:04.062 INFO:teuthology.orchestra.run.trial025.stdout:Setting up libcephfs-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:04.062 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-rados (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:04.063 INFO:teuthology.orchestra.run.trial025.stdout:Setting up librgw2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:04.064 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-rbd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:04.065 INFO:teuthology.orchestra.run.trial025.stdout:Setting up rbd-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:04.066 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-rgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:04.066 INFO:teuthology.orchestra.run.trial025.stdout:Setting up python3-cephfs (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:04.067 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:04.096 INFO:teuthology.orchestra.run.trial025.stdout:Adding group ceph....done 2026-02-17T08:56:04.130 INFO:teuthology.orchestra.run.trial025.stdout:Adding system user ceph....done 2026-02-17T08:56:04.140 INFO:teuthology.orchestra.run.trial025.stdout:Setting system user ceph properties....done 2026-02-17T08:56:04.145 INFO:teuthology.orchestra.run.trial025.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-17T08:56:04.234 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-17T08:56:04.520 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-17T08:56:04.911 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-test (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:04.911 INFO:teuthology.orchestra.run.trial025.stdout:Setting up radosgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:05.174 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T08:56:05.174 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T08:56:05.566 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-base (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:05.682 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-17T08:56:06.067 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-mds (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:06.127 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T08:56:06.127 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T08:56:06.517 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-mgr (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:06.598 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T08:56:06.598 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T08:56:06.978 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-osd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:07.061 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T08:56:07.061 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T08:56:07.464 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-mgr-k8sevents (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:07.465 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-mgr-diskprediction-local (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:07.477 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-mon (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:07.554 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T08:56:07.554 INFO:teuthology.orchestra.run.trial025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T08:56:07.948 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-mgr-cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:07.959 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:07.960 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-mgr-dashboard (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:07.971 INFO:teuthology.orchestra.run.trial025.stdout:Setting up ceph-volume (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T08:56:08.083 INFO:teuthology.orchestra.run.trial025.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2026-02-17T08:56:08.089 INFO:teuthology.orchestra.run.trial025.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-17T08:56:08.107 INFO:teuthology.orchestra.run.trial025.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-17T08:56:08.131 INFO:teuthology.orchestra.run.trial025.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-17T08:56:08.638 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:08.638 INFO:teuthology.orchestra.run.trial025.stdout:Running kernel seems to be up-to-date. 2026-02-17T08:56:08.638 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:08.638 INFO:teuthology.orchestra.run.trial025.stdout:The processor microcode seems to be up-to-date. 2026-02-17T08:56:08.638 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:08.639 INFO:teuthology.orchestra.run.trial025.stdout:No services need to be restarted. 2026-02-17T08:56:08.639 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:08.639 INFO:teuthology.orchestra.run.trial025.stdout:No containers need to be restarted. 2026-02-17T08:56:08.639 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:08.639 INFO:teuthology.orchestra.run.trial025.stdout:No user sessions are running outdated binaries. 2026-02-17T08:56:08.639 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:08.639 INFO:teuthology.orchestra.run.trial025.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T08:56:09.296 INFO:teuthology.orchestra.run.trial025.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-17T08:56:09.300 DEBUG:teuthology.parallel:result is None 2026-02-17T08:56:09.301 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:56:09.427 DEBUG:teuthology.orchestra.run.trial025:> dpkg-query -W -f '${Version}' ceph 2026-02-17T08:56:09.436 INFO:teuthology.orchestra.run.trial025.stdout:19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:56:09.437 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T08:56:09.437 INFO:teuthology.task.install:The correct ceph version 19.2.3-705-g04cf6dd4-1jammy is installed. 2026-02-17T08:56:09.439 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T08:56:09.439 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:09.439 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T08:56:09.487 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T08:56:09.487 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:09.487 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T08:56:09.538 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T08:56:09.586 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T08:56:09.586 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:09.586 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T08:56:09.635 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T08:56:09.686 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T08:56:09.686 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:09.686 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T08:56:09.735 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T08:56:09.782 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T08:56:09.860 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T08:56:09.860 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 777 /var/log/ceph 2026-02-17T08:56:09.867 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T08:56:09.867 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T08:56:09.918 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T08:56:09.918 DEBUG:teuthology.orchestra.run.trial025:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T08:56:09.977 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T08:56:09.977 INFO:tasks.ceph:config {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T08:56:09.977 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51202', 'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'description': 'rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51202', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid'}, 'ceph': {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'workunit': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 3603, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'targets': {'trial025.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGgSf3Mf0SMWohTpVAtJqzO4WEK0MvVgl7p+ItsSZGWQB/NidB4jWewYRDB4sJLiM8PH+loyvZMWKfQO99+bPZY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)'], 'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'cluster': 'ceph'}}, {'workunit': {'clients': {'all': ['cephtool/test_kvstore_tool.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:03:08', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T08:56:09.978 DEBUG:teuthology.orchestra.run.trial025:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T08:56:10.010 DEBUG:teuthology.orchestra.run.trial025:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T08:56:10.059 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:10.059 DEBUG:teuthology.orchestra.run.trial025:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T08:56:10.107 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T08:56:10.107 DEBUG:teuthology.orchestra.run.trial025:> stat /dev/vg_nvme/lv_1 2026-02-17T08:56:10.154 INFO:teuthology.orchestra.run.trial025.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T08:56:10.155 INFO:teuthology.orchestra.run.trial025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:56:10.155 INFO:teuthology.orchestra.run.trial025.stdout:Device: 5h/5d Inode: 905 Links: 1 2026-02-17T08:56:10.155 INFO:teuthology.orchestra.run.trial025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:56:10.155 INFO:teuthology.orchestra.run.trial025.stdout:Access: 2026-02-17 08:55:27.789232876 +0000 2026-02-17T08:56:10.155 INFO:teuthology.orchestra.run.trial025.stdout:Modify: 2026-02-17 08:55:27.653237214 +0000 2026-02-17T08:56:10.155 INFO:teuthology.orchestra.run.trial025.stdout:Change: 2026-02-17 08:55:27.653237214 +0000 2026-02-17T08:56:10.155 INFO:teuthology.orchestra.run.trial025.stdout: Birth: - 2026-02-17T08:56:10.156 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T08:56:10.205 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records in 2026-02-17T08:56:10.206 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records out 2026-02-17T08:56:10.206 INFO:teuthology.orchestra.run.trial025.stderr:512 bytes copied, 0.00017924 s, 2.9 MB/s 2026-02-17T08:56:10.207 DEBUG:teuthology.orchestra.run.trial025:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T08:56:10.256 DEBUG:teuthology.orchestra.run.trial025:> stat /dev/vg_nvme/lv_2 2026-02-17T08:56:10.303 INFO:teuthology.orchestra.run.trial025.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T08:56:10.304 INFO:teuthology.orchestra.run.trial025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:56:10.304 INFO:teuthology.orchestra.run.trial025.stdout:Device: 5h/5d Inode: 929 Links: 1 2026-02-17T08:56:10.304 INFO:teuthology.orchestra.run.trial025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:56:10.304 INFO:teuthology.orchestra.run.trial025.stdout:Access: 2026-02-17 08:55:28.109222669 +0000 2026-02-17T08:56:10.304 INFO:teuthology.orchestra.run.trial025.stdout:Modify: 2026-02-17 08:55:27.937228156 +0000 2026-02-17T08:56:10.304 INFO:teuthology.orchestra.run.trial025.stdout:Change: 2026-02-17 08:55:27.937228156 +0000 2026-02-17T08:56:10.305 INFO:teuthology.orchestra.run.trial025.stdout: Birth: - 2026-02-17T08:56:10.305 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T08:56:10.354 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records in 2026-02-17T08:56:10.354 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records out 2026-02-17T08:56:10.354 INFO:teuthology.orchestra.run.trial025.stderr:512 bytes copied, 0.000169582 s, 3.0 MB/s 2026-02-17T08:56:10.355 DEBUG:teuthology.orchestra.run.trial025:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T08:56:10.404 DEBUG:teuthology.orchestra.run.trial025:> stat /dev/vg_nvme/lv_3 2026-02-17T08:56:10.451 INFO:teuthology.orchestra.run.trial025.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T08:56:10.452 INFO:teuthology.orchestra.run.trial025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:56:10.452 INFO:teuthology.orchestra.run.trial025.stdout:Device: 5h/5d Inode: 962 Links: 1 2026-02-17T08:56:10.452 INFO:teuthology.orchestra.run.trial025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:56:10.452 INFO:teuthology.orchestra.run.trial025.stdout:Access: 2026-02-17 08:55:28.433212335 +0000 2026-02-17T08:56:10.452 INFO:teuthology.orchestra.run.trial025.stdout:Modify: 2026-02-17 08:55:28.269217567 +0000 2026-02-17T08:56:10.453 INFO:teuthology.orchestra.run.trial025.stdout:Change: 2026-02-17 08:55:28.269217567 +0000 2026-02-17T08:56:10.453 INFO:teuthology.orchestra.run.trial025.stdout: Birth: - 2026-02-17T08:56:10.453 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T08:56:10.501 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records in 2026-02-17T08:56:10.502 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records out 2026-02-17T08:56:10.502 INFO:teuthology.orchestra.run.trial025.stderr:512 bytes copied, 0.000185943 s, 2.8 MB/s 2026-02-17T08:56:10.503 DEBUG:teuthology.orchestra.run.trial025:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T08:56:10.552 DEBUG:teuthology.orchestra.run.trial025:> stat /dev/vg_nvme/lv_4 2026-02-17T08:56:10.600 INFO:teuthology.orchestra.run.trial025.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T08:56:10.600 INFO:teuthology.orchestra.run.trial025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:56:10.600 INFO:teuthology.orchestra.run.trial025.stdout:Device: 5h/5d Inode: 975 Links: 1 2026-02-17T08:56:10.600 INFO:teuthology.orchestra.run.trial025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:56:10.600 INFO:teuthology.orchestra.run.trial025.stdout:Access: 2026-02-17 08:55:28.773201491 +0000 2026-02-17T08:56:10.601 INFO:teuthology.orchestra.run.trial025.stdout:Modify: 2026-02-17 08:55:28.597207104 +0000 2026-02-17T08:56:10.601 INFO:teuthology.orchestra.run.trial025.stdout:Change: 2026-02-17 08:55:28.597207104 +0000 2026-02-17T08:56:10.601 INFO:teuthology.orchestra.run.trial025.stdout: Birth: - 2026-02-17T08:56:10.602 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T08:56:10.650 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records in 2026-02-17T08:56:10.650 INFO:teuthology.orchestra.run.trial025.stderr:1+0 records out 2026-02-17T08:56:10.650 INFO:teuthology.orchestra.run.trial025.stderr:512 bytes copied, 0.000176455 s, 2.9 MB/s 2026-02-17T08:56:10.651 DEBUG:teuthology.orchestra.run.trial025:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T08:56:10.700 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T08:56:10.700 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial025.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T08:56:10.700 INFO:tasks.ceph:Generating config... 2026-02-17T08:56:10.703 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-17T08:56:10.703 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T08:56:10.703 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T08:56:10.703 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T08:56:10.704 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T08:56:10.704 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T08:56:10.704 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T08:56:10.704 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T08:56:10.704 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T08:56:10.704 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T08:56:10.704 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T08:56:10.704 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T08:56:10.704 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T08:56:10.705 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T08:56:10.705 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T08:56:10.705 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T08:56:10.705 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T08:56:10.706 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T08:56:10.759 INFO:teuthology.orchestra.run.trial025.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T08:56:10.762 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T08:56:10.822 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T08:56:10.870 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.25')] 2026-02-17T08:56:10.871 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.25', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd mclock override recovery settings': True, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-17T08:56:10.872 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:10.873 DEBUG:teuthology.orchestra.run.trial025:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T08:56:10.915 DEBUG:teuthology.orchestra.run.trial025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.25 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:56:10.975 INFO:teuthology.orchestra.run.trial025.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:56:10.975 INFO:teuthology.orchestra.run.trial025.stdout:monmaptool: generated fsid 90e8bae8-9779-40e8-823a-3b5cb1d90003 2026-02-17T08:56:10.975 INFO:teuthology.orchestra.run.trial025.stdout:setting min_mon_release = quincy 2026-02-17T08:56:10.975 INFO:teuthology.orchestra.run.trial025.stdout:epoch 0 2026-02-17T08:56:10.975 INFO:teuthology.orchestra.run.trial025.stdout:fsid 90e8bae8-9779-40e8-823a-3b5cb1d90003 2026-02-17T08:56:10.975 INFO:teuthology.orchestra.run.trial025.stdout:last_changed 2026-02-17T08:56:10.973458+0000 2026-02-17T08:56:10.976 INFO:teuthology.orchestra.run.trial025.stdout:created 2026-02-17T08:56:10.973458+0000 2026-02-17T08:56:10.976 INFO:teuthology.orchestra.run.trial025.stdout:min_mon_release 17 (quincy) 2026-02-17T08:56:10.976 INFO:teuthology.orchestra.run.trial025.stdout:election_strategy: 3 2026-02-17T08:56:10.976 INFO:teuthology.orchestra.run.trial025.stdout:0: [v2:10.20.193.25:3300/0,v1:10.20.193.25:6789/0] mon.a 2026-02-17T08:56:10.976 INFO:teuthology.orchestra.run.trial025.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-17T08:56:10.977 DEBUG:teuthology.orchestra.run.trial025:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T08:56:11.022 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 90e8bae8-9779-40e8-823a-3b5cb1d90003... 2026-02-17T08:56:11.023 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T08:56:11.081 INFO:teuthology.orchestra.run.trial025.stdout:[global] 2026-02-17T08:56:11.082 INFO:teuthology.orchestra.run.trial025.stdout: chdir = "" 2026-02-17T08:56:11.082 INFO:teuthology.orchestra.run.trial025.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T08:56:11.082 INFO:teuthology.orchestra.run.trial025.stdout: auth supported = cephx 2026-02-17T08:56:11.082 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.082 INFO:teuthology.orchestra.run.trial025.stdout: filestore xattr use omap = true 2026-02-17T08:56:11.082 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.082 INFO:teuthology.orchestra.run.trial025.stdout: mon clock drift allowed = 1.000 2026-02-17T08:56:11.082 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.082 INFO:teuthology.orchestra.run.trial025.stdout: osd crush chooseleaf type = 0 2026-02-17T08:56:11.083 INFO:teuthology.orchestra.run.trial025.stdout: auth debug = true 2026-02-17T08:56:11.083 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.083 INFO:teuthology.orchestra.run.trial025.stdout: ms die on old message = true 2026-02-17T08:56:11.083 INFO:teuthology.orchestra.run.trial025.stdout: ms die on bug = true 2026-02-17T08:56:11.083 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.083 INFO:teuthology.orchestra.run.trial025.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T08:56:11.083 INFO:teuthology.orchestra.run.trial025.stdout: mon pg warn max object skew = 0 2026-02-17T08:56:11.083 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.083 INFO:teuthology.orchestra.run.trial025.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T08:56:11.083 INFO:teuthology.orchestra.run.trial025.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T08:56:11.083 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.083 INFO:teuthology.orchestra.run.trial025.stdout: osd pool default size = 2 2026-02-17T08:56:11.084 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.084 INFO:teuthology.orchestra.run.trial025.stdout: mon osd allow primary affinity = true 2026-02-17T08:56:11.084 INFO:teuthology.orchestra.run.trial025.stdout: mon osd allow pg remap = true 2026-02-17T08:56:11.084 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on legacy crush tunables = false 2026-02-17T08:56:11.084 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on crush straw calc version zero = false 2026-02-17T08:56:11.084 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on no sortbitwise = false 2026-02-17T08:56:11.084 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on osd down out interval zero = false 2026-02-17T08:56:11.084 INFO:teuthology.orchestra.run.trial025.stdout: mon warn on too few osds = false 2026-02-17T08:56:11.084 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T08:56:11.084 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T08:56:11.084 INFO:teuthology.orchestra.run.trial025.stdout: mon_allow_pool_size_one = true 2026-02-17T08:56:11.084 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.085 INFO:teuthology.orchestra.run.trial025.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T08:56:11.085 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.085 INFO:teuthology.orchestra.run.trial025.stdout: osd default data pool replay window = 5 2026-02-17T08:56:11.085 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.085 INFO:teuthology.orchestra.run.trial025.stdout: mon allow pool delete = true 2026-02-17T08:56:11.085 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.085 INFO:teuthology.orchestra.run.trial025.stdout: mon cluster log file level = debug 2026-02-17T08:56:11.085 INFO:teuthology.orchestra.run.trial025.stdout: debug asserts on shutdown = true 2026-02-17T08:56:11.085 INFO:teuthology.orchestra.run.trial025.stdout: mon health detail to clog = false 2026-02-17T08:56:11.085 INFO:teuthology.orchestra.run.trial025.stdout: mon host = 10.20.193.25 2026-02-17T08:56:11.085 INFO:teuthology.orchestra.run.trial025.stdout: mon election default strategy = 3 2026-02-17T08:56:11.085 INFO:teuthology.orchestra.run.trial025.stdout: fsid = 90e8bae8-9779-40e8-823a-3b5cb1d90003 2026-02-17T08:56:11.085 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.086 INFO:teuthology.orchestra.run.trial025.stdout:[osd] 2026-02-17T08:56:11.086 INFO:teuthology.orchestra.run.trial025.stdout: osd journal size = 100 2026-02-17T08:56:11.086 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.086 INFO:teuthology.orchestra.run.trial025.stdout: osd scrub load threshold = 5.0 2026-02-17T08:56:11.086 INFO:teuthology.orchestra.run.trial025.stdout: osd scrub max interval = 600 2026-02-17T08:56:11.086 INFO:teuthology.orchestra.run.trial025.stdout: osd mclock profile = high_recovery_ops 2026-02-17T08:56:11.086 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.086 INFO:teuthology.orchestra.run.trial025.stdout: osd recover clone overlap = true 2026-02-17T08:56:11.086 INFO:teuthology.orchestra.run.trial025.stdout: osd recovery max chunk = 1048576 2026-02-17T08:56:11.086 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.086 INFO:teuthology.orchestra.run.trial025.stdout: osd debug shutdown = true 2026-02-17T08:56:11.086 INFO:teuthology.orchestra.run.trial025.stdout: osd debug op order = true 2026-02-17T08:56:11.087 INFO:teuthology.orchestra.run.trial025.stdout: osd debug verify stray on activate = true 2026-02-17T08:56:11.087 INFO:teuthology.orchestra.run.trial025.stdout: osd debug trim objects = true 2026-02-17T08:56:11.087 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.087 INFO:teuthology.orchestra.run.trial025.stdout: osd open classes on start = true 2026-02-17T08:56:11.087 INFO:teuthology.orchestra.run.trial025.stdout: osd debug pg log writeout = true 2026-02-17T08:56:11.087 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.087 INFO:teuthology.orchestra.run.trial025.stdout: osd deep scrub update digest min age = 30 2026-02-17T08:56:11.087 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.087 INFO:teuthology.orchestra.run.trial025.stdout: osd map max advance = 10 2026-02-17T08:56:11.087 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.087 INFO:teuthology.orchestra.run.trial025.stdout: journal zero on create = true 2026-02-17T08:56:11.087 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.088 INFO:teuthology.orchestra.run.trial025.stdout: filestore ondisk finisher threads = 3 2026-02-17T08:56:11.088 INFO:teuthology.orchestra.run.trial025.stdout: filestore apply finisher threads = 3 2026-02-17T08:56:11.088 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.088 INFO:teuthology.orchestra.run.trial025.stdout: bdev debug aio = true 2026-02-17T08:56:11.088 INFO:teuthology.orchestra.run.trial025.stdout: osd debug misdirected ops = true 2026-02-17T08:56:11.088 INFO:teuthology.orchestra.run.trial025.stdout: bluestore zero block detection = True 2026-02-17T08:56:11.088 INFO:teuthology.orchestra.run.trial025.stdout: debug ms = 1 2026-02-17T08:56:11.088 INFO:teuthology.orchestra.run.trial025.stdout: debug osd = 20 2026-02-17T08:56:11.088 INFO:teuthology.orchestra.run.trial025.stdout: osd debug verify cached snaps = True 2026-02-17T08:56:11.088 INFO:teuthology.orchestra.run.trial025.stdout: osd debug verify missing on start = True 2026-02-17T08:56:11.088 INFO:teuthology.orchestra.run.trial025.stdout: osd mclock override recovery settings = True 2026-02-17T08:56:11.088 INFO:teuthology.orchestra.run.trial025.stdout: osd op queue = debug_random 2026-02-17T08:56:11.088 INFO:teuthology.orchestra.run.trial025.stdout: osd op queue cut off = debug_random 2026-02-17T08:56:11.089 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.089 INFO:teuthology.orchestra.run.trial025.stdout:[mgr] 2026-02-17T08:56:11.089 INFO:teuthology.orchestra.run.trial025.stdout: debug ms = 1 2026-02-17T08:56:11.089 INFO:teuthology.orchestra.run.trial025.stdout: debug mgr = 20 2026-02-17T08:56:11.089 INFO:teuthology.orchestra.run.trial025.stdout: debug mon = 20 2026-02-17T08:56:11.089 INFO:teuthology.orchestra.run.trial025.stdout: debug auth = 20 2026-02-17T08:56:11.089 INFO:teuthology.orchestra.run.trial025.stdout: mon reweight min pgs per osd = 4 2026-02-17T08:56:11.089 INFO:teuthology.orchestra.run.trial025.stdout: mon reweight min bytes per osd = 10 2026-02-17T08:56:11.089 INFO:teuthology.orchestra.run.trial025.stdout: mgr/telemetry/nag = false 2026-02-17T08:56:11.089 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.089 INFO:teuthology.orchestra.run.trial025.stdout:[mon] 2026-02-17T08:56:11.089 INFO:teuthology.orchestra.run.trial025.stdout: debug ms = 1 2026-02-17T08:56:11.089 INFO:teuthology.orchestra.run.trial025.stdout: debug mon = 20 2026-02-17T08:56:11.090 INFO:teuthology.orchestra.run.trial025.stdout: debug paxos = 20 2026-02-17T08:56:11.090 INFO:teuthology.orchestra.run.trial025.stdout: debug auth = 20 2026-02-17T08:56:11.090 INFO:teuthology.orchestra.run.trial025.stdout: mon data avail warn = 5 2026-02-17T08:56:11.090 INFO:teuthology.orchestra.run.trial025.stdout: mon mgr mkfs grace = 240 2026-02-17T08:56:11.090 INFO:teuthology.orchestra.run.trial025.stdout: mon reweight min pgs per osd = 4 2026-02-17T08:56:11.090 INFO:teuthology.orchestra.run.trial025.stdout: mon osd reporter subtree level = osd 2026-02-17T08:56:11.090 INFO:teuthology.orchestra.run.trial025.stdout: mon osd prime pg temp = true 2026-02-17T08:56:11.090 INFO:teuthology.orchestra.run.trial025.stdout: mon reweight min bytes per osd = 10 2026-02-17T08:56:11.090 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.090 INFO:teuthology.orchestra.run.trial025.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T08:56:11.090 INFO:teuthology.orchestra.run.trial025.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T08:56:11.090 INFO:teuthology.orchestra.run.trial025.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T08:56:11.090 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.091 INFO:teuthology.orchestra.run.trial025.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T08:56:11.091 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T08:56:11.091 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T08:56:11.091 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.091 INFO:teuthology.orchestra.run.trial025.stdout: # 1m isn't quite enough 2026-02-17T08:56:11.091 INFO:teuthology.orchestra.run.trial025.stdout: mon_down_mkfs_grace = 2m 2026-02-17T08:56:11.091 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.091 INFO:teuthology.orchestra.run.trial025.stdout: mon_warn_on_filestore_osds = false 2026-02-17T08:56:11.091 INFO:teuthology.orchestra.run.trial025.stdout: mon scrub interval = 300 2026-02-17T08:56:11.091 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:11.091 INFO:teuthology.orchestra.run.trial025.stdout:[client] 2026-02-17T08:56:11.091 INFO:teuthology.orchestra.run.trial025.stdout: rgw cache enabled = true 2026-02-17T08:56:11.091 INFO:teuthology.orchestra.run.trial025.stdout: rgw enable ops log = true 2026-02-17T08:56:11.092 INFO:teuthology.orchestra.run.trial025.stdout: rgw enable usage log = true 2026-02-17T08:56:11.092 INFO:teuthology.orchestra.run.trial025.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T08:56:11.092 INFO:teuthology.orchestra.run.trial025.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T08:56:11.092 INFO:teuthology.orchestra.run.trial025.stdout:[mon.a] 2026-02-17T08:56:11.093 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T08:56:11.093 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T08:56:11.157 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T08:56:11.157 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:11.157 DEBUG:teuthology.orchestra.run.trial025:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T08:56:11.202 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:11.202 DEBUG:teuthology.orchestra.run.trial025:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T08:56:11.247 INFO:tasks.ceph:Sending monmap to node ubuntu@trial025.front.sepia.ceph.com 2026-02-17T08:56:11.247 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:11.247 DEBUG:teuthology.orchestra.run.trial025:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T08:56:11.247 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T08:56:11.305 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:11.306 DEBUG:teuthology.orchestra.run.trial025:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:56:11.350 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T08:56:11.351 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T08:56:11.351 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T08:56:11.412 INFO:teuthology.orchestra.run.trial025.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T08:56:11.414 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T08:56:11.415 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T08:56:11.415 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T08:56:11.476 INFO:teuthology.orchestra.run.trial025.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T08:56:11.484 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T08:56:11.484 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial025.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T08:56:11.485 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T08:56:11.534 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T08:56:11.534 INFO:tasks.ceph:role: osd.0 2026-02-17T08:56:11.535 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial025.front.sepia.ceph.com 2026-02-17T08:56:11.535 DEBUG:teuthology.orchestra.run.trial025:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T08:56:11.584 INFO:teuthology.orchestra.run.trial025.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T08:56:11.584 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T08:56:11.584 INFO:teuthology.orchestra.run.trial025.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T08:56:11.584 INFO:teuthology.orchestra.run.trial025.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T08:56:11.584 INFO:teuthology.orchestra.run.trial025.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T08:56:11.584 INFO:teuthology.orchestra.run.trial025.stdout: = sunit=0 swidth=0 blks 2026-02-17T08:56:11.584 INFO:teuthology.orchestra.run.trial025.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T08:56:11.584 INFO:teuthology.orchestra.run.trial025.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T08:56:11.584 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T08:56:11.585 INFO:teuthology.orchestra.run.trial025.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T08:56:12.159 INFO:teuthology.orchestra.run.trial025.stdout:Discarding blocks...Done. 2026-02-17T08:56:12.160 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial025.front.sepia.ceph.com -o noatime 2026-02-17T08:56:12.160 DEBUG:teuthology.orchestra.run.trial025:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T08:56:12.215 DEBUG:teuthology.orchestra.run.trial025:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T08:56:12.264 INFO:teuthology.orchestra.run.trial025.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T08:56:12.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:56:12.266 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T08:56:12.315 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T08:56:12.315 INFO:tasks.ceph:role: osd.1 2026-02-17T08:56:12.315 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial025.front.sepia.ceph.com 2026-02-17T08:56:12.316 DEBUG:teuthology.orchestra.run.trial025:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T08:56:12.368 INFO:teuthology.orchestra.run.trial025.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T08:56:12.369 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T08:56:12.369 INFO:teuthology.orchestra.run.trial025.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T08:56:12.369 INFO:teuthology.orchestra.run.trial025.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T08:56:12.369 INFO:teuthology.orchestra.run.trial025.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T08:56:12.369 INFO:teuthology.orchestra.run.trial025.stdout: = sunit=0 swidth=0 blks 2026-02-17T08:56:12.369 INFO:teuthology.orchestra.run.trial025.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T08:56:12.369 INFO:teuthology.orchestra.run.trial025.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T08:56:12.369 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T08:56:12.369 INFO:teuthology.orchestra.run.trial025.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T08:56:12.934 INFO:teuthology.orchestra.run.trial025.stdout:Discarding blocks...Done. 2026-02-17T08:56:12.935 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial025.front.sepia.ceph.com -o noatime 2026-02-17T08:56:12.936 DEBUG:teuthology.orchestra.run.trial025:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T08:56:12.992 DEBUG:teuthology.orchestra.run.trial025:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T08:56:13.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:56:13.041 INFO:teuthology.orchestra.run.trial025.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T08:56:13.042 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T08:56:13.091 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T08:56:13.091 INFO:tasks.ceph:role: osd.2 2026-02-17T08:56:13.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial025.front.sepia.ceph.com 2026-02-17T08:56:13.091 DEBUG:teuthology.orchestra.run.trial025:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T08:56:13.143 INFO:teuthology.orchestra.run.trial025.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T08:56:13.143 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T08:56:13.144 INFO:teuthology.orchestra.run.trial025.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T08:56:13.144 INFO:teuthology.orchestra.run.trial025.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-17T08:56:13.144 INFO:teuthology.orchestra.run.trial025.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T08:56:13.144 INFO:teuthology.orchestra.run.trial025.stdout: = sunit=0 swidth=0 blks 2026-02-17T08:56:13.144 INFO:teuthology.orchestra.run.trial025.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T08:56:13.144 INFO:teuthology.orchestra.run.trial025.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T08:56:13.144 INFO:teuthology.orchestra.run.trial025.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T08:56:13.144 INFO:teuthology.orchestra.run.trial025.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T08:56:13.708 INFO:teuthology.orchestra.run.trial025.stdout:Discarding blocks...Done. 2026-02-17T08:56:13.709 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial025.front.sepia.ceph.com -o noatime 2026-02-17T08:56:13.710 DEBUG:teuthology.orchestra.run.trial025:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T08:56:13.763 DEBUG:teuthology.orchestra.run.trial025:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T08:56:13.812 INFO:teuthology.orchestra.run.trial025.stderr:sudo: /sbin/restorecon: command not found 2026-02-17T08:56:13.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:56:13.813 DEBUG:teuthology.orchestra.run.trial025:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:56:13.876 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-17T08:56:13.870+0000 7f3b7a8548c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T08:56:13.876 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-17T08:56:13.870+0000 7f3b7a8548c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T08:56:13.876 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-17T08:56:13.870+0000 7f3b7a8548c0 -1 bdev(0x5601fa873800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T08:56:13.877 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-17T08:56:13.870+0000 7f3b7a8548c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T08:56:16.162 DEBUG:teuthology.orchestra.run.trial025:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T08:56:16.216 DEBUG:teuthology.orchestra.run.trial025:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:56:16.279 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-17T08:56:16.274+0000 7f4c0ba7f8c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T08:56:16.280 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-17T08:56:16.274+0000 7f4c0ba7f8c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T08:56:16.280 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-17T08:56:16.274+0000 7f4c0ba7f8c0 -1 bdev(0x5602ac515800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T08:56:16.280 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-17T08:56:16.274+0000 7f4c0ba7f8c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T08:56:18.538 DEBUG:teuthology.orchestra.run.trial025:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T08:56:18.587 DEBUG:teuthology.orchestra.run.trial025:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:56:18.651 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-17T08:56:18.642+0000 7f1349cf68c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T08:56:18.652 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-17T08:56:18.646+0000 7f1349cf68c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T08:56:18.652 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-17T08:56:18.646+0000 7f1349cf68c0 -1 bdev(0x55616b3ad800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T08:56:18.652 INFO:teuthology.orchestra.run.trial025.stderr:2026-02-17T08:56:18.646+0000 7f1349cf68c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T08:56:20.965 DEBUG:teuthology.orchestra.run.trial025:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T08:56:21.015 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T08:56:21.015 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:21.015 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T08:56:21.067 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:21.067 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T08:56:21.119 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:21.119 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T08:56:21.171 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:21.171 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T08:56:21.222 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:21.222 DEBUG:teuthology.orchestra.run.trial025:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T08:56:21.266 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T08:56:21.266 DEBUG:teuthology.orchestra.run.trial025:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T08:56:21.313 INFO:teuthology.orchestra.run.trial025.stdout:[mgr.x] 2026-02-17T08:56:21.313 INFO:teuthology.orchestra.run.trial025.stdout: key = AQArLZRpbwmDGBAAQLiS04taJKZjco3Mvy6E+A== 2026-02-17T08:56:21.314 INFO:teuthology.orchestra.run.trial025.stdout:[osd.0] 2026-02-17T08:56:21.314 INFO:teuthology.orchestra.run.trial025.stdout: key = AQAtLZRpMKwpNBAAAX03jDI5NiaiPBgJ6V/fvQ== 2026-02-17T08:56:21.314 INFO:teuthology.orchestra.run.trial025.stdout:[osd.1] 2026-02-17T08:56:21.314 INFO:teuthology.orchestra.run.trial025.stdout: key = AQAwLZRpX+eOEBAANlPtG4s9eLoS+b84ETy2fQ== 2026-02-17T08:56:21.314 INFO:teuthology.orchestra.run.trial025.stdout:[osd.2] 2026-02-17T08:56:21.314 INFO:teuthology.orchestra.run.trial025.stdout: key = AQAyLZRpA7y5JhAA68z7W96AS1FHDwVbShxK3g== 2026-02-17T08:56:21.314 INFO:teuthology.orchestra.run.trial025.stdout:[client.0] 2026-02-17T08:56:21.314 INFO:teuthology.orchestra.run.trial025.stdout: key = AQArLZRpw4NXHBAAwDCkQ+E5QXYtDOTBS+FK4g== 2026-02-17T08:56:21.314 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T08:56:21.377 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T08:56:21.440 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T08:56:21.504 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T08:56:21.567 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T08:56:21.632 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T08:56:21.632 DEBUG:teuthology.orchestra.run.trial025:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T08:56:21.683 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T08:56:21.751 DEBUG:teuthology.orchestra.run.trial025:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T08:56:21.803 DEBUG:teuthology.orchestra.run.trial025:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:56:21.850 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T08:56:21.850 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T08:56:21.850 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T08:56:21.892 INFO:tasks.ceph.mon.a:Started 2026-02-17T08:56:21.892 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph config set mgr mgr_pool false --force 2026-02-17T08:56:22.025 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T08:56:22.026 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T08:56:22.026 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T08:56:22.028 INFO:tasks.ceph.mgr.x:Started 2026-02-17T08:56:22.028 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T08:56:22.028 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T08:56:22.129 INFO:teuthology.orchestra.run.trial025.stderr:adjusted tunables profile to default 2026-02-17T08:56:22.138 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:22.130+0000 7f627311d280 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T08:56:22.138 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T08:56:22.138 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T08:56:22.138 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:22.138 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T08:56:22.147 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:22.147 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T08:56:22.164 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:22.158+0000 7f627311d280 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T08:56:22.171 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:56:22.172 DEBUG:teuthology.orchestra.run.trial025:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T08:56:22.202 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:22.194+0000 7f627311d280 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T08:56:22.209 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd new 4dccfa76-85be-4e4f-8a52-1b772796b024 0 2026-02-17T08:56:22.290 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:22.282+0000 7f627311d280 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T08:56:22.363 INFO:teuthology.orchestra.run.trial025.stdout:0 2026-02-17T08:56:22.370 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:22.362+0000 7f627311d280 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T08:56:22.373 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd new 7f274425-9478-4110-bd75-2c08e55b9425 1 2026-02-17T08:56:22.407 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:22.398+0000 7f627311d280 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T08:56:22.481 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:22.474+0000 7f627311d280 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T08:56:22.502 INFO:teuthology.orchestra.run.trial025.stdout:1 2026-02-17T08:56:22.512 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd new 0657e5c6-fd18-44da-9cdd-bfab7000ed46 2 2026-02-17T08:56:22.609 INFO:teuthology.orchestra.run.trial025.stdout:2 2026-02-17T08:56:22.618 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T08:56:22.618 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T08:56:22.619 INFO:tasks.ceph.osd.0:Started 2026-02-17T08:56:22.619 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T08:56:22.619 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T08:56:22.620 INFO:tasks.ceph.osd.1:Started 2026-02-17T08:56:22.620 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T08:56:22.620 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T08:56:22.621 INFO:tasks.ceph.osd.2:Started 2026-02-17T08:56:22.621 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T08:56:22.657 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:22.650+0000 7f627311d280 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T08:56:22.723 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:22.723 INFO:teuthology.orchestra.run.trial025.stdout:{"epoch":5,"fsid":"90e8bae8-9779-40e8-823a-3b5cb1d90003","created":"2026-02-17T08:56:21.971094+0000","modified":"2026-02-17T08:56:22.607574+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T08:56:22.607574+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4dccfa76-85be-4e4f-8a52-1b772796b024","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7f274425-9478-4110-bd75-2c08e55b9425","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0657e5c6-fd18-44da-9cdd-bfab7000ed46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:56:22.733 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T08:56:22.733 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T08:56:22.969 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:22.962+0000 7f627311d280 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T08:56:23.034 DEBUG:teuthology.orchestra.run.trial025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T08:56:23.062 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:23.054+0000 7f627311d280 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T08:56:23.090 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:23.082+0000 7f627311d280 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T08:56:23.121 INFO:teuthology.misc.health.trial025.stdout: 2026-02-17T08:56:23.121 INFO:teuthology.misc.health.trial025.stdout:{"epoch":5,"fsid":"90e8bae8-9779-40e8-823a-3b5cb1d90003","created":"2026-02-17T08:56:21.971094+0000","modified":"2026-02-17T08:56:22.607574+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T08:56:22.607574+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4dccfa76-85be-4e4f-8a52-1b772796b024","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7f274425-9478-4110-bd75-2c08e55b9425","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0657e5c6-fd18-44da-9cdd-bfab7000ed46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:56:23.121 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:23.114+0000 7f627311d280 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T08:56:23.129 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T08:56:23.165 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:23.158+0000 7f627311d280 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T08:56:23.269 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:23.262+0000 7f627311d280 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T08:56:23.468 INFO:tasks.ceph.mgr.x.trial025.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-17T08:56:23.646 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:23.638+0000 7f627311d280 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T08:56:23.679 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:23.670+0000 7f627311d280 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T08:56:23.775 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:23.766+0000 7f627311d280 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T08:56:23.799 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:23.790+0000 7f627311d280 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T08:56:23.826 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:23.818+0000 7f627311d280 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T08:56:23.853 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:23.846+0000 7f627311d280 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T08:56:23.979 INFO:tasks.ceph.mgr.x.trial025.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T08:56:23.979 INFO:tasks.ceph.mgr.x.trial025.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T08:56:23.979 INFO:tasks.ceph.mgr.x.trial025.stderr: from numpy import show_config as show_numpy_config 2026-02-17T08:56:23.986 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:23.978+0000 7f627311d280 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T08:56:24.012 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:24.006+0000 7f627311d280 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T08:56:24.051 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:24.046+0000 7f627311d280 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T08:56:24.168 INFO:tasks.ceph.osd.1.trial025.stderr:2026-02-17T08:56:24.162+0000 7f5bef0508c0 -1 Falling back to public interface 2026-02-17T08:56:24.668 INFO:tasks.ceph.osd.0.trial025.stderr:2026-02-17T08:56:24.662+0000 7ff4e9b0d8c0 -1 Falling back to public interface 2026-02-17T08:56:24.669 INFO:tasks.ceph.osd.2.trial025.stderr:2026-02-17T08:56:24.662+0000 7f2107a798c0 -1 Falling back to public interface 2026-02-17T08:56:25.080 INFO:tasks.ceph.mgr.x.trial025.stderr:2026-02-17T08:56:25.074+0000 7f6191a69640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-17T08:56:27.205 INFO:tasks.ceph.osd.1.trial025.stderr:2026-02-17T08:56:27.198+0000 7f5bef0508c0 -1 osd.1 0 log_to_monitors true 2026-02-17T08:56:27.707 INFO:tasks.ceph.osd.0.trial025.stderr:2026-02-17T08:56:27.702+0000 7ff4e9b0d8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T08:56:27.937 INFO:tasks.ceph.osd.2.trial025.stderr:2026-02-17T08:56:27.930+0000 7f2107a798c0 -1 osd.2 0 log_to_monitors true 2026-02-17T08:56:29.086 INFO:tasks.ceph.osd.2.trial025.stderr:2026-02-17T08:56:29.078+0000 7f2103a22640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T08:56:29.087 INFO:tasks.ceph.osd.1.trial025.stderr:2026-02-17T08:56:29.078+0000 7f5beaff9640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T08:56:29.116 INFO:tasks.ceph.osd.1.trial025.stderr:2026-02-17T08:56:29.110+0000 7f5be6e34640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T08:56:29.117 INFO:tasks.ceph.osd.2.trial025.stderr:2026-02-17T08:56:29.110+0000 7f20ff85d640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T08:56:29.320 INFO:tasks.ceph.osd.0.trial025.stderr:2026-02-17T08:56:29.314+0000 7ff4e5ab6640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T08:56:29.340 INFO:tasks.ceph.osd.0.trial025.stderr:2026-02-17T08:56:29.334+0000 7ff4dd8e9640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T08:56:29.430 DEBUG:teuthology.orchestra.run.trial025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T08:56:29.570 INFO:teuthology.misc.health.trial025.stdout: 2026-02-17T08:56:29.570 INFO:teuthology.misc.health.trial025.stdout:{"epoch":7,"fsid":"90e8bae8-9779-40e8-823a-3b5cb1d90003","created":"2026-02-17T08:56:21.971094+0000","modified":"2026-02-17T08:56:29.078790+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T08:56:22.607574+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4dccfa76-85be-4e4f-8a52-1b772796b024","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7f274425-9478-4110-bd75-2c08e55b9425","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0657e5c6-fd18-44da-9cdd-bfab7000ed46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:56:29.579 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T08:56:35.882 DEBUG:teuthology.orchestra.run.trial025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T08:56:36.020 INFO:teuthology.misc.health.trial025.stdout: 2026-02-17T08:56:36.021 INFO:teuthology.misc.health.trial025.stdout:{"epoch":8,"fsid":"90e8bae8-9779-40e8-823a-3b5cb1d90003","created":"2026-02-17T08:56:21.971094+0000","modified":"2026-02-17T08:56:30.080903+0000","last_up_change":"2026-02-17T08:56:30.080903+0000","last_in_change":"2026-02-17T08:56:22.607574+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4dccfa76-85be-4e4f-8a52-1b772796b024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6811","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6813","nonce":2170068383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6815","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6817","nonce":2170068383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6823","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6825","nonce":2170068383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6819","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6821","nonce":2170068383}]},"public_addr":"10.20.193.25:6813/2170068383","cluster_addr":"10.20.193.25:6817/2170068383","heartbeat_back_addr":"10.20.193.25:6825/2170068383","heartbeat_front_addr":"10.20.193.25:6821/2170068383","state":["exists","up"]},{"osd":1,"uuid":"7f274425-9478-4110-bd75-2c08e55b9425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6802","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6803","nonce":3516643521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6804","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6805","nonce":3516643521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6808","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6809","nonce":3516643521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6806","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6807","nonce":3516643521}]},"public_addr":"10.20.193.25:6803/3516643521","cluster_addr":"10.20.193.25:6805/3516643521","heartbeat_back_addr":"10.20.193.25:6809/3516643521","heartbeat_front_addr":"10.20.193.25:6807/3516643521","state":["exists","up"]},{"osd":2,"uuid":"0657e5c6-fd18-44da-9cdd-bfab7000ed46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6810","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6812","nonce":2080245453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6814","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6816","nonce":2080245453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6822","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6824","nonce":2080245453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6818","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6820","nonce":2080245453}]},"public_addr":"10.20.193.25:6812/2080245453","cluster_addr":"10.20.193.25:6816/2080245453","heartbeat_back_addr":"10.20.193.25:6824/2080245453","heartbeat_front_addr":"10.20.193.25:6820/2080245453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:56:36.029 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-17T08:56:36.029 INFO:tasks.ceph:Creating RBD pool 2026-02-17T08:56:36.029 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T08:56:37.095 INFO:teuthology.orchestra.run.trial025.stderr:pool 'rbd' created 2026-02-17T08:56:37.108 DEBUG:teuthology.orchestra.run.trial025:> rbd --cluster ceph pool init rbd 2026-02-17T08:56:40.110 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T08:56:40.110 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T08:56:40.110 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T08:56:40.111 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T08:56:40.111 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T08:56:40.276 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:40.288 INFO:teuthology.orchestra.run.trial025.stdout:{"epoch":4,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6800","nonce":3431211158},{"type":"v1","addr":"10.20.193.25:6801","nonce":3431211158}]},"active_addr":"10.20.193.25:6801/3431211158","active_change":"2026-02-17T08:56:24.070513+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.25:0","nonce":2598704417}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.25:0","nonce":4109049840}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.25:0","nonce":2713521771}]}]} 2026-02-17T08:56:40.291 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T08:56:40.291 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T08:56:40.292 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T08:56:40.436 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:40.437 INFO:teuthology.orchestra.run.trial025.stdout:{"epoch":12,"fsid":"90e8bae8-9779-40e8-823a-3b5cb1d90003","created":"2026-02-17T08:56:21.971094+0000","modified":"2026-02-17T08:56:40.097572+0000","last_up_change":"2026-02-17T08:56:30.080903+0000","last_in_change":"2026-02-17T08:56:22.607574+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T08:56:36.173932+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":12,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4dccfa76-85be-4e4f-8a52-1b772796b024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6811","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6813","nonce":2170068383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6815","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6817","nonce":2170068383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6823","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6825","nonce":2170068383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6819","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6821","nonce":2170068383}]},"public_addr":"10.20.193.25:6813/2170068383","cluster_addr":"10.20.193.25:6817/2170068383","heartbeat_back_addr":"10.20.193.25:6825/2170068383","heartbeat_front_addr":"10.20.193.25:6821/2170068383","state":["exists","up"]},{"osd":1,"uuid":"7f274425-9478-4110-bd75-2c08e55b9425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6802","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6803","nonce":3516643521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6804","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6805","nonce":3516643521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6808","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6809","nonce":3516643521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6806","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6807","nonce":3516643521}]},"public_addr":"10.20.193.25:6803/3516643521","cluster_addr":"10.20.193.25:6805/3516643521","heartbeat_back_addr":"10.20.193.25:6809/3516643521","heartbeat_front_addr":"10.20.193.25:6807/3516643521","state":["exists","up"]},{"osd":2,"uuid":"0657e5c6-fd18-44da-9cdd-bfab7000ed46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6810","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6812","nonce":2080245453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6814","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6816","nonce":2080245453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6822","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6824","nonce":2080245453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6818","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6820","nonce":2080245453}]},"public_addr":"10.20.193.25:6812/2080245453","cluster_addr":"10.20.193.25:6816/2080245453","heartbeat_back_addr":"10.20.193.25:6824/2080245453","heartbeat_front_addr":"10.20.193.25:6820/2080245453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:56:40.448 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T08:56:40.448 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T08:56:40.599 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:40.600 INFO:teuthology.orchestra.run.trial025.stdout:{"epoch":12,"fsid":"90e8bae8-9779-40e8-823a-3b5cb1d90003","created":"2026-02-17T08:56:21.971094+0000","modified":"2026-02-17T08:56:40.097572+0000","last_up_change":"2026-02-17T08:56:30.080903+0000","last_in_change":"2026-02-17T08:56:22.607574+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T08:56:36.173932+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":12,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4dccfa76-85be-4e4f-8a52-1b772796b024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6811","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6813","nonce":2170068383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6815","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6817","nonce":2170068383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6823","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6825","nonce":2170068383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6819","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6821","nonce":2170068383}]},"public_addr":"10.20.193.25:6813/2170068383","cluster_addr":"10.20.193.25:6817/2170068383","heartbeat_back_addr":"10.20.193.25:6825/2170068383","heartbeat_front_addr":"10.20.193.25:6821/2170068383","state":["exists","up"]},{"osd":1,"uuid":"7f274425-9478-4110-bd75-2c08e55b9425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6802","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6803","nonce":3516643521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6804","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6805","nonce":3516643521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6808","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6809","nonce":3516643521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6806","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6807","nonce":3516643521}]},"public_addr":"10.20.193.25:6803/3516643521","cluster_addr":"10.20.193.25:6805/3516643521","heartbeat_back_addr":"10.20.193.25:6809/3516643521","heartbeat_front_addr":"10.20.193.25:6807/3516643521","state":["exists","up"]},{"osd":2,"uuid":"0657e5c6-fd18-44da-9cdd-bfab7000ed46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6810","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6812","nonce":2080245453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6814","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6816","nonce":2080245453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6822","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6824","nonce":2080245453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6818","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6820","nonce":2080245453}]},"public_addr":"10.20.193.25:6812/2080245453","cluster_addr":"10.20.193.25:6816/2080245453","heartbeat_back_addr":"10.20.193.25:6824/2080245453","heartbeat_front_addr":"10.20.193.25:6820/2080245453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:56:40.609 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T08:56:40.610 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T08:56:40.610 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T08:56:40.691 INFO:teuthology.orchestra.run.trial025.stdout:34359738371 2026-02-17T08:56:40.692 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T08:56:40.692 INFO:teuthology.orchestra.run.trial025.stdout:34359738371 2026-02-17T08:56:40.693 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T08:56:40.693 INFO:teuthology.orchestra.run.trial025.stdout:34359738372 2026-02-17T08:56:40.693 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T08:56:40.884 INFO:teuthology.orchestra.run.trial025.stdout:34359738371 2026-02-17T08:56:40.887 INFO:teuthology.orchestra.run.trial025.stdout:34359738370 2026-02-17T08:56:40.894 INFO:teuthology.orchestra.run.trial025.stdout:34359738370 2026-02-17T08:56:40.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2026-02-17T08:56:40.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.1 2026-02-17T08:56:40.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.2 2026-02-17T08:56:41.896 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T08:56:41.898 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T08:56:41.907 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T08:56:42.046 INFO:teuthology.orchestra.run.trial025.stdout:34359738370 2026-02-17T08:56:42.046 INFO:teuthology.orchestra.run.trial025.stdout:34359738371 2026-02-17T08:56:42.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.1 2026-02-17T08:56:42.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2026-02-17T08:56:42.088 INFO:teuthology.orchestra.run.trial025.stdout:34359738370 2026-02-17T08:56:42.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.2 2026-02-17T08:56:43.059 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T08:56:43.060 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T08:56:43.101 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T08:56:43.206 INFO:teuthology.orchestra.run.trial025.stdout:34359738372 2026-02-17T08:56:43.208 INFO:teuthology.orchestra.run.trial025.stdout:34359738373 2026-02-17T08:56:43.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738372 for osd.1 2026-02-17T08:56:43.218 DEBUG:teuthology.parallel:result is None 2026-02-17T08:56:43.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738373 for osd.0 2026-02-17T08:56:43.220 DEBUG:teuthology.parallel:result is None 2026-02-17T08:56:43.247 INFO:teuthology.orchestra.run.trial025.stdout:34359738372 2026-02-17T08:56:43.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738372 for osd.2 2026-02-17T08:56:43.260 DEBUG:teuthology.parallel:result is None 2026-02-17T08:56:43.260 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T08:56:43.261 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T08:56:43.455 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:43.456 INFO:teuthology.orchestra.run.trial025.stderr:dumped all 2026-02-17T08:56:43.465 INFO:teuthology.orchestra.run.trial025.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-17T08:56:42.074670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81220,"kb_used_data":320,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491580,"statfs":{"total":322122547200,"available":322039377920,"internally_reserved":0,"allocated":327680,"data_stored":81620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":82767189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.103424+0000","last_change":"2026-02-17T08:56:40.103424+0000","last_active":"2026-02-17T08:56:40.103424+0000","last_peered":"2026-02-17T08:56:40.103424+0000","last_clean":"2026-02-17T08:56:40.103424+0000","last_became_active":"2026-02-17T08:56:38.099789+0000","last_became_peered":"2026-02-17T08:56:38.099789+0000","last_unstale":"2026-02-17T08:56:40.103424+0000","last_undegraded":"2026-02-17T08:56:40.103424+0000","last_fullsized":"2026-02-17T08:56:40.103424+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:47:01.052648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.103306+0000","last_change":"2026-02-17T08:56:40.103306+0000","last_active":"2026-02-17T08:56:40.103306+0000","last_peered":"2026-02-17T08:56:40.103306+0000","last_clean":"2026-02-17T08:56:40.103306+0000","last_became_active":"2026-02-17T08:56:38.100176+0000","last_became_peered":"2026-02-17T08:56:38.100176+0000","last_unstale":"2026-02-17T08:56:40.103306+0000","last_undegraded":"2026-02-17T08:56:40.103306+0000","last_fullsized":"2026-02-17T08:56:40.103306+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:48:49.184861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000254799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.100120+0000","last_change":"2026-02-17T08:56:40.100120+0000","last_active":"2026-02-17T08:56:40.100120+0000","last_peered":"2026-02-17T08:56:40.100120+0000","last_clean":"2026-02-17T08:56:40.100120+0000","last_became_active":"2026-02-17T08:56:38.099739+0000","last_became_peered":"2026-02-17T08:56:38.099739+0000","last_unstale":"2026-02-17T08:56:40.100120+0000","last_undegraded":"2026-02-17T08:56:40.100120+0000","last_fullsized":"2026-02-17T08:56:40.100120+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:47:08.363009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.103577+0000","last_change":"2026-02-17T08:56:40.103577+0000","last_active":"2026-02-17T08:56:40.103577+0000","last_peered":"2026-02-17T08:56:40.103577+0000","last_clean":"2026-02-17T08:56:40.103577+0000","last_became_active":"2026-02-17T08:56:38.100197+0000","last_became_peered":"2026-02-17T08:56:38.100197+0000","last_unstale":"2026-02-17T08:56:40.103577+0000","last_undegraded":"2026-02-17T08:56:40.103577+0000","last_fullsized":"2026-02-17T08:56:40.103577+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:18:08.960294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050294700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"10'1","reported_seq":20,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.103478+0000","last_change":"2026-02-17T08:56:40.103478+0000","last_active":"2026-02-17T08:56:40.103478+0000","last_peered":"2026-02-17T08:56:40.103478+0000","last_clean":"2026-02-17T08:56:40.103478+0000","last_became_active":"2026-02-17T08:56:38.099787+0000","last_became_peered":"2026-02-17T08:56:38.099787+0000","last_unstale":"2026-02-17T08:56:40.103478+0000","last_undegraded":"2026-02-17T08:56:40.103478+0000","last_fullsized":"2026-02-17T08:56:40.103478+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:22:08.112761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"12'2","reported_seq":21,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.102688+0000","last_change":"2026-02-17T08:56:40.102144+0000","last_active":"2026-02-17T08:56:40.102688+0000","last_peered":"2026-02-17T08:56:40.102688+0000","last_clean":"2026-02-17T08:56:40.102688+0000","last_became_active":"2026-02-17T08:56:38.099655+0000","last_became_peered":"2026-02-17T08:56:38.099655+0000","last_unstale":"2026-02-17T08:56:40.102688+0000","last_undegraded":"2026-02-17T08:56:40.102688+0000","last_fullsized":"2026-02-17T08:56:40.102688+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:49:07.787596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052371500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.100138+0000","last_change":"2026-02-17T08:56:40.100138+0000","last_active":"2026-02-17T08:56:40.100138+0000","last_peered":"2026-02-17T08:56:40.100138+0000","last_clean":"2026-02-17T08:56:40.100138+0000","last_became_active":"2026-02-17T08:56:38.099710+0000","last_became_peered":"2026-02-17T08:56:38.099710+0000","last_unstale":"2026-02-17T08:56:40.100138+0000","last_undegraded":"2026-02-17T08:56:40.100138+0000","last_fullsized":"2026-02-17T08:56:40.100138+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:16:19.039429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000256703,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.103298+0000","last_change":"2026-02-17T08:56:40.103298+0000","last_active":"2026-02-17T08:56:40.103298+0000","last_peered":"2026-02-17T08:56:40.103298+0000","last_clean":"2026-02-17T08:56:40.103298+0000","last_became_active":"2026-02-17T08:56:38.100217+0000","last_became_peered":"2026-02-17T08:56:38.100217+0000","last_unstale":"2026-02-17T08:56:40.103298+0000","last_undegraded":"2026-02-17T08:56:40.103298+0000","last_fullsized":"2026-02-17T08:56:40.103298+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:43:00.380089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027119900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":106496,"data_stored":27194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":110592,"data_stored":27213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":110592,"data_stored":27213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T08:56:43.467 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T08:56:43.611 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:43.612 INFO:teuthology.orchestra.run.trial025.stderr:dumped all 2026-02-17T08:56:43.622 INFO:teuthology.orchestra.run.trial025.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-17T08:56:42.074670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81220,"kb_used_data":320,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491580,"statfs":{"total":322122547200,"available":322039377920,"internally_reserved":0,"allocated":327680,"data_stored":81620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":82767189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.103424+0000","last_change":"2026-02-17T08:56:40.103424+0000","last_active":"2026-02-17T08:56:40.103424+0000","last_peered":"2026-02-17T08:56:40.103424+0000","last_clean":"2026-02-17T08:56:40.103424+0000","last_became_active":"2026-02-17T08:56:38.099789+0000","last_became_peered":"2026-02-17T08:56:38.099789+0000","last_unstale":"2026-02-17T08:56:40.103424+0000","last_undegraded":"2026-02-17T08:56:40.103424+0000","last_fullsized":"2026-02-17T08:56:40.103424+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:47:01.052648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.103306+0000","last_change":"2026-02-17T08:56:40.103306+0000","last_active":"2026-02-17T08:56:40.103306+0000","last_peered":"2026-02-17T08:56:40.103306+0000","last_clean":"2026-02-17T08:56:40.103306+0000","last_became_active":"2026-02-17T08:56:38.100176+0000","last_became_peered":"2026-02-17T08:56:38.100176+0000","last_unstale":"2026-02-17T08:56:40.103306+0000","last_undegraded":"2026-02-17T08:56:40.103306+0000","last_fullsized":"2026-02-17T08:56:40.103306+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:48:49.184861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000254799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.100120+0000","last_change":"2026-02-17T08:56:40.100120+0000","last_active":"2026-02-17T08:56:40.100120+0000","last_peered":"2026-02-17T08:56:40.100120+0000","last_clean":"2026-02-17T08:56:40.100120+0000","last_became_active":"2026-02-17T08:56:38.099739+0000","last_became_peered":"2026-02-17T08:56:38.099739+0000","last_unstale":"2026-02-17T08:56:40.100120+0000","last_undegraded":"2026-02-17T08:56:40.100120+0000","last_fullsized":"2026-02-17T08:56:40.100120+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:47:08.363009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.103577+0000","last_change":"2026-02-17T08:56:40.103577+0000","last_active":"2026-02-17T08:56:40.103577+0000","last_peered":"2026-02-17T08:56:40.103577+0000","last_clean":"2026-02-17T08:56:40.103577+0000","last_became_active":"2026-02-17T08:56:38.100197+0000","last_became_peered":"2026-02-17T08:56:38.100197+0000","last_unstale":"2026-02-17T08:56:40.103577+0000","last_undegraded":"2026-02-17T08:56:40.103577+0000","last_fullsized":"2026-02-17T08:56:40.103577+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:18:08.960294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050294700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"10'1","reported_seq":20,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.103478+0000","last_change":"2026-02-17T08:56:40.103478+0000","last_active":"2026-02-17T08:56:40.103478+0000","last_peered":"2026-02-17T08:56:40.103478+0000","last_clean":"2026-02-17T08:56:40.103478+0000","last_became_active":"2026-02-17T08:56:38.099787+0000","last_became_peered":"2026-02-17T08:56:38.099787+0000","last_unstale":"2026-02-17T08:56:40.103478+0000","last_undegraded":"2026-02-17T08:56:40.103478+0000","last_fullsized":"2026-02-17T08:56:40.103478+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:22:08.112761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"12'2","reported_seq":21,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.102688+0000","last_change":"2026-02-17T08:56:40.102144+0000","last_active":"2026-02-17T08:56:40.102688+0000","last_peered":"2026-02-17T08:56:40.102688+0000","last_clean":"2026-02-17T08:56:40.102688+0000","last_became_active":"2026-02-17T08:56:38.099655+0000","last_became_peered":"2026-02-17T08:56:38.099655+0000","last_unstale":"2026-02-17T08:56:40.102688+0000","last_undegraded":"2026-02-17T08:56:40.102688+0000","last_fullsized":"2026-02-17T08:56:40.102688+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:49:07.787596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052371500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.100138+0000","last_change":"2026-02-17T08:56:40.100138+0000","last_active":"2026-02-17T08:56:40.100138+0000","last_peered":"2026-02-17T08:56:40.100138+0000","last_clean":"2026-02-17T08:56:40.100138+0000","last_became_active":"2026-02-17T08:56:38.099710+0000","last_became_peered":"2026-02-17T08:56:38.099710+0000","last_unstale":"2026-02-17T08:56:40.100138+0000","last_undegraded":"2026-02-17T08:56:40.100138+0000","last_fullsized":"2026-02-17T08:56:40.100138+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:16:19.039429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000256703,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-17T08:56:40.103298+0000","last_change":"2026-02-17T08:56:40.103298+0000","last_active":"2026-02-17T08:56:40.103298+0000","last_peered":"2026-02-17T08:56:40.103298+0000","last_clean":"2026-02-17T08:56:40.103298+0000","last_became_active":"2026-02-17T08:56:38.100217+0000","last_became_peered":"2026-02-17T08:56:38.100217+0000","last_unstale":"2026-02-17T08:56:40.103298+0000","last_undegraded":"2026-02-17T08:56:40.103298+0000","last_fullsized":"2026-02-17T08:56:40.103298+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:43:00.380089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027119900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":106496,"data_stored":27194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":110592,"data_stored":27213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":108,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":110592,"data_stored":27213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T08:56:43.625 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T08:56:43.625 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T08:56:43.625 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T08:56:43.626 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T08:56:43.804 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:56:43.804 INFO:teuthology.orchestra.run.trial025.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T08:56:43.814 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T08:56:43.814 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T08:56:43.840 INFO:tasks.workunit:Pulling workunits from ref 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:56:43.840 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T08:56:43.840 INFO:tasks.workunit:timeout=3h 2026-02-17T08:56:43.840 INFO:tasks.workunit:cleanup=True 2026-02-17T08:56:43.841 DEBUG:teuthology.orchestra.run.trial025:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T08:56:43.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:56:43.845 INFO:teuthology.orchestra.run.trial025.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T08:56:43.846 DEBUG:teuthology.orchestra.run.trial025:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T08:56:43.890 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T08:56:43.890 DEBUG:teuthology.orchestra.run.trial025:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T08:56:43.934 DEBUG:teuthology.orchestra.run.trial025:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:56:43.985 INFO:tasks.workunit.client.0.trial025.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T08:57:05.895 INFO:tasks.workunit.client.0.trial025.stderr:Note: switching to '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'. 2026-02-17T08:57:05.895 INFO:tasks.workunit.client.0.trial025.stderr: 2026-02-17T08:57:05.895 INFO:tasks.workunit.client.0.trial025.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T08:57:05.895 INFO:tasks.workunit.client.0.trial025.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T08:57:05.895 INFO:tasks.workunit.client.0.trial025.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T08:57:05.895 INFO:tasks.workunit.client.0.trial025.stderr: 2026-02-17T08:57:05.895 INFO:tasks.workunit.client.0.trial025.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T08:57:05.895 INFO:tasks.workunit.client.0.trial025.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T08:57:05.896 INFO:tasks.workunit.client.0.trial025.stderr: 2026-02-17T08:57:05.896 INFO:tasks.workunit.client.0.trial025.stderr: git switch -c 2026-02-17T08:57:05.896 INFO:tasks.workunit.client.0.trial025.stderr: 2026-02-17T08:57:05.896 INFO:tasks.workunit.client.0.trial025.stderr:Or undo this operation with: 2026-02-17T08:57:05.896 INFO:tasks.workunit.client.0.trial025.stderr: 2026-02-17T08:57:05.896 INFO:tasks.workunit.client.0.trial025.stderr: git switch - 2026-02-17T08:57:05.896 INFO:tasks.workunit.client.0.trial025.stderr: 2026-02-17T08:57:05.896 INFO:tasks.workunit.client.0.trial025.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T08:57:05.896 INFO:tasks.workunit.client.0.trial025.stderr: 2026-02-17T08:57:05.896 INFO:tasks.workunit.client.0.trial025.stderr:HEAD is now at 04cf6dd4be4 Merge branch 'wip-squid-update-spdk' of https://github.com/tchaikov/ceph into wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T08:57:05.905 DEBUG:teuthology.orchestra.run.trial025:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T08:57:05.956 INFO:tasks.workunit.client.0.trial025.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-17T08:57:05.958 INFO:tasks.workunit.client.0.trial025.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-17T08:57:05.958 INFO:tasks.workunit.client.0.trial025.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-17T08:57:06.055 INFO:tasks.workunit.client.0.trial025.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-17T08:57:06.088 INFO:tasks.workunit.client.0.trial025.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-17T08:57:06.118 INFO:tasks.workunit.client.0.trial025.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-17T08:57:06.120 INFO:tasks.workunit.client.0.trial025.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-17T08:57:06.120 INFO:tasks.workunit.client.0.trial025.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-17T08:57:06.143 INFO:tasks.workunit.client.0.trial025.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-17T08:57:06.146 DEBUG:teuthology.orchestra.run.trial025:> set -ex 2026-02-17T08:57:06.146 DEBUG:teuthology.orchestra.run.trial025:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T08:57:06.192 INFO:tasks.workunit:Running workunits matching cephtool/test_kvstore_tool.sh on client.0... 2026-02-17T08:57:06.195 INFO:tasks.workunit:Running workunit cephtool/test_kvstore_tool.sh... 2026-02-17T08:57:06.196 DEBUG:teuthology.orchestra.run.trial025:workunit test cephtool/test_kvstore_tool.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh 2026-02-17T08:57:06.243 INFO:tasks.workunit.client.0.trial025.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh 2026-02-17T08:57:06.245 INFO:tasks.workunit.client.0.trial025.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/../../standalone/ceph-helpers.sh 2026-02-17T08:57:06.245 INFO:tasks.workunit.client.0.trial025.stderr:++ TIMEOUT=300 2026-02-17T08:57:06.245 INFO:tasks.workunit.client.0.trial025.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2026-02-17T08:57:06.245 INFO:tasks.workunit.client.0.trial025.stderr:++ MAX_TIMEOUT=15 2026-02-17T08:57:06.245 INFO:tasks.workunit.client.0.trial025.stderr:++ PG_NUM=4 2026-02-17T08:57:06.245 INFO:tasks.workunit.client.0.trial025.stderr:++ TMPDIR=/tmp 2026-02-17T08:57:06.245 INFO:tasks.workunit.client.0.trial025.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2026-02-17T08:57:06.245 INFO:tasks.workunit.client.0.trial025.stderr:++ TESTDIR=/home/ubuntu/cephtest 2026-02-17T08:57:06.245 INFO:tasks.workunit.client.0.trial025.stderr:++ type xmlstarlet 2026-02-17T08:57:06.246 INFO:tasks.workunit.client.0.trial025.stderr:++ XMLSTARLET=xmlstarlet 2026-02-17T08:57:06.246 INFO:tasks.workunit.client.0.trial025.stderr:+++ uname 2026-02-17T08:57:06.247 INFO:tasks.workunit.client.0.trial025.stderr:++ '[' Linux = FreeBSD ']' 2026-02-17T08:57:06.247 INFO:tasks.workunit.client.0.trial025.stderr:++ SED=sed 2026-02-17T08:57:06.247 INFO:tasks.workunit.client.0.trial025.stderr:++ AWK=awk 2026-02-17T08:57:06.247 INFO:tasks.workunit.client.0.trial025.stderr:+++ stty -a 2026-02-17T08:57:06.247 INFO:tasks.workunit.client.0.trial025.stderr:+++ head -1 2026-02-17T08:57:06.247 INFO:tasks.workunit.client.0.trial025.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2026-02-17T08:57:06.247 INFO:tasks.workunit.client.0.trial025.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T08:57:06.248 INFO:tasks.workunit.client.0.trial025.stderr:++ termwidth= 2026-02-17T08:57:06.248 INFO:tasks.workunit.client.0.trial025.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2026-02-17T08:57:06.248 INFO:tasks.workunit.client.0.trial025.stderr:++ DIFFCOLOPTS='-y ' 2026-02-17T08:57:06.248 INFO:tasks.workunit.client.0.trial025.stderr:++ KERNCORE=kernel.core_pattern 2026-02-17T08:57:06.248 INFO:tasks.workunit.client.0.trial025.stderr:++ EXTRA_OPTS= 2026-02-17T08:57:06.250 INFO:tasks.workunit.client.0.trial025.stderr:++ test '' = TESTS 2026-02-17T08:57:06.251 INFO:tasks.workunit.client.0.trial025.stderr:+ set -e 2026-02-17T08:57:06.251 INFO:tasks.workunit.client.0.trial025.stderr:+ set -o functrace 2026-02-17T08:57:06.251 INFO:tasks.workunit.client.0.trial025.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T08:57:06.251 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:10: : SUDO=sudo 2026-02-17T08:57:06.251 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:11: : export CEPH_DEV=1 2026-02-17T08:57:06.251 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:11: : CEPH_DEV=1 2026-02-17T08:57:06.251 INFO:tasks.workunit.client.0.trial025.stdout:note: test ceph_kvstore_tool with bluestore 2026-02-17T08:57:06.252 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:13: : echo note: test ceph_kvstore_tool with bluestore 2026-02-17T08:57:06.252 INFO:tasks.workunit.client.0.trial025.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:21: : mktemp -d ./cephtool.XXX 2026-02-17T08:57:06.252 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:21: : TEMP_DIR=./cephtool.4w7 2026-02-17T08:57:06.252 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:22: : trap 'rm -fr ./cephtool.4w7' 0 2026-02-17T08:57:06.252 INFO:tasks.workunit.client.0.trial025.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:24: : mktemp ./cephtool.4w7/test_invalid.XXX 2026-02-17T08:57:06.253 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:24: : TEMP_FILE=./cephtool.4w7/test_invalid.mhH 2026-02-17T08:57:06.253 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:69: : test_ceph_kvstore_tool 2026-02-17T08:57:06.253 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:29: test_ceph_kvstore_tool: ceph-objectstore-tool --data-path ./cephtool.4w7 --op mkfs --no-mon-config 2026-02-17T08:57:07.636 INFO:tasks.workunit.client.0.trial025.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:32: test_ceph_kvstore_tool: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 list 2026-02-17T08:57:07.637 INFO:tasks.workunit.client.0.trial025.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:32: test_ceph_kvstore_tool: wc -l 2026-02-17T08:57:08.716 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:32: test_ceph_kvstore_tool: origin_kv_nums=11 2026-02-17T08:57:08.717 INFO:tasks.workunit.client.0.trial025.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:35: test_ceph_kvstore_tool: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 list 2026-02-17T08:57:08.717 INFO:tasks.workunit.client.0.trial025.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:35: test_ceph_kvstore_tool: head -n 1 2026-02-17T08:57:08.717 INFO:tasks.workunit.client.0.trial025.stderr://home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:35: test_ceph_kvstore_tool: awk '{print $1}' 2026-02-17T08:57:09.813 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:35: test_ceph_kvstore_tool: prefix=B 2026-02-17T08:57:09.813 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:36: test_ceph_kvstore_tool: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 exists B 2026-02-17T08:57:09.828 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:09.820+0000 7faf3e8abbc0 1 bdev(0x55ff4742d800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:09.828 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:09.820+0000 7faf3e8abbc0 1 bdev(0x55ff4742d800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:09.828 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:09.824+0000 7faf3e8abbc0 1 bdev(0x55ff4742d800 ./cephtool.4w7/block) close 2026-02-17T08:57:10.116 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bdev(0x55ff4742d800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:10.116 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bdev(0x55ff4742d800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:10.116 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:10.116 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bdev(0x55ff4742dc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:10.117 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bdev(0x55ff4742dc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:10.117 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:10.117 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bluefs mount 2026-02-17T08:57:10.117 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:10.119 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:10.119 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:10.119 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:10.120 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:10.120 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:10.120 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:10.120 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.112+0000 7faf3e8abbc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:10.124 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.120+0000 7faf3e8abbc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:10.124 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.120+0000 7faf3e8abbc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:10.125 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.120+0000 7faf3e8abbc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:10.125 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.120+0000 7faf3e8abbc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:10.125 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.120+0000 7faf3e8abbc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:10.126 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.120+0000 7faf3e8abbc0 1 freelist init 2026-02-17T08:57:10.126 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.120+0000 7faf3e8abbc0 1 freelist _read_cfg 2026-02-17T08:57:10.126 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.120+0000 7faf3e8abbc0 1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T08:57:10.126 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.120+0000 7faf3e8abbc0 0 bluestore(./cephtool.4w7) _init_alloc::NCB::restore_allocator() failed! Run Full Recovery from ONodes (might take a while) ... 2026-02-17T08:57:10.126 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.120+0000 7faf3e8abbc0 1 bluestore::NCB::read_allocation_from_drive_on_startup::::Allocation Recovery was completed in 0.000114 seconds, extent_count=1 2026-02-17T08:57:10.126 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.120+0000 7faf3e8abbc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 0 B in 0 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:10.126 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.120+0000 7faf3e8abbc0 1 bluefs umount 2026-02-17T08:57:10.126 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.120+0000 7faf3e8abbc0 1 bdev(0x55ff4742dc00 ./cephtool.4w7/block) close 2026-02-17T08:57:10.396 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.392+0000 7faf3e8abbc0 1 bdev(0x55ff4742dc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:10.396 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.392+0000 7faf3e8abbc0 1 bdev(0x55ff4742dc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:10.397 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.392+0000 7faf3e8abbc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:10.397 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.392+0000 7faf3e8abbc0 1 bluefs mount 2026-02-17T08:57:10.397 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.392+0000 7faf3e8abbc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:10.397 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.392+0000 7faf3e8abbc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:10.398 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.392+0000 7faf3e8abbc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:10.398 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.392+0000 7faf3e8abbc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:10.398 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.392+0000 7faf3e8abbc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:10.398 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.392+0000 7faf3e8abbc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:10.398 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.392+0000 7faf3e8abbc0 1 bluefs mount shared_bdev_used = 4653056 2026-02-17T08:57:10.398 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.392+0000 7faf3e8abbc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:10.405 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.400+0000 7faf3e8abbc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:10.406 INFO:tasks.workunit.client.0.trial025.stdout:(B, ) exists 2026-02-17T08:57:10.406 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.400+0000 7faf3e8abbc0 1 bluefs umount 2026-02-17T08:57:10.406 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.400+0000 7faf3e8abbc0 1 bdev(0x55ff4742dc00 ./cephtool.4w7/block) close 2026-02-17T08:57:10.676 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.672+0000 7faf3e8abbc0 1 freelist shutdown 2026-02-17T08:57:10.676 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.672+0000 7faf3e8abbc0 1 bdev(0x55ff4742d800 ./cephtool.4w7/block) close 2026-02-17T08:57:10.902 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:37: test_ceph_kvstore_tool: expect_false ceph-kvstore-tool bluestore-kv ./cephtool.4w7 exists Bnotexist 2026-02-17T08:57:10.902 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:17: expect_false: set -x 2026-02-17T08:57:10.902 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:18: expect_false: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 exists Bnotexist 2026-02-17T08:57:10.916 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.908+0000 7f495780fbc0 1 bdev(0x55aa1b9a5800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:10.916 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.912+0000 7f495780fbc0 1 bdev(0x55aa1b9a5800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:10.916 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:10.912+0000 7f495780fbc0 1 bdev(0x55aa1b9a5800 ./cephtool.4w7/block) close 2026-02-17T08:57:11.196 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bdev(0x55aa1b9a5800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:11.196 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bdev(0x55aa1b9a5800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:11.196 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:11.196 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bdev(0x55aa1b9a5c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:11.196 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bdev(0x55aa1b9a5c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:11.196 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:11.196 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bluefs mount 2026-02-17T08:57:11.197 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:11.199 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:11.199 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:11.199 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:11.199 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:11.199 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:11.199 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:11.199 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.192+0000 7f495780fbc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:11.205 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.200+0000 7f495780fbc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:11.205 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.200+0000 7f495780fbc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:11.205 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.200+0000 7f495780fbc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:11.205 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.200+0000 7f495780fbc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:11.205 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.200+0000 7f495780fbc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:11.205 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.200+0000 7f495780fbc0 1 freelist init 2026-02-17T08:57:11.205 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.200+0000 7f495780fbc0 1 freelist _read_cfg 2026-02-17T08:57:11.205 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.200+0000 7f495780fbc0 1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T08:57:11.205 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.200+0000 7f495780fbc0 0 bluestore(./cephtool.4w7) _init_alloc::NCB::restore_allocator() failed! Run Full Recovery from ONodes (might take a while) ... 2026-02-17T08:57:11.206 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.200+0000 7f495780fbc0 1 bluestore::NCB::read_allocation_from_drive_on_startup::::Allocation Recovery was completed in 0.000184 seconds, extent_count=1 2026-02-17T08:57:11.206 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.200+0000 7f495780fbc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 0 B in 0 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:11.206 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.200+0000 7f495780fbc0 1 bluefs umount 2026-02-17T08:57:11.206 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.200+0000 7f495780fbc0 1 bdev(0x55aa1b9a5c00 ./cephtool.4w7/block) close 2026-02-17T08:57:11.492 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.488+0000 7f495780fbc0 1 bdev(0x55aa1b9a5c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:11.493 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.488+0000 7f495780fbc0 1 bdev(0x55aa1b9a5c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:11.493 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.488+0000 7f495780fbc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:11.493 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.488+0000 7f495780fbc0 1 bluefs mount 2026-02-17T08:57:11.493 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.488+0000 7f495780fbc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:11.494 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.488+0000 7f495780fbc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:11.494 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.488+0000 7f495780fbc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:11.494 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.488+0000 7f495780fbc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:11.495 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.488+0000 7f495780fbc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:11.495 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.488+0000 7f495780fbc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:11.495 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.488+0000 7f495780fbc0 1 bluefs mount shared_bdev_used = 4653056 2026-02-17T08:57:11.495 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.488+0000 7f495780fbc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:11.502 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.496+0000 7f495780fbc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:11.502 INFO:tasks.workunit.client.0.trial025.stdout:(Bnotexist, ) does not exist 2026-02-17T08:57:11.503 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.496+0000 7f495780fbc0 1 bluefs umount 2026-02-17T08:57:11.503 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.496+0000 7f495780fbc0 1 bdev(0x55aa1b9a5c00 ./cephtool.4w7/block) close 2026-02-17T08:57:11.772 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.768+0000 7f495780fbc0 1 freelist shutdown 2026-02-17T08:57:11.772 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.768+0000 7f495780fbc0 1 bdev(0x55aa1b9a5800 ./cephtool.4w7/block) close 2026-02-17T08:57:11.987 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:18: expect_false: return 0 2026-02-17T08:57:11.987 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:40: test_ceph_kvstore_tool: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 list-crc 2026-02-17T08:57:12.000 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.992+0000 7f380a7dcbc0 1 bdev(0x5576197cb800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:12.000 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.992+0000 7f380a7dcbc0 1 bdev(0x5576197cb800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:12.000 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:11.996+0000 7f380a7dcbc0 1 bdev(0x5576197cb800 ./cephtool.4w7/block) close 2026-02-17T08:57:12.280 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bdev(0x5576197cb800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:12.280 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bdev(0x5576197cb800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:12.280 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:12.280 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bdev(0x5576197cbc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:12.280 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bdev(0x5576197cbc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:12.280 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:12.280 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bluefs mount 2026-02-17T08:57:12.281 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:12.283 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:12.283 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:12.283 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:12.283 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:12.283 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:12.283 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:12.283 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.276+0000 7f380a7dcbc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:12.289 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.284+0000 7f380a7dcbc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:12.289 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.284+0000 7f380a7dcbc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:12.289 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.284+0000 7f380a7dcbc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:12.289 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.284+0000 7f380a7dcbc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:12.289 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.284+0000 7f380a7dcbc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:12.289 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.284+0000 7f380a7dcbc0 1 freelist init 2026-02-17T08:57:12.289 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.284+0000 7f380a7dcbc0 1 freelist _read_cfg 2026-02-17T08:57:12.289 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.284+0000 7f380a7dcbc0 1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T08:57:12.289 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.284+0000 7f380a7dcbc0 0 bluestore(./cephtool.4w7) _init_alloc::NCB::restore_allocator() failed! Run Full Recovery from ONodes (might take a while) ... 2026-02-17T08:57:12.289 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.284+0000 7f380a7dcbc0 1 bluestore::NCB::read_allocation_from_drive_on_startup::::Allocation Recovery was completed in 0.000145 seconds, extent_count=1 2026-02-17T08:57:12.289 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.284+0000 7f380a7dcbc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 0 B in 0 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:12.289 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.284+0000 7f380a7dcbc0 1 bluefs umount 2026-02-17T08:57:12.289 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.284+0000 7f380a7dcbc0 1 bdev(0x5576197cbc00 ./cephtool.4w7/block) close 2026-02-17T08:57:12.576 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.572+0000 7f380a7dcbc0 1 bdev(0x5576197cbc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:12.577 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.572+0000 7f380a7dcbc0 1 bdev(0x5576197cbc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:12.577 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.572+0000 7f380a7dcbc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:12.577 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.572+0000 7f380a7dcbc0 1 bluefs mount 2026-02-17T08:57:12.577 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.572+0000 7f380a7dcbc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:12.578 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.572+0000 7f380a7dcbc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:12.578 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.572+0000 7f380a7dcbc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:12.578 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.572+0000 7f380a7dcbc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:12.578 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.572+0000 7f380a7dcbc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:12.578 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.572+0000 7f380a7dcbc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:12.578 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.572+0000 7f380a7dcbc0 1 bluefs mount shared_bdev_used = 4653056 2026-02-17T08:57:12.578 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.572+0000 7f380a7dcbc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:12.585 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.580+0000 7f380a7dcbc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:12.586 INFO:tasks.workunit.client.0.trial025.stdout:B blocks 3887034139 2026-02-17T08:57:12.586 INFO:tasks.workunit.client.0.trial025.stdout:B blocks_per_key 2356384685 2026-02-17T08:57:12.586 INFO:tasks.workunit.client.0.trial025.stdout:B bytes_per_block 1745006751 2026-02-17T08:57:12.586 INFO:tasks.workunit.client.0.trial025.stdout:B size 714193852 2026-02-17T08:57:12.586 INFO:tasks.workunit.client.0.trial025.stdout:S blobid_max 3417961130 2026-02-17T08:57:12.586 INFO:tasks.workunit.client.0.trial025.stdout:S freelist_type 753695201 2026-02-17T08:57:12.586 INFO:tasks.workunit.client.0.trial025.stdout:S min_alloc_size 1458662255 2026-02-17T08:57:12.586 INFO:tasks.workunit.client.0.trial025.stdout:S min_compat_ondisk_format 2796427507 2026-02-17T08:57:12.586 INFO:tasks.workunit.client.0.trial025.stdout:S nid_max 1692495819 2026-02-17T08:57:12.586 INFO:tasks.workunit.client.0.trial025.stdout:S ondisk_format 3256356326 2026-02-17T08:57:12.586 INFO:tasks.workunit.client.0.trial025.stdout:S per_pool_omap 490065073 2026-02-17T08:57:12.587 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.580+0000 7f380a7dcbc0 1 bluefs umount 2026-02-17T08:57:12.587 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.580+0000 7f380a7dcbc0 1 bdev(0x5576197cbc00 ./cephtool.4w7/block) close 2026-02-17T08:57:12.856 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.852+0000 7f380a7dcbc0 1 freelist shutdown 2026-02-17T08:57:12.856 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:12.852+0000 7f380a7dcbc0 1 bdev(0x5576197cb800 ./cephtool.4w7/block) close 2026-02-17T08:57:13.074 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:41: test_ceph_kvstore_tool: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 list-crc B 2026-02-17T08:57:13.088 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.080+0000 7f3d0f70dbc0 1 bdev(0x561ef3c15800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:13.088 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.084+0000 7f3d0f70dbc0 1 bdev(0x561ef3c15800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:13.088 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.084+0000 7f3d0f70dbc0 1 bdev(0x561ef3c15800 ./cephtool.4w7/block) close 2026-02-17T08:57:13.368 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bdev(0x561ef3c15800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:13.368 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bdev(0x561ef3c15800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:13.369 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:13.369 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bdev(0x561ef3c15c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:13.369 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bdev(0x561ef3c15c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:13.369 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:13.370 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bluefs mount 2026-02-17T08:57:13.370 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:13.371 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:13.371 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:13.371 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:13.371 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:13.371 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:13.371 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:13.371 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.364+0000 7f3d0f70dbc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:13.377 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.368+0000 7f3d0f70dbc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:13.378 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.368+0000 7f3d0f70dbc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:13.378 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.368+0000 7f3d0f70dbc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:13.378 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.368+0000 7f3d0f70dbc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:13.378 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.368+0000 7f3d0f70dbc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:13.378 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.372+0000 7f3d0f70dbc0 1 freelist init 2026-02-17T08:57:13.379 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.372+0000 7f3d0f70dbc0 1 freelist _read_cfg 2026-02-17T08:57:13.379 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.372+0000 7f3d0f70dbc0 1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T08:57:13.379 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.372+0000 7f3d0f70dbc0 0 bluestore(./cephtool.4w7) _init_alloc::NCB::restore_allocator() failed! Run Full Recovery from ONodes (might take a while) ... 2026-02-17T08:57:13.379 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.372+0000 7f3d0f70dbc0 1 bluestore::NCB::read_allocation_from_drive_on_startup::::Allocation Recovery was completed in 0.000179 seconds, extent_count=1 2026-02-17T08:57:13.379 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.372+0000 7f3d0f70dbc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 0 B in 0 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:13.379 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.372+0000 7f3d0f70dbc0 1 bluefs umount 2026-02-17T08:57:13.380 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.372+0000 7f3d0f70dbc0 1 bdev(0x561ef3c15c00 ./cephtool.4w7/block) close 2026-02-17T08:57:13.648 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.644+0000 7f3d0f70dbc0 1 bdev(0x561ef3c15c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:13.648 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.644+0000 7f3d0f70dbc0 1 bdev(0x561ef3c15c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:13.648 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.644+0000 7f3d0f70dbc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:13.648 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.644+0000 7f3d0f70dbc0 1 bluefs mount 2026-02-17T08:57:13.648 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.644+0000 7f3d0f70dbc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:13.649 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.644+0000 7f3d0f70dbc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:13.649 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.644+0000 7f3d0f70dbc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:13.649 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.644+0000 7f3d0f70dbc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:13.649 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.644+0000 7f3d0f70dbc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:13.649 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.644+0000 7f3d0f70dbc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:13.649 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.644+0000 7f3d0f70dbc0 1 bluefs mount shared_bdev_used = 4653056 2026-02-17T08:57:13.649 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.644+0000 7f3d0f70dbc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:13.657 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.652+0000 7f3d0f70dbc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:13.658 INFO:tasks.workunit.client.0.trial025.stdout:B blocks 3887034139 2026-02-17T08:57:13.658 INFO:tasks.workunit.client.0.trial025.stdout:B blocks_per_key 2356384685 2026-02-17T08:57:13.658 INFO:tasks.workunit.client.0.trial025.stdout:B bytes_per_block 1745006751 2026-02-17T08:57:13.658 INFO:tasks.workunit.client.0.trial025.stdout:B size 714193852 2026-02-17T08:57:13.658 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.652+0000 7f3d0f70dbc0 1 bluefs umount 2026-02-17T08:57:13.658 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.652+0000 7f3d0f70dbc0 1 bdev(0x561ef3c15c00 ./cephtool.4w7/block) close 2026-02-17T08:57:13.928 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.924+0000 7f3d0f70dbc0 1 freelist shutdown 2026-02-17T08:57:13.928 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:13.924+0000 7f3d0f70dbc0 1 bdev(0x561ef3c15800 ./cephtool.4w7/block) close 2026-02-17T08:57:14.151 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:44: test_ceph_kvstore_tool: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 list B 2026-02-17T08:57:14.164 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.156+0000 7fb67df87bc0 1 bdev(0x5641fa3d7800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:14.164 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.160+0000 7fb67df87bc0 1 bdev(0x5641fa3d7800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:14.164 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.160+0000 7fb67df87bc0 1 bdev(0x5641fa3d7800 ./cephtool.4w7/block) close 2026-02-17T08:57:14.444 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bdev(0x5641fa3d7800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:14.444 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bdev(0x5641fa3d7800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:14.444 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:14.444 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bdev(0x5641fa3d7c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:14.444 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bdev(0x5641fa3d7c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:14.444 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:14.444 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bluefs mount 2026-02-17T08:57:14.445 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:14.447 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:14.447 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:14.447 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:14.447 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:14.447 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:14.447 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:14.447 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.440+0000 7fb67df87bc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:14.452 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.448+0000 7fb67df87bc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:14.453 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.448+0000 7fb67df87bc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:14.453 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.448+0000 7fb67df87bc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:14.453 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.448+0000 7fb67df87bc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:14.453 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.448+0000 7fb67df87bc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:14.453 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.448+0000 7fb67df87bc0 1 freelist init 2026-02-17T08:57:14.453 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.448+0000 7fb67df87bc0 1 freelist _read_cfg 2026-02-17T08:57:14.453 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.448+0000 7fb67df87bc0 1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T08:57:14.453 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.448+0000 7fb67df87bc0 0 bluestore(./cephtool.4w7) _init_alloc::NCB::restore_allocator() failed! Run Full Recovery from ONodes (might take a while) ... 2026-02-17T08:57:14.453 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.448+0000 7fb67df87bc0 1 bluestore::NCB::read_allocation_from_drive_on_startup::::Allocation Recovery was completed in 0.000150 seconds, extent_count=1 2026-02-17T08:57:14.453 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.448+0000 7fb67df87bc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 0 B in 0 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:14.453 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.448+0000 7fb67df87bc0 1 bluefs umount 2026-02-17T08:57:14.453 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.448+0000 7fb67df87bc0 1 bdev(0x5641fa3d7c00 ./cephtool.4w7/block) close 2026-02-17T08:57:14.724 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.720+0000 7fb67df87bc0 1 bdev(0x5641fa3d7c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:14.724 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.720+0000 7fb67df87bc0 1 bdev(0x5641fa3d7c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:14.725 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.720+0000 7fb67df87bc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:14.725 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.720+0000 7fb67df87bc0 1 bluefs mount 2026-02-17T08:57:14.725 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.720+0000 7fb67df87bc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:14.725 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.720+0000 7fb67df87bc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:14.725 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.720+0000 7fb67df87bc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:14.726 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.720+0000 7fb67df87bc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:14.726 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.720+0000 7fb67df87bc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:14.726 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.720+0000 7fb67df87bc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:14.726 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.720+0000 7fb67df87bc0 1 bluefs mount shared_bdev_used = 4653056 2026-02-17T08:57:14.726 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.720+0000 7fb67df87bc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:14.733 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.728+0000 7fb67df87bc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:14.734 INFO:tasks.workunit.client.0.trial025.stdout:B blocks 2026-02-17T08:57:14.734 INFO:tasks.workunit.client.0.trial025.stdout:B blocks_per_key 2026-02-17T08:57:14.734 INFO:tasks.workunit.client.0.trial025.stdout:B bytes_per_block 2026-02-17T08:57:14.734 INFO:tasks.workunit.client.0.trial025.stdout:B size 2026-02-17T08:57:14.734 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.728+0000 7fb67df87bc0 1 bluefs umount 2026-02-17T08:57:14.734 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:14.728+0000 7fb67df87bc0 1 bdev(0x5641fa3d7c00 ./cephtool.4w7/block) close 2026-02-17T08:57:15.012 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.008+0000 7fb67df87bc0 1 freelist shutdown 2026-02-17T08:57:15.012 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.008+0000 7fb67df87bc0 1 bdev(0x5641fa3d7800 ./cephtool.4w7/block) close 2026-02-17T08:57:15.229 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:47: test_ceph_kvstore_tool: echo helloworld 2026-02-17T08:57:15.230 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:48: test_ceph_kvstore_tool: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 set TESTPREFIX TESTKEY in ./cephtool.4w7/test_invalid.mhH 2026-02-17T08:57:15.245 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.240+0000 7f923615dbc0 1 bdev(0x56120c805800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:15.245 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.240+0000 7f923615dbc0 1 bdev(0x56120c805800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:15.245 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.240+0000 7f923615dbc0 1 bdev(0x56120c805800 ./cephtool.4w7/block) close 2026-02-17T08:57:15.524 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bdev(0x56120c805800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:15.525 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bdev(0x56120c805800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:15.525 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:15.525 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bdev(0x56120c805c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:15.526 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bdev(0x56120c805c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:15.526 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:15.526 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bluefs mount 2026-02-17T08:57:15.526 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:15.527 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:15.527 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:15.527 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:15.527 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:15.527 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:15.528 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:15.528 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.520+0000 7f923615dbc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:15.533 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.528+0000 7f923615dbc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:15.533 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.528+0000 7f923615dbc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:15.533 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.528+0000 7f923615dbc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:15.533 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.528+0000 7f923615dbc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:15.533 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.528+0000 7f923615dbc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:15.534 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.528+0000 7f923615dbc0 1 freelist init 2026-02-17T08:57:15.534 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.528+0000 7f923615dbc0 1 freelist _read_cfg 2026-02-17T08:57:15.534 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.528+0000 7f923615dbc0 1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-17T08:57:15.535 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.528+0000 7f923615dbc0 0 bluestore(./cephtool.4w7) _init_alloc::NCB::restore_allocator() failed! Run Full Recovery from ONodes (might take a while) ... 2026-02-17T08:57:15.535 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.528+0000 7f923615dbc0 1 bluestore::NCB::read_allocation_from_drive_on_startup::::Allocation Recovery was completed in 0.000130 seconds, extent_count=1 2026-02-17T08:57:15.535 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.528+0000 7f923615dbc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 0 B in 0 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:15.535 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.528+0000 7f923615dbc0 1 bluefs umount 2026-02-17T08:57:15.535 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.528+0000 7f923615dbc0 1 bdev(0x56120c805c00 ./cephtool.4w7/block) close 2026-02-17T08:57:15.804 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.800+0000 7f923615dbc0 1 bdev(0x56120c805c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:15.805 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.800+0000 7f923615dbc0 1 bdev(0x56120c805c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:15.805 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.800+0000 7f923615dbc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:15.805 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.800+0000 7f923615dbc0 1 bluefs mount 2026-02-17T08:57:15.805 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.800+0000 7f923615dbc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:15.806 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.800+0000 7f923615dbc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:15.806 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.800+0000 7f923615dbc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:15.806 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.800+0000 7f923615dbc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:15.806 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.800+0000 7f923615dbc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:15.806 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.800+0000 7f923615dbc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:15.806 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.800+0000 7f923615dbc0 1 bluefs mount shared_bdev_used = 4653056 2026-02-17T08:57:15.806 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.800+0000 7f923615dbc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:15.818 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.812+0000 7f923615dbc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:15.822 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.816+0000 7f923615dbc0 1 bluefs umount 2026-02-17T08:57:15.822 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:15.816+0000 7f923615dbc0 1 bdev(0x56120c805c00 ./cephtool.4w7/block) close 2026-02-17T08:57:16.100 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.096+0000 7f923615dbc0 1 freelist shutdown 2026-02-17T08:57:16.100 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.096+0000 7f923615dbc0 1 bdev(0x56120c805800 ./cephtool.4w7/block) close 2026-02-17T08:57:16.309 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:49: test_ceph_kvstore_tool: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 exists TESTPREFIX TESTKEY 2026-02-17T08:57:16.323 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.316+0000 7ff66c2bbbc0 1 bdev(0x558691e03800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:16.323 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.316+0000 7ff66c2bbbc0 1 bdev(0x558691e03800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:16.323 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.316+0000 7ff66c2bbbc0 1 bdev(0x558691e03800 ./cephtool.4w7/block) close 2026-02-17T08:57:16.620 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bdev(0x558691e03800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:16.620 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bdev(0x558691e03800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:16.621 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:16.621 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bdev(0x558691e03c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:16.622 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bdev(0x558691e03c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:16.622 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:16.622 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bluefs mount 2026-02-17T08:57:16.622 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:16.623 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:16.623 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:16.623 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:16.623 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:16.623 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:16.623 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:16.623 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.616+0000 7ff66c2bbbc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:16.629 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.624+0000 7ff66c2bbbc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:16.629 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.624+0000 7ff66c2bbbc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:16.629 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.624+0000 7ff66c2bbbc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:16.629 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.624+0000 7ff66c2bbbc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:16.629 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.624+0000 7ff66c2bbbc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:16.629 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.624+0000 7ff66c2bbbc0 1 freelist init 2026-02-17T08:57:16.629 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.624+0000 7ff66c2bbbc0 1 freelist _read_cfg 2026-02-17T08:57:16.630 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.624+0000 7ff66c2bbbc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 100 GiB in 1 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:16.630 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.624+0000 7ff66c2bbbc0 1 bluefs umount 2026-02-17T08:57:16.630 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.624+0000 7ff66c2bbbc0 1 bdev(0x558691e03c00 ./cephtool.4w7/block) close 2026-02-17T08:57:16.908 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.904+0000 7ff66c2bbbc0 1 bdev(0x558691e03c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:16.909 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.904+0000 7ff66c2bbbc0 1 bdev(0x558691e03c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:16.909 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.904+0000 7ff66c2bbbc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:16.909 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.904+0000 7ff66c2bbbc0 1 bluefs mount 2026-02-17T08:57:16.909 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.904+0000 7ff66c2bbbc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:16.909 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.904+0000 7ff66c2bbbc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:16.910 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.904+0000 7ff66c2bbbc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:16.910 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.904+0000 7ff66c2bbbc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:16.910 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.904+0000 7ff66c2bbbc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:16.910 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.904+0000 7ff66c2bbbc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:16.910 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.904+0000 7ff66c2bbbc0 1 bluefs mount shared_bdev_used = 4915200 2026-02-17T08:57:16.910 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.904+0000 7ff66c2bbbc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:16.918 INFO:tasks.workunit.client.0.trial025.stdout:(TESTPREFIX, TESTKEY) exists 2026-02-17T08:57:16.919 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.912+0000 7ff66c2bbbc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:16.919 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.912+0000 7ff66c2bbbc0 1 bluefs umount 2026-02-17T08:57:16.919 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:16.912+0000 7ff66c2bbbc0 1 bdev(0x558691e03c00 ./cephtool.4w7/block) close 2026-02-17T08:57:17.188 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.184+0000 7ff66c2bbbc0 1 freelist shutdown 2026-02-17T08:57:17.188 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.184+0000 7ff66c2bbbc0 1 bdev(0x558691e03800 ./cephtool.4w7/block) close 2026-02-17T08:57:17.404 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:52: test_ceph_kvstore_tool: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 get TESTPREFIX TESTKEY out ./cephtool.4w7/test_invalid.mhH.bak 2026-02-17T08:57:17.417 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.412+0000 7f2a77a7abc0 1 bdev(0x55c264bf5800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:17.418 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.412+0000 7f2a77a7abc0 1 bdev(0x55c264bf5800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:17.418 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.412+0000 7f2a77a7abc0 1 bdev(0x55c264bf5800 ./cephtool.4w7/block) close 2026-02-17T08:57:17.696 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bdev(0x55c264bf5800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:17.697 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bdev(0x55c264bf5800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:17.697 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:17.697 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bdev(0x55c264bf5c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:17.698 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bdev(0x55c264bf5c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:17.698 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:17.698 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bluefs mount 2026-02-17T08:57:17.698 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:17.699 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:17.699 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:17.699 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:17.699 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:17.699 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:17.699 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:17.700 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.692+0000 7f2a77a7abc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:17.705 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.700+0000 7f2a77a7abc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:17.705 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.700+0000 7f2a77a7abc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:17.705 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.700+0000 7f2a77a7abc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:17.705 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.700+0000 7f2a77a7abc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:17.705 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.700+0000 7f2a77a7abc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:17.705 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.700+0000 7f2a77a7abc0 1 freelist init 2026-02-17T08:57:17.705 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.700+0000 7f2a77a7abc0 1 freelist _read_cfg 2026-02-17T08:57:17.705 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.700+0000 7f2a77a7abc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 100 GiB in 1 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:17.706 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.700+0000 7f2a77a7abc0 1 bluefs umount 2026-02-17T08:57:17.706 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.700+0000 7f2a77a7abc0 1 bdev(0x55c264bf5c00 ./cephtool.4w7/block) close 2026-02-17T08:57:17.976 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.972+0000 7f2a77a7abc0 1 bdev(0x55c264bf5c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:17.976 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.972+0000 7f2a77a7abc0 1 bdev(0x55c264bf5c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:17.977 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.972+0000 7f2a77a7abc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:17.977 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.972+0000 7f2a77a7abc0 1 bluefs mount 2026-02-17T08:57:17.977 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.972+0000 7f2a77a7abc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:17.977 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.972+0000 7f2a77a7abc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:17.978 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.972+0000 7f2a77a7abc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:17.978 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.972+0000 7f2a77a7abc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:17.978 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.972+0000 7f2a77a7abc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:17.978 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.972+0000 7f2a77a7abc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:17.978 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.972+0000 7f2a77a7abc0 1 bluefs mount shared_bdev_used = 4915200 2026-02-17T08:57:17.978 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.972+0000 7f2a77a7abc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:17.983 INFO:tasks.workunit.client.0.trial025.stdout:(TESTPREFIX, TESTKEY) 2026-02-17T08:57:17.984 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.976+0000 7f2a77a7abc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:17.984 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.976+0000 7f2a77a7abc0 1 bluefs umount 2026-02-17T08:57:17.984 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:17.976+0000 7f2a77a7abc0 1 bdev(0x55c264bf5c00 ./cephtool.4w7/block) close 2026-02-17T08:57:18.256 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.252+0000 7f2a77a7abc0 1 freelist shutdown 2026-02-17T08:57:18.256 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.252+0000 7f2a77a7abc0 1 bdev(0x55c264bf5800 ./cephtool.4w7/block) close 2026-02-17T08:57:18.488 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:53: test_ceph_kvstore_tool: diff ./cephtool.4w7/test_invalid.mhH ./cephtool.4w7/test_invalid.mhH.bak 2026-02-17T08:57:18.490 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:56: test_ceph_kvstore_tool: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 rm TESTPREFIX TESTKEY 2026-02-17T08:57:18.509 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.504+0000 7f69a13babc0 1 bdev(0x56405b28f800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:18.510 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.504+0000 7f69a13babc0 1 bdev(0x56405b28f800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:18.510 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.504+0000 7f69a13babc0 1 bdev(0x56405b28f800 ./cephtool.4w7/block) close 2026-02-17T08:57:18.792 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bdev(0x56405b28f800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:18.792 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bdev(0x56405b28f800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:18.792 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:18.792 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bdev(0x56405b28fc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:18.792 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bdev(0x56405b28fc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:18.792 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:18.792 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bluefs mount 2026-02-17T08:57:18.793 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:18.795 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:18.795 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:18.795 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:18.795 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:18.795 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:18.795 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:18.795 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.788+0000 7f69a13babc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:18.801 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.796+0000 7f69a13babc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:18.801 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.796+0000 7f69a13babc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:18.801 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.796+0000 7f69a13babc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:18.801 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.796+0000 7f69a13babc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:18.802 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.796+0000 7f69a13babc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:18.802 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.796+0000 7f69a13babc0 1 freelist init 2026-02-17T08:57:18.802 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.796+0000 7f69a13babc0 1 freelist _read_cfg 2026-02-17T08:57:18.802 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.796+0000 7f69a13babc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 100 GiB in 1 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:18.802 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.796+0000 7f69a13babc0 1 bluefs umount 2026-02-17T08:57:18.803 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:18.796+0000 7f69a13babc0 1 bdev(0x56405b28fc00 ./cephtool.4w7/block) close 2026-02-17T08:57:19.073 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.068+0000 7f69a13babc0 1 bdev(0x56405b28fc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:19.073 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.068+0000 7f69a13babc0 1 bdev(0x56405b28fc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:19.073 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.068+0000 7f69a13babc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:19.073 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.068+0000 7f69a13babc0 1 bluefs mount 2026-02-17T08:57:19.073 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.068+0000 7f69a13babc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:19.074 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.068+0000 7f69a13babc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:19.074 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.068+0000 7f69a13babc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:19.074 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.068+0000 7f69a13babc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:19.075 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.068+0000 7f69a13babc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:19.075 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.068+0000 7f69a13babc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:19.075 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.068+0000 7f69a13babc0 1 bluefs mount shared_bdev_used = 4915200 2026-02-17T08:57:19.075 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.068+0000 7f69a13babc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:19.081 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.076+0000 7f69a13babc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:19.084 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.076+0000 7f69a13babc0 1 bluefs umount 2026-02-17T08:57:19.084 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.076+0000 7f69a13babc0 1 bdev(0x56405b28fc00 ./cephtool.4w7/block) close 2026-02-17T08:57:19.364 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.360+0000 7f69a13babc0 1 freelist shutdown 2026-02-17T08:57:19.364 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.360+0000 7f69a13babc0 1 bdev(0x56405b28f800 ./cephtool.4w7/block) close 2026-02-17T08:57:19.580 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:57: test_ceph_kvstore_tool: expect_false ceph-kvstore-tool bluestore-kv ./cephtool.4w7 exists TESTPREFIX TESTKEY 2026-02-17T08:57:19.580 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:17: expect_false: set -x 2026-02-17T08:57:19.580 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:18: expect_false: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 exists TESTPREFIX TESTKEY 2026-02-17T08:57:19.592 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.588+0000 7f9116307bc0 1 bdev(0x55563f299800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:19.592 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.588+0000 7f9116307bc0 1 bdev(0x55563f299800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:19.593 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.588+0000 7f9116307bc0 1 bdev(0x55563f299800 ./cephtool.4w7/block) close 2026-02-17T08:57:19.881 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bdev(0x55563f299800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:19.881 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bdev(0x55563f299800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:19.881 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:19.881 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bdev(0x55563f299c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:19.881 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bdev(0x55563f299c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:19.881 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:19.881 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bluefs mount 2026-02-17T08:57:19.882 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:19.883 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:19.883 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:19.883 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:19.883 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:19.884 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:19.884 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:19.884 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.876+0000 7f9116307bc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:19.889 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.884+0000 7f9116307bc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:19.889 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.884+0000 7f9116307bc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:19.889 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.884+0000 7f9116307bc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:19.889 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.884+0000 7f9116307bc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:19.889 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.884+0000 7f9116307bc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:19.889 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.884+0000 7f9116307bc0 1 freelist init 2026-02-17T08:57:19.890 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.884+0000 7f9116307bc0 1 freelist _read_cfg 2026-02-17T08:57:19.890 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.884+0000 7f9116307bc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 100 GiB in 1 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:19.890 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.884+0000 7f9116307bc0 1 bluefs umount 2026-02-17T08:57:19.890 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:19.884+0000 7f9116307bc0 1 bdev(0x55563f299c00 ./cephtool.4w7/block) close 2026-02-17T08:57:20.160 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.156+0000 7f9116307bc0 1 bdev(0x55563f299c00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:20.160 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.156+0000 7f9116307bc0 1 bdev(0x55563f299c00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:20.160 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.156+0000 7f9116307bc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:20.160 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.156+0000 7f9116307bc0 1 bluefs mount 2026-02-17T08:57:20.160 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.156+0000 7f9116307bc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:20.161 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.156+0000 7f9116307bc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:20.161 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.156+0000 7f9116307bc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:20.161 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.156+0000 7f9116307bc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:20.161 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.156+0000 7f9116307bc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:20.161 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.156+0000 7f9116307bc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:20.161 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.156+0000 7f9116307bc0 1 bluefs mount shared_bdev_used = 4980736 2026-02-17T08:57:20.161 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.156+0000 7f9116307bc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:20.167 INFO:tasks.workunit.client.0.trial025.stdout:(TESTPREFIX, TESTKEY) does not exist 2026-02-17T08:57:20.168 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.160+0000 7f9116307bc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:20.168 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.160+0000 7f9116307bc0 1 bluefs umount 2026-02-17T08:57:20.168 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.160+0000 7f9116307bc0 1 bdev(0x55563f299c00 ./cephtool.4w7/block) close 2026-02-17T08:57:20.440 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.436+0000 7f9116307bc0 1 freelist shutdown 2026-02-17T08:57:20.440 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.436+0000 7f9116307bc0 1 bdev(0x55563f299800 ./cephtool.4w7/block) close 2026-02-17T08:57:20.677 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:18: expect_false: return 0 2026-02-17T08:57:20.677 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:60: test_ceph_kvstore_tool: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 compact 2026-02-17T08:57:20.690 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.684+0000 7fa821311bc0 1 bdev(0x56462d99b800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:20.691 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.684+0000 7fa821311bc0 1 bdev(0x56462d99b800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:20.691 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.684+0000 7fa821311bc0 1 bdev(0x56462d99b800 ./cephtool.4w7/block) close 2026-02-17T08:57:20.972 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bdev(0x56462d99b800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:20.972 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bdev(0x56462d99b800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:20.972 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:20.972 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bdev(0x56462d99bc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:20.973 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bdev(0x56462d99bc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:20.973 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:20.973 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bluefs mount 2026-02-17T08:57:20.973 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:20.975 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:20.976 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:20.976 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:20.976 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:20.976 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:20.976 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.968+0000 7fa821311bc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:20.976 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.972+0000 7fa821311bc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:20.984 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.980+0000 7fa821311bc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:20.984 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.980+0000 7fa821311bc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:20.984 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.980+0000 7fa821311bc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:20.984 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.980+0000 7fa821311bc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:20.984 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.980+0000 7fa821311bc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:20.985 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.980+0000 7fa821311bc0 1 freelist init 2026-02-17T08:57:20.985 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.980+0000 7fa821311bc0 1 freelist _read_cfg 2026-02-17T08:57:20.986 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.980+0000 7fa821311bc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 100 GiB in 1 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:20.986 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.980+0000 7fa821311bc0 1 bluefs umount 2026-02-17T08:57:20.986 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:20.980+0000 7fa821311bc0 1 bdev(0x56462d99bc00 ./cephtool.4w7/block) close 2026-02-17T08:57:21.252 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.248+0000 7fa821311bc0 1 bdev(0x56462d99bc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:21.252 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.248+0000 7fa821311bc0 1 bdev(0x56462d99bc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:21.252 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.248+0000 7fa821311bc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:21.252 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.248+0000 7fa821311bc0 1 bluefs mount 2026-02-17T08:57:21.252 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.248+0000 7fa821311bc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:21.253 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.248+0000 7fa821311bc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:21.253 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.248+0000 7fa821311bc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:21.253 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.248+0000 7fa821311bc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:21.253 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.248+0000 7fa821311bc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:21.253 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.248+0000 7fa821311bc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:21.253 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.248+0000 7fa821311bc0 1 bluefs mount shared_bdev_used = 4980736 2026-02-17T08:57:21.253 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.248+0000 7fa821311bc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:21.263 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.256+0000 7fa821311bc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:21.263 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.256+0000 7fa821311bc0 2 rocksdb: compact starting 2026-02-17T08:57:21.266 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.260+0000 7fa821311bc0 2 rocksdb: compact completed 2026-02-17T08:57:21.269 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.264+0000 7fa821311bc0 1 bluefs umount 2026-02-17T08:57:21.269 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.264+0000 7fa821311bc0 1 bdev(0x56462d99bc00 ./cephtool.4w7/block) close 2026-02-17T08:57:21.548 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.544+0000 7fa821311bc0 1 freelist shutdown 2026-02-17T08:57:21.548 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.544+0000 7fa821311bc0 1 bdev(0x56462d99b800 ./cephtool.4w7/block) close 2026-02-17T08:57:21.756 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:63: test_ceph_kvstore_tool: ceph-kvstore-tool bluestore-kv ./cephtool.4w7 destructive-repair 2026-02-17T08:57:21.770 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.764+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:21.770 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.764+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:21.770 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:21.764+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) close 2026-02-17T08:57:22.057 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:22.057 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:22.057 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:22.057 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:22.058 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:22.058 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:22.058 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount 2026-02-17T08:57:22.058 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:22.060 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.060 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.060 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.060 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.060 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.060 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:22.061 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:22.066 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:22.066 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:22.066 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:22.066 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:22.066 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:22.067 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 freelist init 2026-02-17T08:57:22.067 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 freelist _read_cfg 2026-02-17T08:57:22.068 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 100 GiB in 1 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:22.068 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluefs umount 2026-02-17T08:57:22.068 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) close 2026-02-17T08:57:22.361 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:22.361 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:22.361 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:22.361 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount 2026-02-17T08:57:22.362 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:22.362 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.363 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.363 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.363 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.363 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.363 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount shared_bdev_used = 4915200 2026-02-17T08:57:22.363 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:22.386 INFO:tasks.workunit.client.0.trial025.stdout:destructive-repair completed without reporting an error 2026-02-17T08:57:22.393 INFO:tasks.workunit.client.0.trial025.stderr:*** Caught signal (Segmentation fault) ** 2026-02-17T08:57:22.393 INFO:tasks.workunit.client.0.trial025.stderr: in thread 7fc2d9fbebc0 thread_name:ceph-kvstore-to 2026-02-17T08:57:22.393 INFO:tasks.workunit.client.0.trial025.stderr: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T08:57:22.393 INFO:tasks.workunit.client.0.trial025.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc2db1c8520] 2026-02-17T08:57:22.393 INFO:tasks.workunit.client.0.trial025.stderr: 2: (RocksDBStore::get_wholespace_iterator(unsigned int)+0xb4) [0x562376834e64] 2026-02-17T08:57:22.394 INFO:tasks.workunit.client.0.trial025.stderr: 3: (RocksDBStore::get_iterator(std::__cxx11::basic_string, std::allocator > const&, unsigned int, KeyValueDB::IteratorBounds)+0x519) [0x562376834799] 2026-02-17T08:57:22.394 INFO:tasks.workunit.client.0.trial025.stderr: 4: (BlueStore::_close_db()+0x31c) [0x562376686e6c] 2026-02-17T08:57:22.394 INFO:tasks.workunit.client.0.trial025.stderr: 5: (BlueStore::umount()+0x239) [0x562376691439] 2026-02-17T08:57:22.394 INFO:tasks.workunit.client.0.trial025.stderr: 6: ceph-kvstore-tool(+0x1f8ea3) [0x562376632ea3] 2026-02-17T08:57:22.394 INFO:tasks.workunit.client.0.trial025.stderr: 7: main() 2026-02-17T08:57:22.394 INFO:tasks.workunit.client.0.trial025.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc2db1afd90] 2026-02-17T08:57:22.394 INFO:tasks.workunit.client.0.trial025.stderr: 9: __libc_start_main() 2026-02-17T08:57:22.394 INFO:tasks.workunit.client.0.trial025.stderr: 10: _start() 2026-02-17T08:57:22.394 INFO:tasks.workunit.client.0.trial025.stderr:2026-02-17T08:57:22.380+0000 7fc2d9fbebc0 -1 *** Caught signal (Segmentation fault) ** 2026-02-17T08:57:22.394 INFO:tasks.workunit.client.0.trial025.stderr: in thread 7fc2d9fbebc0 thread_name:ceph-kvstore-to 2026-02-17T08:57:22.394 INFO:tasks.workunit.client.0.trial025.stderr: 2026-02-17T08:57:22.394 INFO:tasks.workunit.client.0.trial025.stderr: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T08:57:22.395 INFO:tasks.workunit.client.0.trial025.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc2db1c8520] 2026-02-17T08:57:22.395 INFO:tasks.workunit.client.0.trial025.stderr: 2: (RocksDBStore::get_wholespace_iterator(unsigned int)+0xb4) [0x562376834e64] 2026-02-17T08:57:22.395 INFO:tasks.workunit.client.0.trial025.stderr: 3: (RocksDBStore::get_iterator(std::__cxx11::basic_string, std::allocator > const&, unsigned int, KeyValueDB::IteratorBounds)+0x519) [0x562376834799] 2026-02-17T08:57:22.395 INFO:tasks.workunit.client.0.trial025.stderr: 4: (BlueStore::_close_db()+0x31c) [0x562376686e6c] 2026-02-17T08:57:22.395 INFO:tasks.workunit.client.0.trial025.stderr: 5: (BlueStore::umount()+0x239) [0x562376691439] 2026-02-17T08:57:22.395 INFO:tasks.workunit.client.0.trial025.stderr: 6: ceph-kvstore-tool(+0x1f8ea3) [0x562376632ea3] 2026-02-17T08:57:22.395 INFO:tasks.workunit.client.0.trial025.stderr: 7: main() 2026-02-17T08:57:22.395 INFO:tasks.workunit.client.0.trial025.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc2db1afd90] 2026-02-17T08:57:22.395 INFO:tasks.workunit.client.0.trial025.stderr: 9: __libc_start_main() 2026-02-17T08:57:22.395 INFO:tasks.workunit.client.0.trial025.stderr: 10: _start() 2026-02-17T08:57:22.395 INFO:tasks.workunit.client.0.trial025.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-17T08:57:22.395 INFO:tasks.workunit.client.0.trial025.stderr: 2026-02-17T08:57:22.396 INFO:tasks.workunit.client.0.trial025.stderr:--- begin dump of recent events --- 2026-02-17T08:57:22.396 INFO:tasks.workunit.client.0.trial025.stderr: -190> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command assert hook 0x56237cb94280 2026-02-17T08:57:22.396 INFO:tasks.workunit.client.0.trial025.stderr: -189> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command abort hook 0x56237cb94280 2026-02-17T08:57:22.396 INFO:tasks.workunit.client.0.trial025.stderr: -188> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command leak_some_memory hook 0x56237cb94280 2026-02-17T08:57:22.396 INFO:tasks.workunit.client.0.trial025.stderr: -187> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perfcounters_dump hook 0x56237cb94280 2026-02-17T08:57:22.396 INFO:tasks.workunit.client.0.trial025.stderr: -186> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command 1 hook 0x56237cb94280 2026-02-17T08:57:22.396 INFO:tasks.workunit.client.0.trial025.stderr: -185> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perf dump hook 0x56237cb94280 2026-02-17T08:57:22.396 INFO:tasks.workunit.client.0.trial025.stderr: -184> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perfcounters_schema hook 0x56237cb94280 2026-02-17T08:57:22.396 INFO:tasks.workunit.client.0.trial025.stderr: -183> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perf histogram dump hook 0x56237cb94280 2026-02-17T08:57:22.396 INFO:tasks.workunit.client.0.trial025.stderr: -182> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command 2 hook 0x56237cb94280 2026-02-17T08:57:22.396 INFO:tasks.workunit.client.0.trial025.stderr: -181> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perf schema hook 0x56237cb94280 2026-02-17T08:57:22.397 INFO:tasks.workunit.client.0.trial025.stderr: -180> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command counter dump hook 0x56237cb94280 2026-02-17T08:57:22.397 INFO:tasks.workunit.client.0.trial025.stderr: -179> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command counter schema hook 0x56237cb94280 2026-02-17T08:57:22.397 INFO:tasks.workunit.client.0.trial025.stderr: -178> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perf histogram schema hook 0x56237cb94280 2026-02-17T08:57:22.397 INFO:tasks.workunit.client.0.trial025.stderr: -177> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perf reset hook 0x56237cb94280 2026-02-17T08:57:22.397 INFO:tasks.workunit.client.0.trial025.stderr: -176> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config show hook 0x56237cb94280 2026-02-17T08:57:22.397 INFO:tasks.workunit.client.0.trial025.stderr: -175> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config help hook 0x56237cb94280 2026-02-17T08:57:22.397 INFO:tasks.workunit.client.0.trial025.stderr: -174> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config set hook 0x56237cb94280 2026-02-17T08:57:22.397 INFO:tasks.workunit.client.0.trial025.stderr: -173> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config unset hook 0x56237cb94280 2026-02-17T08:57:22.397 INFO:tasks.workunit.client.0.trial025.stderr: -172> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config get hook 0x56237cb94280 2026-02-17T08:57:22.397 INFO:tasks.workunit.client.0.trial025.stderr: -171> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config diff hook 0x56237cb94280 2026-02-17T08:57:22.397 INFO:tasks.workunit.client.0.trial025.stderr: -170> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config diff get hook 0x56237cb94280 2026-02-17T08:57:22.397 INFO:tasks.workunit.client.0.trial025.stderr: -169> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command injectargs hook 0x56237cb94280 2026-02-17T08:57:22.397 INFO:tasks.workunit.client.0.trial025.stderr: -168> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command log flush hook 0x56237cb94280 2026-02-17T08:57:22.398 INFO:tasks.workunit.client.0.trial025.stderr: -167> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command log dump hook 0x56237cb94280 2026-02-17T08:57:22.398 INFO:tasks.workunit.client.0.trial025.stderr: -166> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command log reopen hook 0x56237cb94280 2026-02-17T08:57:22.398 INFO:tasks.workunit.client.0.trial025.stderr: -165> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command dump_mempools hook 0x56237cc80068 2026-02-17T08:57:22.398 INFO:tasks.workunit.client.0.trial025.stderr: -164> 2026-02-17T08:57:21.764+0000 7fc2d9fbebc0 5 bluestore(./cephtool.4w7) _open_db_and_around::NCB::read_only=0, to_repair=1 2026-02-17T08:57:22.398 INFO:tasks.workunit.client.0.trial025.stderr: -163> 2026-02-17T08:57:21.764+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:22.398 INFO:tasks.workunit.client.0.trial025.stderr: -162> 2026-02-17T08:57:21.764+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:22.398 INFO:tasks.workunit.client.0.trial025.stderr: -161> 2026-02-17T08:57:21.764+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) close 2026-02-17T08:57:22.398 INFO:tasks.workunit.client.0.trial025.stderr: -160> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:22.398 INFO:tasks.workunit.client.0.trial025.stderr: -159> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:22.398 INFO:tasks.workunit.client.0.trial025.stderr: -158> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:22.398 INFO:tasks.workunit.client.0.trial025.stderr: -157> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore bluefs device info hook 0x56237cb942f0 2026-02-17T08:57:22.398 INFO:tasks.workunit.client.0.trial025.stderr: -156> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluefs stats hook 0x56237cb942f0 2026-02-17T08:57:22.399 INFO:tasks.workunit.client.0.trial025.stderr: -155> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluefs files list hook 0x56237cb942f0 2026-02-17T08:57:22.399 INFO:tasks.workunit.client.0.trial025.stderr: -154> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluefs debug_inject_read_zeros hook 0x56237cb942f0 2026-02-17T08:57:22.399 INFO:tasks.workunit.client.0.trial025.stderr: -153> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:22.399 INFO:tasks.workunit.client.0.trial025.stderr: -152> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:22.399 INFO:tasks.workunit.client.0.trial025.stderr: -151> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:22.399 INFO:tasks.workunit.client.0.trial025.stderr: -150> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount 2026-02-17T08:57:22.399 INFO:tasks.workunit.client.0.trial025.stderr: -149> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 5 bluefs mount super: super(uuid 3ff92788-6d08-4616-a8a6-8adc5adf44ed osd 357c4f16-c176-4358-b635-a1da5c993d9b seq 4 block_size 0x1000 log_fnode 0xfile(ino 1 size 0x0 mtime 2026-02-17T08:57:21.264986+0000 allocated 10000 alloc_commit 10000 extents [1:0xc2000~10000])) 2026-02-17T08:57:22.399 INFO:tasks.workunit.client.0.trial025.stderr: -148> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:22.399 INFO:tasks.workunit.client.0.trial025.stderr: -147> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.399 INFO:tasks.workunit.client.0.trial025.stderr: -146> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.399 INFO:tasks.workunit.client.0.trial025.stderr: -145> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.399 INFO:tasks.workunit.client.0.trial025.stderr: -144> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.400 INFO:tasks.workunit.client.0.trial025.stderr: -143> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.400 INFO:tasks.workunit.client.0.trial025.stderr: -142> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:22.400 INFO:tasks.workunit.client.0.trial025.stderr: -141> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:22.400 INFO:tasks.workunit.client.0.trial025.stderr: -140> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option writable_file_max_buffer_size = 0 2026-02-17T08:57:22.400 INFO:tasks.workunit.client.0.trial025.stderr: -139> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_base = 1073741824 2026-02-17T08:57:22.400 INFO:tasks.workunit.client.0.trial025.stderr: -138> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option level0_file_num_compaction_trigger = 8 2026-02-17T08:57:22.400 INFO:tasks.workunit.client.0.trial025.stderr: -137> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_background_jobs = 4 2026-02-17T08:57:22.400 INFO:tasks.workunit.client.0.trial025.stderr: -136> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option write_buffer_size = 16777216 2026-02-17T08:57:22.400 INFO:tasks.workunit.client.0.trial025.stderr: -135> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option compaction_style = kCompactionStyleLevel 2026-02-17T08:57:22.400 INFO:tasks.workunit.client.0.trial025.stderr: -134> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option compaction_readahead_size = 2MB 2026-02-17T08:57:22.400 INFO:tasks.workunit.client.0.trial025.stderr: -133> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_multiplier = 8 2026-02-17T08:57:22.400 INFO:tasks.workunit.client.0.trial025.stderr: -132> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_write_buffer_number = 64 2026-02-17T08:57:22.401 INFO:tasks.workunit.client.0.trial025.stderr: -131> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_total_wal_size = 1073741824 2026-02-17T08:57:22.401 INFO:tasks.workunit.client.0.trial025.stderr: -130> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option min_write_buffer_number_to_merge = 6 2026-02-17T08:57:22.401 INFO:tasks.workunit.client.0.trial025.stderr: -129> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option compression = kLZ4Compression 2026-02-17T08:57:22.401 INFO:tasks.workunit.client.0.trial025.stderr: -128> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option writable_file_max_buffer_size = 0 2026-02-17T08:57:22.401 INFO:tasks.workunit.client.0.trial025.stderr: -127> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_base = 1073741824 2026-02-17T08:57:22.401 INFO:tasks.workunit.client.0.trial025.stderr: -126> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option level0_file_num_compaction_trigger = 8 2026-02-17T08:57:22.401 INFO:tasks.workunit.client.0.trial025.stderr: -125> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_background_jobs = 4 2026-02-17T08:57:22.401 INFO:tasks.workunit.client.0.trial025.stderr: -124> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option write_buffer_size = 16777216 2026-02-17T08:57:22.401 INFO:tasks.workunit.client.0.trial025.stderr: -123> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option compaction_style = kCompactionStyleLevel 2026-02-17T08:57:22.401 INFO:tasks.workunit.client.0.trial025.stderr: -122> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option compaction_readahead_size = 2MB 2026-02-17T08:57:22.401 INFO:tasks.workunit.client.0.trial025.stderr: -121> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_multiplier = 8 2026-02-17T08:57:22.401 INFO:tasks.workunit.client.0.trial025.stderr: -120> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option max_write_buffer_number = 64 2026-02-17T08:57:22.401 INFO:tasks.workunit.client.0.trial025.stderr: -119> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option max_total_wal_size = 1073741824 2026-02-17T08:57:22.402 INFO:tasks.workunit.client.0.trial025.stderr: -118> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option min_write_buffer_number_to_merge = 6 2026-02-17T08:57:22.402 INFO:tasks.workunit.client.0.trial025.stderr: -117> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option compression = kLZ4Compression 2026-02-17T08:57:22.402 INFO:tasks.workunit.client.0.trial025.stderr: -116> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:22.402 INFO:tasks.workunit.client.0.trial025.stderr: -115> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:22.402 INFO:tasks.workunit.client.0.trial025.stderr: -114> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:22.402 INFO:tasks.workunit.client.0.trial025.stderr: -113> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore(./cephtool.4w7) _open_super_meta::NCB::freelist_type=null 2026-02-17T08:57:22.402 INFO:tasks.workunit.client.0.trial025.stderr: -112> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:22.402 INFO:tasks.workunit.client.0.trial025.stderr: -111> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:22.402 INFO:tasks.workunit.client.0.trial025.stderr: -110> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor snappy = 0 2026-02-17T08:57:22.402 INFO:tasks.workunit.client.0.trial025.stderr: -109> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load compressor snappy 2026-02-17T08:57:22.402 INFO:tasks.workunit.client.0.trial025.stderr: -108> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 add compressor snappy 0x56237ceff530 2026-02-17T08:57:22.402 INFO:tasks.workunit.client.0.trial025.stderr: -107> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor snappy = 0x56237ceff530 2026-02-17T08:57:22.403 INFO:tasks.workunit.client.0.trial025.stderr: -106> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load: compressor snappy loaded and registered 2026-02-17T08:57:22.403 INFO:tasks.workunit.client.0.trial025.stderr: -105> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor snappy = 0x56237ceff530 2026-02-17T08:57:22.403 INFO:tasks.workunit.client.0.trial025.stderr: -104> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor zlib = 0 2026-02-17T08:57:22.403 INFO:tasks.workunit.client.0.trial025.stderr: -103> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load compressor zlib 2026-02-17T08:57:22.403 INFO:tasks.workunit.client.0.trial025.stderr: -102> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 add compressor zlib 0x56237ceff440 2026-02-17T08:57:22.403 INFO:tasks.workunit.client.0.trial025.stderr: -101> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor zlib = 0x56237ceff440 2026-02-17T08:57:22.403 INFO:tasks.workunit.client.0.trial025.stderr: -100> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load: compressor zlib loaded and registered 2026-02-17T08:57:22.403 INFO:tasks.workunit.client.0.trial025.stderr: -99> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor zlib = 0x56237ceff440 2026-02-17T08:57:22.403 INFO:tasks.workunit.client.0.trial025.stderr: -98> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor zstd = 0 2026-02-17T08:57:22.403 INFO:tasks.workunit.client.0.trial025.stderr: -97> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load compressor zstd 2026-02-17T08:57:22.403 INFO:tasks.workunit.client.0.trial025.stderr: -96> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 add compressor zstd 0x56237cffe030 2026-02-17T08:57:22.403 INFO:tasks.workunit.client.0.trial025.stderr: -95> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor zstd = 0x56237cffe030 2026-02-17T08:57:22.403 INFO:tasks.workunit.client.0.trial025.stderr: -94> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load: compressor zstd loaded and registered 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -93> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor zstd = 0x56237cffe030 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -92> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor lz4 = 0 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -91> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load compressor lz4 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -90> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 add compressor lz4 0x56237cffe0c0 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -89> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor lz4 = 0x56237cffe0c0 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -88> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load: compressor lz4 loaded and registered 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -87> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor lz4 = 0x56237cffe0c0 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -86> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor snappy = 0x56237ceff530 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -85> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore(./cephtool.4w7) _open_fm::NCB::freelist_type=null 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -84> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 freelist init 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -83> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 freelist _read_cfg 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -82> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator dump block hook 0x56237cffe0f0 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -81> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator score block hook 0x56237cffe0f0 2026-02-17T08:57:22.404 INFO:tasks.workunit.client.0.trial025.stderr: -80> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator fragmentation block hook 0x56237cffe0f0 2026-02-17T08:57:22.405 INFO:tasks.workunit.client.0.trial025.stderr: -79> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator fragmentation histogram block hook 0x56237cffe0f0 2026-02-17T08:57:22.405 INFO:tasks.workunit.client.0.trial025.stderr: -78> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator dump recovery hook 0x56237cffe1b0 2026-02-17T08:57:22.405 INFO:tasks.workunit.client.0.trial025.stderr: -77> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator score recovery hook 0x56237cffe1b0 2026-02-17T08:57:22.405 INFO:tasks.workunit.client.0.trial025.stderr: -76> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator fragmentation recovery hook 0x56237cffe1b0 2026-02-17T08:57:22.405 INFO:tasks.workunit.client.0.trial025.stderr: -75> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator fragmentation histogram recovery hook 0x56237cffe1b0 2026-02-17T08:57:22.405 INFO:tasks.workunit.client.0.trial025.stderr: -74> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::__restore_allocator::file_size=132,sizeof(extent_t)=16 2026-02-17T08:57:22.405 INFO:tasks.workunit.client.0.trial025.stderr: -73> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::__restore_allocator::READ--extent_count=1, read_alloc_size= 107374174208, file_size=132 2026-02-17T08:57:22.405 INFO:tasks.workunit.client.0.trial025.stderr: -72> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::__restore_allocator::READ duration=0.000434 seconds, s_serial=3 2026-02-17T08:57:22.405 INFO:tasks.workunit.client.0.trial025.stderr: -71> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::restore_allocator:: calling copy_allocator(bitmap_allocator -> shared_alloc.a) 2026-02-17T08:57:22.405 INFO:tasks.workunit.client.0.trial025.stderr: -70> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::copy_allocator::count num_entries=1 2026-02-17T08:57:22.405 INFO:tasks.workunit.client.0.trial025.stderr: -69> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::copy_allocator::copy num_entries=1 2026-02-17T08:57:22.405 INFO:tasks.workunit.client.0.trial025.stderr: -68> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::restore_allocator::restored in 0.000659 seconds, num_entries=1 2026-02-17T08:57:22.406 INFO:tasks.workunit.client.0.trial025.stderr: -67> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluestore allocator dump recovery 2026-02-17T08:57:22.406 INFO:tasks.workunit.client.0.trial025.stderr: -66> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluestore allocator fragmentation histogram recovery 2026-02-17T08:57:22.406 INFO:tasks.workunit.client.0.trial025.stderr: -65> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluestore allocator fragmentation recovery 2026-02-17T08:57:22.406 INFO:tasks.workunit.client.0.trial025.stderr: -64> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluestore allocator score recovery 2026-02-17T08:57:22.406 INFO:tasks.workunit.client.0.trial025.stderr: -63> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore(./cephtool.4w7) _init_alloc::NCB::restore_allocator() completed successfully alloc=0x56237cf93200 2026-02-17T08:57:22.406 INFO:tasks.workunit.client.0.trial025.stderr: -62> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 100 GiB in 1 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:22.406 INFO:tasks.workunit.client.0.trial025.stderr: -61> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluefs umount 2026-02-17T08:57:22.406 INFO:tasks.workunit.client.0.trial025.stderr: -60> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluefs debug_inject_read_zeros 2026-02-17T08:57:22.406 INFO:tasks.workunit.client.0.trial025.stderr: -59> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluefs files list 2026-02-17T08:57:22.406 INFO:tasks.workunit.client.0.trial025.stderr: -58> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluefs stats 2026-02-17T08:57:22.406 INFO:tasks.workunit.client.0.trial025.stderr: -57> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluestore bluefs device info 2026-02-17T08:57:22.406 INFO:tasks.workunit.client.0.trial025.stderr: -56> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) close 2026-02-17T08:57:22.406 INFO:tasks.workunit.client.0.trial025.stderr: -55> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore bluefs device info hook 0x56237cb94b90 2026-02-17T08:57:22.407 INFO:tasks.workunit.client.0.trial025.stderr: -54> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluefs stats hook 0x56237cb94b90 2026-02-17T08:57:22.407 INFO:tasks.workunit.client.0.trial025.stderr: -53> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluefs files list hook 0x56237cb94b90 2026-02-17T08:57:22.407 INFO:tasks.workunit.client.0.trial025.stderr: -52> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluefs debug_inject_read_zeros hook 0x56237cb94b90 2026-02-17T08:57:22.407 INFO:tasks.workunit.client.0.trial025.stderr: -51> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:22.407 INFO:tasks.workunit.client.0.trial025.stderr: -50> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:22.407 INFO:tasks.workunit.client.0.trial025.stderr: -49> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:22.407 INFO:tasks.workunit.client.0.trial025.stderr: -48> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount 2026-02-17T08:57:22.407 INFO:tasks.workunit.client.0.trial025.stderr: -47> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 5 bluefs mount super: super(uuid 3ff92788-6d08-4616-a8a6-8adc5adf44ed osd 357c4f16-c176-4358-b635-a1da5c993d9b seq 4 block_size 0x1000 log_fnode 0xfile(ino 1 size 0x0 mtime 2026-02-17T08:57:21.264986+0000 allocated 10000 alloc_commit 10000 extents [1:0xc2000~10000])) 2026-02-17T08:57:22.407 INFO:tasks.workunit.client.0.trial025.stderr: -46> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:22.407 INFO:tasks.workunit.client.0.trial025.stderr: -45> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.407 INFO:tasks.workunit.client.0.trial025.stderr: -44> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.407 INFO:tasks.workunit.client.0.trial025.stderr: -43> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -42> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -41> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -40> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount shared_bdev_used = 4915200 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -39> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -38> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option writable_file_max_buffer_size = 0 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -37> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_base = 1073741824 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -36> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option level0_file_num_compaction_trigger = 8 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -35> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_background_jobs = 4 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -34> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option write_buffer_size = 16777216 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -33> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option compaction_style = kCompactionStyleLevel 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -32> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option compaction_readahead_size = 2MB 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -31> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_multiplier = 8 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -30> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_write_buffer_number = 64 2026-02-17T08:57:22.408 INFO:tasks.workunit.client.0.trial025.stderr: -29> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_total_wal_size = 1073741824 2026-02-17T08:57:22.409 INFO:tasks.workunit.client.0.trial025.stderr: -28> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option min_write_buffer_number_to_merge = 6 2026-02-17T08:57:22.409 INFO:tasks.workunit.client.0.trial025.stderr: -27> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option compression = kLZ4Compression 2026-02-17T08:57:22.409 INFO:tasks.workunit.client.0.trial025.stderr: -26> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 5 bluestore::NCB::invalidate_allocation_file_on_bluefs::invalidate using bluefs->truncate(p_handle, 0) 2026-02-17T08:57:22.409 INFO:tasks.workunit.client.0.trial025.stderr: -25> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option writable_file_max_buffer_size = 0 2026-02-17T08:57:22.409 INFO:tasks.workunit.client.0.trial025.stderr: -24> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_base = 1073741824 2026-02-17T08:57:22.409 INFO:tasks.workunit.client.0.trial025.stderr: -23> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option level0_file_num_compaction_trigger = 8 2026-02-17T08:57:22.409 INFO:tasks.workunit.client.0.trial025.stderr: -22> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_background_jobs = 4 2026-02-17T08:57:22.409 INFO:tasks.workunit.client.0.trial025.stderr: -21> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option write_buffer_size = 16777216 2026-02-17T08:57:22.409 INFO:tasks.workunit.client.0.trial025.stderr: -20> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option compaction_style = kCompactionStyleLevel 2026-02-17T08:57:22.409 INFO:tasks.workunit.client.0.trial025.stderr: -19> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option compaction_readahead_size = 2MB 2026-02-17T08:57:22.409 INFO:tasks.workunit.client.0.trial025.stderr: -18> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_multiplier = 8 2026-02-17T08:57:22.409 INFO:tasks.workunit.client.0.trial025.stderr: -17> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_write_buffer_number = 64 2026-02-17T08:57:22.410 INFO:tasks.workunit.client.0.trial025.stderr: -16> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_total_wal_size = 1073741824 2026-02-17T08:57:22.410 INFO:tasks.workunit.client.0.trial025.stderr: -15> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option min_write_buffer_number_to_merge = 6 2026-02-17T08:57:22.410 INFO:tasks.workunit.client.0.trial025.stderr: -14> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option compression = kLZ4Compression 2026-02-17T08:57:22.410 INFO:tasks.workunit.client.0.trial025.stderr: -13> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option writable_file_max_buffer_size = 0 2026-02-17T08:57:22.410 INFO:tasks.workunit.client.0.trial025.stderr: -12> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_base = 1073741824 2026-02-17T08:57:22.410 INFO:tasks.workunit.client.0.trial025.stderr: -11> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option level0_file_num_compaction_trigger = 8 2026-02-17T08:57:22.410 INFO:tasks.workunit.client.0.trial025.stderr: -10> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option max_background_jobs = 4 2026-02-17T08:57:22.410 INFO:tasks.workunit.client.0.trial025.stderr: -9> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option write_buffer_size = 16777216 2026-02-17T08:57:22.410 INFO:tasks.workunit.client.0.trial025.stderr: -8> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option compaction_style = kCompactionStyleLevel 2026-02-17T08:57:22.410 INFO:tasks.workunit.client.0.trial025.stderr: -7> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option compaction_readahead_size = 2MB 2026-02-17T08:57:22.410 INFO:tasks.workunit.client.0.trial025.stderr: -6> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_multiplier = 8 2026-02-17T08:57:22.410 INFO:tasks.workunit.client.0.trial025.stderr: -5> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option max_write_buffer_number = 64 2026-02-17T08:57:22.410 INFO:tasks.workunit.client.0.trial025.stderr: -4> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option max_total_wal_size = 1073741824 2026-02-17T08:57:22.411 INFO:tasks.workunit.client.0.trial025.stderr: -3> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option min_write_buffer_number_to_merge = 6 2026-02-17T08:57:22.411 INFO:tasks.workunit.client.0.trial025.stderr: -2> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option compression = kLZ4Compression 2026-02-17T08:57:22.411 INFO:tasks.workunit.client.0.trial025.stderr: -1> 2026-02-17T08:57:22.380+0000 7fc2d9fbebc0 5 bluestore(./cephtool.4w7) umount 2026-02-17T08:57:22.411 INFO:tasks.workunit.client.0.trial025.stderr: 0> 2026-02-17T08:57:22.380+0000 7fc2d9fbebc0 -1 *** Caught signal (Segmentation fault) ** 2026-02-17T08:57:22.411 INFO:tasks.workunit.client.0.trial025.stderr: in thread 7fc2d9fbebc0 thread_name:ceph-kvstore-to 2026-02-17T08:57:22.411 INFO:tasks.workunit.client.0.trial025.stderr: 2026-02-17T08:57:22.411 INFO:tasks.workunit.client.0.trial025.stderr: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T08:57:22.411 INFO:tasks.workunit.client.0.trial025.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc2db1c8520] 2026-02-17T08:57:22.411 INFO:tasks.workunit.client.0.trial025.stderr: 2: (RocksDBStore::get_wholespace_iterator(unsigned int)+0xb4) [0x562376834e64] 2026-02-17T08:57:22.411 INFO:tasks.workunit.client.0.trial025.stderr: 3: (RocksDBStore::get_iterator(std::__cxx11::basic_string, std::allocator > const&, unsigned int, KeyValueDB::IteratorBounds)+0x519) [0x562376834799] 2026-02-17T08:57:22.411 INFO:tasks.workunit.client.0.trial025.stderr: 4: (BlueStore::_close_db()+0x31c) [0x562376686e6c] 2026-02-17T08:57:22.411 INFO:tasks.workunit.client.0.trial025.stderr: 5: (BlueStore::umount()+0x239) [0x562376691439] 2026-02-17T08:57:22.412 INFO:tasks.workunit.client.0.trial025.stderr: 6: ceph-kvstore-tool(+0x1f8ea3) [0x562376632ea3] 2026-02-17T08:57:22.412 INFO:tasks.workunit.client.0.trial025.stderr: 7: main() 2026-02-17T08:57:22.412 INFO:tasks.workunit.client.0.trial025.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc2db1afd90] 2026-02-17T08:57:22.412 INFO:tasks.workunit.client.0.trial025.stderr: 9: __libc_start_main() 2026-02-17T08:57:22.412 INFO:tasks.workunit.client.0.trial025.stderr: 10: _start() 2026-02-17T08:57:22.412 INFO:tasks.workunit.client.0.trial025.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-17T08:57:22.412 INFO:tasks.workunit.client.0.trial025.stderr: 2026-02-17T08:57:22.412 INFO:tasks.workunit.client.0.trial025.stderr:--- logging levels --- 2026-02-17T08:57:22.412 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 none 2026-02-17T08:57:22.412 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 lockdep 2026-02-17T08:57:22.412 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 context 2026-02-17T08:57:22.412 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 1 crush 2026-02-17T08:57:22.413 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mds 2026-02-17T08:57:22.413 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mds_balancer 2026-02-17T08:57:22.413 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mds_locker 2026-02-17T08:57:22.413 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mds_log 2026-02-17T08:57:22.413 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mds_log_expire 2026-02-17T08:57:22.413 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mds_migrator 2026-02-17T08:57:22.413 INFO:tasks.workunit.client.0.trial025.stderr: 3/ 5 mds_quiesce 2026-02-17T08:57:22.413 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 buffer 2026-02-17T08:57:22.413 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 timer 2026-02-17T08:57:22.413 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 filer 2026-02-17T08:57:22.413 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 striper 2026-02-17T08:57:22.413 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 objecter 2026-02-17T08:57:22.414 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 rados 2026-02-17T08:57:22.414 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 rbd 2026-02-17T08:57:22.414 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 rbd_mirror 2026-02-17T08:57:22.414 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 rbd_replay 2026-02-17T08:57:22.414 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 rbd_pwl 2026-02-17T08:57:22.414 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 journaler 2026-02-17T08:57:22.414 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 objectcacher 2026-02-17T08:57:22.414 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 immutable_obj_cache 2026-02-17T08:57:22.414 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 client 2026-02-17T08:57:22.414 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 osd 2026-02-17T08:57:22.414 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 optracker 2026-02-17T08:57:22.414 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 objclass 2026-02-17T08:57:22.414 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 3 filestore 2026-02-17T08:57:22.415 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 3 journal 2026-02-17T08:57:22.415 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 0 ms 2026-02-17T08:57:22.415 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mon 2026-02-17T08:57:22.415 INFO:tasks.workunit.client.0.trial025.stderr: 0/10 monc 2026-02-17T08:57:22.415 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 paxos 2026-02-17T08:57:22.415 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 tp 2026-02-17T08:57:22.415 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 auth 2026-02-17T08:57:22.415 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 crypto 2026-02-17T08:57:22.415 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 1 finisher 2026-02-17T08:57:22.415 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 1 reserver 2026-02-17T08:57:22.415 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 heartbeatmap 2026-02-17T08:57:22.415 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 perfcounter 2026-02-17T08:57:22.415 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw 2026-02-17T08:57:22.416 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_sync 2026-02-17T08:57:22.416 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_datacache 2026-02-17T08:57:22.416 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_access 2026-02-17T08:57:22.416 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_dbstore 2026-02-17T08:57:22.416 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_flight 2026-02-17T08:57:22.416 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_lifecycle 2026-02-17T08:57:22.416 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_notification 2026-02-17T08:57:22.416 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 javaclient 2026-02-17T08:57:22.416 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 asok 2026-02-17T08:57:22.416 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 1 throttle 2026-02-17T08:57:22.416 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 0 refs 2026-02-17T08:57:22.416 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 compressor 2026-02-17T08:57:22.416 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 bluestore 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 bluefs 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 3 bdev 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 kstore 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 2/ 2 rocksdb 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 fuse 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 2/ 5 mgr 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mgrc 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 dpdk 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 eventtrace 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 prioritycache 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 test 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 cephfs_mirror 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 cephsqlite 2026-02-17T08:57:22.417 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 crimson_interrupt 2026-02-17T08:57:22.418 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore 2026-02-17T08:57:22.418 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_onode 2026-02-17T08:57:22.418 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_odata 2026-02-17T08:57:22.418 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_omap 2026-02-17T08:57:22.418 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_tm 2026-02-17T08:57:22.418 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_t 2026-02-17T08:57:22.418 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_cleaner 2026-02-17T08:57:22.418 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_epm 2026-02-17T08:57:22.418 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_lba 2026-02-17T08:57:22.418 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_fixedkv_tree 2026-02-17T08:57:22.418 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_cache 2026-02-17T08:57:22.418 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_journal 2026-02-17T08:57:22.418 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_device 2026-02-17T08:57:22.419 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_backref 2026-02-17T08:57:22.419 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 alienstore 2026-02-17T08:57:22.419 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mclock 2026-02-17T08:57:22.419 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 cyanstore 2026-02-17T08:57:22.419 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 ceph_exporter 2026-02-17T08:57:22.419 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 memstore 2026-02-17T08:57:22.419 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 trace 2026-02-17T08:57:22.419 INFO:tasks.workunit.client.0.trial025.stderr: -2/-2 (syslog threshold) 2026-02-17T08:57:22.419 INFO:tasks.workunit.client.0.trial025.stderr: 99/99 (stderr threshold) 2026-02-17T08:57:22.419 INFO:tasks.workunit.client.0.trial025.stderr:--- pthread ID / name mapping for recent threads --- 2026-02-17T08:57:22.419 INFO:tasks.workunit.client.0.trial025.stderr: 7fc2d9fbebc0 / ceph-kvstore-to 2026-02-17T08:57:22.419 INFO:tasks.workunit.client.0.trial025.stderr: max_recent 500 2026-02-17T08:57:22.419 INFO:tasks.workunit.client.0.trial025.stderr: max_new 1000 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr: log_file 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr:--- end dump of recent events --- 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr:--- begin dump of recent events --- 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr: -190> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command assert hook 0x56237cb94280 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr: -189> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command abort hook 0x56237cb94280 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr: -188> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command leak_some_memory hook 0x56237cb94280 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr: -187> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perfcounters_dump hook 0x56237cb94280 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr: -186> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command 1 hook 0x56237cb94280 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr: -185> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perf dump hook 0x56237cb94280 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr: -184> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perfcounters_schema hook 0x56237cb94280 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr: -183> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perf histogram dump hook 0x56237cb94280 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr: -182> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command 2 hook 0x56237cb94280 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr: -181> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perf schema hook 0x56237cb94280 2026-02-17T08:57:22.420 INFO:tasks.workunit.client.0.trial025.stderr: -180> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command counter dump hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -179> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command counter schema hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -178> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perf histogram schema hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -177> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command perf reset hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -176> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config show hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -175> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config help hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -174> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config set hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -173> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config unset hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -172> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config get hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -171> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config diff hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -170> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command config diff get hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -169> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command injectargs hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -168> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command log flush hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -167> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command log dump hook 0x56237cb94280 2026-02-17T08:57:22.421 INFO:tasks.workunit.client.0.trial025.stderr: -166> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command log reopen hook 0x56237cb94280 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -165> 2026-02-17T08:57:21.760+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command dump_mempools hook 0x56237cc80068 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -164> 2026-02-17T08:57:21.764+0000 7fc2d9fbebc0 5 bluestore(./cephtool.4w7) _open_db_and_around::NCB::read_only=0, to_repair=1 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -163> 2026-02-17T08:57:21.764+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -162> 2026-02-17T08:57:21.764+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -161> 2026-02-17T08:57:21.764+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) close 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -160> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -159> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bdev(0x56237cbbb800 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -158> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -157> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore bluefs device info hook 0x56237cb942f0 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -156> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluefs stats hook 0x56237cb942f0 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -155> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluefs files list hook 0x56237cb942f0 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -154> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluefs debug_inject_read_zeros hook 0x56237cb942f0 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -153> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:22.422 INFO:tasks.workunit.client.0.trial025.stderr: -152> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -151> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -150> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -149> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 5 bluefs mount super: super(uuid 3ff92788-6d08-4616-a8a6-8adc5adf44ed osd 357c4f16-c176-4358-b635-a1da5c993d9b seq 4 block_size 0x1000 log_fnode 0xfile(ino 1 size 0x0 mtime 2026-02-17T08:57:21.264986+0000 allocated 10000 alloc_commit 10000 extents [1:0xc2000~10000])) 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -148> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -147> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -146> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -145> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -144> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -143> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -142> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluefs mount shared_bdev_used = 0 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -141> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -140> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option writable_file_max_buffer_size = 0 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -139> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_base = 1073741824 2026-02-17T08:57:22.423 INFO:tasks.workunit.client.0.trial025.stderr: -138> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option level0_file_num_compaction_trigger = 8 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -137> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_background_jobs = 4 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -136> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option write_buffer_size = 16777216 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -135> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option compaction_style = kCompactionStyleLevel 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -134> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option compaction_readahead_size = 2MB 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -133> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_multiplier = 8 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -132> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_write_buffer_number = 64 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -131> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_total_wal_size = 1073741824 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -130> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option min_write_buffer_number_to_merge = 6 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -129> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option compression = kLZ4Compression 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -128> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option writable_file_max_buffer_size = 0 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -127> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_base = 1073741824 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -126> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option level0_file_num_compaction_trigger = 8 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -125> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option max_background_jobs = 4 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -124> 2026-02-17T08:57:22.052+0000 7fc2d9fbebc0 1 set rocksdb option write_buffer_size = 16777216 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -123> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option compaction_style = kCompactionStyleLevel 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -122> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option compaction_readahead_size = 2MB 2026-02-17T08:57:22.424 INFO:tasks.workunit.client.0.trial025.stderr: -121> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_multiplier = 8 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -120> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option max_write_buffer_number = 64 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -119> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option max_total_wal_size = 1073741824 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -118> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option min_write_buffer_number_to_merge = 6 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -117> 2026-02-17T08:57:22.056+0000 7fc2d9fbebc0 1 set rocksdb option compression = kLZ4Compression 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -116> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -115> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_super_meta old nid_max 0 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -114> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_super_meta old blobid_max 0 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -113> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore(./cephtool.4w7) _open_super_meta::NCB::freelist_type=null 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -112> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -111> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _open_super_meta min_alloc_size 0x1000 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -110> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor snappy = 0 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -109> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load compressor snappy 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -108> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 add compressor snappy 0x56237ceff530 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -107> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor snappy = 0x56237ceff530 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -106> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load: compressor snappy loaded and registered 2026-02-17T08:57:22.425 INFO:tasks.workunit.client.0.trial025.stderr: -105> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor snappy = 0x56237ceff530 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -104> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor zlib = 0 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -103> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load compressor zlib 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -102> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 add compressor zlib 0x56237ceff440 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -101> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor zlib = 0x56237ceff440 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -100> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load: compressor zlib loaded and registered 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -99> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor zlib = 0x56237ceff440 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -98> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor zstd = 0 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -97> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load compressor zstd 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -96> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 add compressor zstd 0x56237cffe030 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -95> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor zstd = 0x56237cffe030 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -94> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load: compressor zstd loaded and registered 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -93> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor zstd = 0x56237cffe030 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -92> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor lz4 = 0 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -91> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load compressor lz4 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -90> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 add compressor lz4 0x56237cffe0c0 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -89> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor lz4 = 0x56237cffe0c0 2026-02-17T08:57:22.426 INFO:tasks.workunit.client.0.trial025.stderr: -88> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 load: compressor lz4 loaded and registered 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -87> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor lz4 = 0x56237cffe0c0 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -86> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 get compressor snappy = 0x56237ceff530 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -85> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore(./cephtool.4w7) _open_fm::NCB::freelist_type=null 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -84> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 freelist init 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -83> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 freelist _read_cfg 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -82> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator dump block hook 0x56237cffe0f0 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -81> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator score block hook 0x56237cffe0f0 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -80> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator fragmentation block hook 0x56237cffe0f0 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -79> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator fragmentation histogram block hook 0x56237cffe0f0 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -78> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator dump recovery hook 0x56237cffe1b0 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -77> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator score recovery hook 0x56237cffe1b0 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -76> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator fragmentation recovery hook 0x56237cffe1b0 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -75> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore allocator fragmentation histogram recovery hook 0x56237cffe1b0 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -74> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::__restore_allocator::file_size=132,sizeof(extent_t)=16 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -73> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::__restore_allocator::READ--extent_count=1, read_alloc_size= 107374174208, file_size=132 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -72> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::__restore_allocator::READ duration=0.000434 seconds, s_serial=3 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -71> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::restore_allocator:: calling copy_allocator(bitmap_allocator -> shared_alloc.a) 2026-02-17T08:57:22.427 INFO:tasks.workunit.client.0.trial025.stderr: -70> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::copy_allocator::count num_entries=1 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -69> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::copy_allocator::copy num_entries=1 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -68> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore::NCB::restore_allocator::restored in 0.000659 seconds, num_entries=1 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -67> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluestore allocator dump recovery 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -66> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluestore allocator fragmentation histogram recovery 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -65> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluestore allocator fragmentation recovery 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -64> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluestore allocator score recovery 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -63> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 bluestore(./cephtool.4w7) _init_alloc::NCB::restore_allocator() completed successfully alloc=0x56237cf93200 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -62> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _init_alloc loaded 100 GiB in 1 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18ffffe000, fragmentation 0 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -61> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bluefs umount 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -60> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluefs debug_inject_read_zeros 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -59> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluefs files list 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -58> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluefs stats 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -57> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) unregister_commands bluestore bluefs device info 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -56> 2026-02-17T08:57:22.060+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) close 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -55> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluestore bluefs device info hook 0x56237cb94b90 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -54> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluefs stats hook 0x56237cb94b90 2026-02-17T08:57:22.428 INFO:tasks.workunit.client.0.trial025.stderr: -53> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluefs files list hook 0x56237cb94b90 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -52> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 5 asok(0x56237cc22000) register_command bluefs debug_inject_read_zeros hook 0x56237cb94b90 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -51> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) open path ./cephtool.4w7/block 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -50> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bdev(0x56237cbbbc00 ./cephtool.4w7/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -49> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs add_block_device bdev 1 path ./cephtool.4w7/block size 100 GiB 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -48> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -47> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 5 bluefs mount super: super(uuid 3ff92788-6d08-4616-a8a6-8adc5adf44ed osd 357c4f16-c176-4358-b635-a1da5c993d9b seq 4 block_size 0x1000 log_fnode 0xfile(ino 1 size 0x0 mtime 2026-02-17T08:57:21.264986+0000 allocated 10000 alloc_commit 10000 extents [1:0xc2000~10000])) 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -46> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -45> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -44> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -43> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -42> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -41> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -40> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluefs mount shared_bdev_used = 4915200 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -39> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 bluestore(./cephtool.4w7) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -38> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option writable_file_max_buffer_size = 0 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -37> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_base = 1073741824 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -36> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option level0_file_num_compaction_trigger = 8 2026-02-17T08:57:22.429 INFO:tasks.workunit.client.0.trial025.stderr: -35> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_background_jobs = 4 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -34> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option write_buffer_size = 16777216 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -33> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option compaction_style = kCompactionStyleLevel 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -32> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option compaction_readahead_size = 2MB 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -31> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_multiplier = 8 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -30> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_write_buffer_number = 64 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -29> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_total_wal_size = 1073741824 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -28> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option min_write_buffer_number_to_merge = 6 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -27> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option compression = kLZ4Compression 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -26> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 5 bluestore::NCB::invalidate_allocation_file_on_bluefs::invalidate using bluefs->truncate(p_handle, 0) 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -25> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option writable_file_max_buffer_size = 0 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -24> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_base = 1073741824 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -23> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option level0_file_num_compaction_trigger = 8 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -22> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_background_jobs = 4 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -21> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option write_buffer_size = 16777216 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -20> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option compaction_style = kCompactionStyleLevel 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -19> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option compaction_readahead_size = 2MB 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -18> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_multiplier = 8 2026-02-17T08:57:22.430 INFO:tasks.workunit.client.0.trial025.stderr: -17> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_write_buffer_number = 64 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -16> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option max_total_wal_size = 1073741824 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -15> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option min_write_buffer_number_to_merge = 6 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -14> 2026-02-17T08:57:22.356+0000 7fc2d9fbebc0 1 set rocksdb option compression = kLZ4Compression 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -13> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option writable_file_max_buffer_size = 0 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -12> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_base = 1073741824 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -11> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option level0_file_num_compaction_trigger = 8 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -10> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option max_background_jobs = 4 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -9> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option write_buffer_size = 16777216 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -8> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option compaction_style = kCompactionStyleLevel 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -7> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option compaction_readahead_size = 2MB 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -6> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option max_bytes_for_level_multiplier = 8 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -5> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option max_write_buffer_number = 64 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -4> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option max_total_wal_size = 1073741824 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -3> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option min_write_buffer_number_to_merge = 6 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -2> 2026-02-17T08:57:22.360+0000 7fc2d9fbebc0 1 set rocksdb option compression = kLZ4Compression 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: -1> 2026-02-17T08:57:22.380+0000 7fc2d9fbebc0 5 bluestore(./cephtool.4w7) umount 2026-02-17T08:57:22.431 INFO:tasks.workunit.client.0.trial025.stderr: 0> 2026-02-17T08:57:22.380+0000 7fc2d9fbebc0 -1 *** Caught signal (Segmentation fault) ** 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: in thread 7fc2d9fbebc0 thread_name:ceph-kvstore-to 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc2db1c8520] 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: 2: (RocksDBStore::get_wholespace_iterator(unsigned int)+0xb4) [0x562376834e64] 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: 3: (RocksDBStore::get_iterator(std::__cxx11::basic_string, std::allocator > const&, unsigned int, KeyValueDB::IteratorBounds)+0x519) [0x562376834799] 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: 4: (BlueStore::_close_db()+0x31c) [0x562376686e6c] 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: 5: (BlueStore::umount()+0x239) [0x562376691439] 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: 6: ceph-kvstore-tool(+0x1f8ea3) [0x562376632ea3] 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: 7: main() 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc2db1afd90] 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: 9: __libc_start_main() 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: 10: _start() 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr:--- logging levels --- 2026-02-17T08:57:22.432 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 none 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 lockdep 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 context 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 1 crush 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mds 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mds_balancer 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mds_locker 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mds_log 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mds_log_expire 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mds_migrator 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 3/ 5 mds_quiesce 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 buffer 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 timer 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 filer 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 striper 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 1 objecter 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 rados 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 rbd 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 rbd_mirror 2026-02-17T08:57:22.433 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 rbd_replay 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 rbd_pwl 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 journaler 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 objectcacher 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 immutable_obj_cache 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 client 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 osd 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 optracker 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 objclass 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 3 filestore 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 3 journal 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 0 ms 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mon 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 0/10 monc 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 paxos 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 tp 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 auth 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 crypto 2026-02-17T08:57:22.434 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 1 finisher 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 1 reserver 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 heartbeatmap 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 perfcounter 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_sync 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_datacache 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_access 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_dbstore 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_flight 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_lifecycle 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 rgw_notification 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 javaclient 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 asok 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 1 throttle 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 0 refs 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 compressor 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 bluestore 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 bluefs 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 3 bdev 2026-02-17T08:57:22.435 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 kstore 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 2/ 2 rocksdb 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 fuse 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 2/ 5 mgr 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mgrc 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 dpdk 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 eventtrace 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 prioritycache 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 test 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 cephfs_mirror 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 cephsqlite 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 crimson_interrupt 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_onode 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_odata 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_omap 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_tm 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_t 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_cleaner 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_epm 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_lba 2026-02-17T08:57:22.436 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_fixedkv_tree 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_cache 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_journal 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_device 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 seastore_backref 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 alienstore 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 mclock 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: 0/ 5 cyanstore 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 ceph_exporter 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 memstore 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: 1/ 5 trace 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: -2/-2 (syslog threshold) 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: 99/99 (stderr threshold) 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr:--- pthread ID / name mapping for recent threads --- 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: 7fc2d9fbebc0 / ceph-kvstore-to 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: max_recent 500 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: max_new 1000 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr: log_file /var/lib/ceph/crash/2026-02-17T08:57:22.383336Z_4e28c0f1-8426-4608-b76e-90144b27dc38/log 2026-02-17T08:57:22.437 INFO:tasks.workunit.client.0.trial025.stderr:--- end dump of recent events --- 2026-02-17T08:57:22.461 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh: line 27: 23097 Segmentation fault (core dumped) ceph-kvstore-tool bluestore-kv ${TEMP_DIR} destructive-repair 2026-02-17T08:57:22.461 INFO:tasks.workunit.client.0.trial025.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh:1: test_ceph_kvstore_tool: rm -fr ./cephtool.4w7 2026-02-17T08:57:22.463 DEBUG:teuthology.orchestra.run:got remote process result: 139 2026-02-17T08:57:22.463 INFO:tasks.workunit:Stopping ['cephtool/test_kvstore_tool.sh'] on client.0... 2026-02-17T08:57:22.463 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T08:57:22.769 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/workunit.py", line 144, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/workunit.py", line 292, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/workunit.py", line 433, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test cephtool/test_kvstore_tool.sh) on trial025 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh' 2026-02-17T08:57:22.771 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T08:57:22.779 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T08:57:22.779 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T08:57:22.924 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:57:22.924 INFO:teuthology.orchestra.run.trial025.stderr:dumped all 2026-02-17T08:57:22.935 INFO:teuthology.orchestra.run.trial025.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2026-02-17T08:57:22.079349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81232,"kb_used_data":344,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491568,"statfs":{"total":322122547200,"available":322039365632,"internally_reserved":0,"allocated":352256,"data_stored":90044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":82767189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001448"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931424+0000","last_change":"2026-02-17T08:56:40.103424+0000","last_active":"2026-02-17T08:56:46.931424+0000","last_peered":"2026-02-17T08:56:46.931424+0000","last_clean":"2026-02-17T08:56:46.931424+0000","last_became_active":"2026-02-17T08:56:38.099789+0000","last_became_peered":"2026-02-17T08:56:38.099789+0000","last_unstale":"2026-02-17T08:56:46.931424+0000","last_undegraded":"2026-02-17T08:56:46.931424+0000","last_fullsized":"2026-02-17T08:56:46.931424+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:47:01.052648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931414+0000","last_change":"2026-02-17T08:56:40.103306+0000","last_active":"2026-02-17T08:56:46.931414+0000","last_peered":"2026-02-17T08:56:46.931414+0000","last_clean":"2026-02-17T08:56:46.931414+0000","last_became_active":"2026-02-17T08:56:38.100176+0000","last_became_peered":"2026-02-17T08:56:38.100176+0000","last_unstale":"2026-02-17T08:56:46.931414+0000","last_undegraded":"2026-02-17T08:56:46.931414+0000","last_fullsized":"2026-02-17T08:56:46.931414+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:48:49.184861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000254799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:47.875480+0000","last_change":"2026-02-17T08:56:40.100120+0000","last_active":"2026-02-17T08:56:47.875480+0000","last_peered":"2026-02-17T08:56:47.875480+0000","last_clean":"2026-02-17T08:56:47.875480+0000","last_became_active":"2026-02-17T08:56:38.099739+0000","last_became_peered":"2026-02-17T08:56:38.099739+0000","last_unstale":"2026-02-17T08:56:47.875480+0000","last_undegraded":"2026-02-17T08:56:47.875480+0000","last_fullsized":"2026-02-17T08:56:47.875480+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:47:08.363009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931409+0000","last_change":"2026-02-17T08:56:40.103577+0000","last_active":"2026-02-17T08:56:46.931409+0000","last_peered":"2026-02-17T08:56:46.931409+0000","last_clean":"2026-02-17T08:56:46.931409+0000","last_became_active":"2026-02-17T08:56:38.100197+0000","last_became_peered":"2026-02-17T08:56:38.100197+0000","last_unstale":"2026-02-17T08:56:46.931409+0000","last_undegraded":"2026-02-17T08:56:46.931409+0000","last_fullsized":"2026-02-17T08:56:46.931409+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:18:08.960294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050294700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"10'1","reported_seq":22,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931392+0000","last_change":"2026-02-17T08:56:40.103478+0000","last_active":"2026-02-17T08:56:46.931392+0000","last_peered":"2026-02-17T08:56:46.931392+0000","last_clean":"2026-02-17T08:56:46.931392+0000","last_became_active":"2026-02-17T08:56:38.099787+0000","last_became_peered":"2026-02-17T08:56:38.099787+0000","last_unstale":"2026-02-17T08:56:46.931392+0000","last_undegraded":"2026-02-17T08:56:46.931392+0000","last_fullsized":"2026-02-17T08:56:46.931392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:22:08.112761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"12'2","reported_seq":23,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:47.483877+0000","last_change":"2026-02-17T08:56:40.102144+0000","last_active":"2026-02-17T08:56:47.483877+0000","last_peered":"2026-02-17T08:56:47.483877+0000","last_clean":"2026-02-17T08:56:47.483877+0000","last_became_active":"2026-02-17T08:56:38.099655+0000","last_became_peered":"2026-02-17T08:56:38.099655+0000","last_unstale":"2026-02-17T08:56:47.483877+0000","last_undegraded":"2026-02-17T08:56:47.483877+0000","last_fullsized":"2026-02-17T08:56:47.483877+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:49:07.787596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052371500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:47.875469+0000","last_change":"2026-02-17T08:56:40.100138+0000","last_active":"2026-02-17T08:56:47.875469+0000","last_peered":"2026-02-17T08:56:47.875469+0000","last_clean":"2026-02-17T08:56:47.875469+0000","last_became_active":"2026-02-17T08:56:38.099710+0000","last_became_peered":"2026-02-17T08:56:38.099710+0000","last_unstale":"2026-02-17T08:56:47.875469+0000","last_undegraded":"2026-02-17T08:56:47.875469+0000","last_fullsized":"2026-02-17T08:56:47.875469+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:16:19.039429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000256703,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931392+0000","last_change":"2026-02-17T08:56:40.103298+0000","last_active":"2026-02-17T08:56:46.931392+0000","last_peered":"2026-02-17T08:56:46.931392+0000","last_clean":"2026-02-17T08:56:46.931392+0000","last_became_active":"2026-02-17T08:56:38.100217+0000","last_became_peered":"2026-02-17T08:56:38.100217+0000","last_unstale":"2026-02-17T08:56:46.931392+0000","last_undegraded":"2026-02-17T08:56:46.931392+0000","last_fullsized":"2026-02-17T08:56:46.931392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:43:00.380089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027119900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738380,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":114688,"data_stored":30002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27080,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830520,"statfs":{"total":107374182400,"available":107346452480,"internally_reserved":0,"allocated":118784,"data_stored":30021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":118784,"data_stored":30021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T08:57:22.936 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T08:57:23.082 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:57:23.083 INFO:teuthology.orchestra.run.trial025.stderr:dumped all 2026-02-17T08:57:23.094 INFO:teuthology.orchestra.run.trial025.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2026-02-17T08:57:22.079349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81232,"kb_used_data":344,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491568,"statfs":{"total":322122547200,"available":322039365632,"internally_reserved":0,"allocated":352256,"data_stored":90044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":82767189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001448"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931424+0000","last_change":"2026-02-17T08:56:40.103424+0000","last_active":"2026-02-17T08:56:46.931424+0000","last_peered":"2026-02-17T08:56:46.931424+0000","last_clean":"2026-02-17T08:56:46.931424+0000","last_became_active":"2026-02-17T08:56:38.099789+0000","last_became_peered":"2026-02-17T08:56:38.099789+0000","last_unstale":"2026-02-17T08:56:46.931424+0000","last_undegraded":"2026-02-17T08:56:46.931424+0000","last_fullsized":"2026-02-17T08:56:46.931424+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:47:01.052648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931414+0000","last_change":"2026-02-17T08:56:40.103306+0000","last_active":"2026-02-17T08:56:46.931414+0000","last_peered":"2026-02-17T08:56:46.931414+0000","last_clean":"2026-02-17T08:56:46.931414+0000","last_became_active":"2026-02-17T08:56:38.100176+0000","last_became_peered":"2026-02-17T08:56:38.100176+0000","last_unstale":"2026-02-17T08:56:46.931414+0000","last_undegraded":"2026-02-17T08:56:46.931414+0000","last_fullsized":"2026-02-17T08:56:46.931414+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:48:49.184861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000254799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:47.875480+0000","last_change":"2026-02-17T08:56:40.100120+0000","last_active":"2026-02-17T08:56:47.875480+0000","last_peered":"2026-02-17T08:56:47.875480+0000","last_clean":"2026-02-17T08:56:47.875480+0000","last_became_active":"2026-02-17T08:56:38.099739+0000","last_became_peered":"2026-02-17T08:56:38.099739+0000","last_unstale":"2026-02-17T08:56:47.875480+0000","last_undegraded":"2026-02-17T08:56:47.875480+0000","last_fullsized":"2026-02-17T08:56:47.875480+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:47:08.363009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931409+0000","last_change":"2026-02-17T08:56:40.103577+0000","last_active":"2026-02-17T08:56:46.931409+0000","last_peered":"2026-02-17T08:56:46.931409+0000","last_clean":"2026-02-17T08:56:46.931409+0000","last_became_active":"2026-02-17T08:56:38.100197+0000","last_became_peered":"2026-02-17T08:56:38.100197+0000","last_unstale":"2026-02-17T08:56:46.931409+0000","last_undegraded":"2026-02-17T08:56:46.931409+0000","last_fullsized":"2026-02-17T08:56:46.931409+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:18:08.960294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050294700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"10'1","reported_seq":22,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931392+0000","last_change":"2026-02-17T08:56:40.103478+0000","last_active":"2026-02-17T08:56:46.931392+0000","last_peered":"2026-02-17T08:56:46.931392+0000","last_clean":"2026-02-17T08:56:46.931392+0000","last_became_active":"2026-02-17T08:56:38.099787+0000","last_became_peered":"2026-02-17T08:56:38.099787+0000","last_unstale":"2026-02-17T08:56:46.931392+0000","last_undegraded":"2026-02-17T08:56:46.931392+0000","last_fullsized":"2026-02-17T08:56:46.931392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:22:08.112761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"12'2","reported_seq":23,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:47.483877+0000","last_change":"2026-02-17T08:56:40.102144+0000","last_active":"2026-02-17T08:56:47.483877+0000","last_peered":"2026-02-17T08:56:47.483877+0000","last_clean":"2026-02-17T08:56:47.483877+0000","last_became_active":"2026-02-17T08:56:38.099655+0000","last_became_peered":"2026-02-17T08:56:38.099655+0000","last_unstale":"2026-02-17T08:56:47.483877+0000","last_undegraded":"2026-02-17T08:56:47.483877+0000","last_fullsized":"2026-02-17T08:56:47.483877+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:49:07.787596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052371500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:47.875469+0000","last_change":"2026-02-17T08:56:40.100138+0000","last_active":"2026-02-17T08:56:47.875469+0000","last_peered":"2026-02-17T08:56:47.875469+0000","last_clean":"2026-02-17T08:56:47.875469+0000","last_became_active":"2026-02-17T08:56:38.099710+0000","last_became_peered":"2026-02-17T08:56:38.099710+0000","last_unstale":"2026-02-17T08:56:47.875469+0000","last_undegraded":"2026-02-17T08:56:47.875469+0000","last_fullsized":"2026-02-17T08:56:47.875469+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:16:19.039429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000256703,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931392+0000","last_change":"2026-02-17T08:56:40.103298+0000","last_active":"2026-02-17T08:56:46.931392+0000","last_peered":"2026-02-17T08:56:46.931392+0000","last_clean":"2026-02-17T08:56:46.931392+0000","last_became_active":"2026-02-17T08:56:38.100217+0000","last_became_peered":"2026-02-17T08:56:38.100217+0000","last_unstale":"2026-02-17T08:56:46.931392+0000","last_undegraded":"2026-02-17T08:56:46.931392+0000","last_fullsized":"2026-02-17T08:56:46.931392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:43:00.380089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027119900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738380,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":114688,"data_stored":30002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27080,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830520,"statfs":{"total":107374182400,"available":107346452480,"internally_reserved":0,"allocated":118784,"data_stored":30021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":118784,"data_stored":30021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T08:57:23.095 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T08:57:23.095 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T08:57:23.239 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:57:23.240 INFO:teuthology.orchestra.run.trial025.stderr:dumped all 2026-02-17T08:57:23.250 INFO:teuthology.orchestra.run.trial025.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2026-02-17T08:57:22.079349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81232,"kb_used_data":344,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491568,"statfs":{"total":322122547200,"available":322039365632,"internally_reserved":0,"allocated":352256,"data_stored":90044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":82767189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001448"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931424+0000","last_change":"2026-02-17T08:56:40.103424+0000","last_active":"2026-02-17T08:56:46.931424+0000","last_peered":"2026-02-17T08:56:46.931424+0000","last_clean":"2026-02-17T08:56:46.931424+0000","last_became_active":"2026-02-17T08:56:38.099789+0000","last_became_peered":"2026-02-17T08:56:38.099789+0000","last_unstale":"2026-02-17T08:56:46.931424+0000","last_undegraded":"2026-02-17T08:56:46.931424+0000","last_fullsized":"2026-02-17T08:56:46.931424+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:47:01.052648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931414+0000","last_change":"2026-02-17T08:56:40.103306+0000","last_active":"2026-02-17T08:56:46.931414+0000","last_peered":"2026-02-17T08:56:46.931414+0000","last_clean":"2026-02-17T08:56:46.931414+0000","last_became_active":"2026-02-17T08:56:38.100176+0000","last_became_peered":"2026-02-17T08:56:38.100176+0000","last_unstale":"2026-02-17T08:56:46.931414+0000","last_undegraded":"2026-02-17T08:56:46.931414+0000","last_fullsized":"2026-02-17T08:56:46.931414+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:48:49.184861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000254799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:47.875480+0000","last_change":"2026-02-17T08:56:40.100120+0000","last_active":"2026-02-17T08:56:47.875480+0000","last_peered":"2026-02-17T08:56:47.875480+0000","last_clean":"2026-02-17T08:56:47.875480+0000","last_became_active":"2026-02-17T08:56:38.099739+0000","last_became_peered":"2026-02-17T08:56:38.099739+0000","last_unstale":"2026-02-17T08:56:47.875480+0000","last_undegraded":"2026-02-17T08:56:47.875480+0000","last_fullsized":"2026-02-17T08:56:47.875480+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:47:08.363009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931409+0000","last_change":"2026-02-17T08:56:40.103577+0000","last_active":"2026-02-17T08:56:46.931409+0000","last_peered":"2026-02-17T08:56:46.931409+0000","last_clean":"2026-02-17T08:56:46.931409+0000","last_became_active":"2026-02-17T08:56:38.100197+0000","last_became_peered":"2026-02-17T08:56:38.100197+0000","last_unstale":"2026-02-17T08:56:46.931409+0000","last_undegraded":"2026-02-17T08:56:46.931409+0000","last_fullsized":"2026-02-17T08:56:46.931409+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:18:08.960294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050294700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"10'1","reported_seq":22,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931392+0000","last_change":"2026-02-17T08:56:40.103478+0000","last_active":"2026-02-17T08:56:46.931392+0000","last_peered":"2026-02-17T08:56:46.931392+0000","last_clean":"2026-02-17T08:56:46.931392+0000","last_became_active":"2026-02-17T08:56:38.099787+0000","last_became_peered":"2026-02-17T08:56:38.099787+0000","last_unstale":"2026-02-17T08:56:46.931392+0000","last_undegraded":"2026-02-17T08:56:46.931392+0000","last_fullsized":"2026-02-17T08:56:46.931392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:22:08.112761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"12'2","reported_seq":23,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:47.483877+0000","last_change":"2026-02-17T08:56:40.102144+0000","last_active":"2026-02-17T08:56:47.483877+0000","last_peered":"2026-02-17T08:56:47.483877+0000","last_clean":"2026-02-17T08:56:47.483877+0000","last_became_active":"2026-02-17T08:56:38.099655+0000","last_became_peered":"2026-02-17T08:56:38.099655+0000","last_unstale":"2026-02-17T08:56:47.483877+0000","last_undegraded":"2026-02-17T08:56:47.483877+0000","last_fullsized":"2026-02-17T08:56:47.483877+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:49:07.787596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052371500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:47.875469+0000","last_change":"2026-02-17T08:56:40.100138+0000","last_active":"2026-02-17T08:56:47.875469+0000","last_peered":"2026-02-17T08:56:47.875469+0000","last_clean":"2026-02-17T08:56:47.875469+0000","last_became_active":"2026-02-17T08:56:38.099710+0000","last_became_peered":"2026-02-17T08:56:38.099710+0000","last_unstale":"2026-02-17T08:56:47.875469+0000","last_undegraded":"2026-02-17T08:56:47.875469+0000","last_fullsized":"2026-02-17T08:56:47.875469+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:16:19.039429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000256703,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931392+0000","last_change":"2026-02-17T08:56:40.103298+0000","last_active":"2026-02-17T08:56:46.931392+0000","last_peered":"2026-02-17T08:56:46.931392+0000","last_clean":"2026-02-17T08:56:46.931392+0000","last_became_active":"2026-02-17T08:56:38.100217+0000","last_became_peered":"2026-02-17T08:56:38.100217+0000","last_unstale":"2026-02-17T08:56:46.931392+0000","last_undegraded":"2026-02-17T08:56:46.931392+0000","last_fullsized":"2026-02-17T08:56:46.931392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:43:00.380089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027119900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738380,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":114688,"data_stored":30002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27080,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830520,"statfs":{"total":107374182400,"available":107346452480,"internally_reserved":0,"allocated":118784,"data_stored":30021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":118784,"data_stored":30021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T08:57:23.251 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T08:57:23.395 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:57:23.395 INFO:teuthology.orchestra.run.trial025.stdout:{"epoch":13,"fsid":"90e8bae8-9779-40e8-823a-3b5cb1d90003","created":"2026-02-17T08:56:21.971094+0000","modified":"2026-02-17T08:56:46.929526+0000","last_up_change":"2026-02-17T08:56:30.080903+0000","last_in_change":"2026-02-17T08:56:22.607574+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T08:56:36.173932+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":12,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4dccfa76-85be-4e4f-8a52-1b772796b024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6811","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6813","nonce":2170068383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6815","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6817","nonce":2170068383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6823","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6825","nonce":2170068383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6819","nonce":2170068383},{"type":"v1","addr":"10.20.193.25:6821","nonce":2170068383}]},"public_addr":"10.20.193.25:6813/2170068383","cluster_addr":"10.20.193.25:6817/2170068383","heartbeat_back_addr":"10.20.193.25:6825/2170068383","heartbeat_front_addr":"10.20.193.25:6821/2170068383","state":["exists","up"]},{"osd":1,"uuid":"7f274425-9478-4110-bd75-2c08e55b9425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6802","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6803","nonce":3516643521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6804","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6805","nonce":3516643521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6808","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6809","nonce":3516643521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6806","nonce":3516643521},{"type":"v1","addr":"10.20.193.25:6807","nonce":3516643521}]},"public_addr":"10.20.193.25:6803/3516643521","cluster_addr":"10.20.193.25:6805/3516643521","heartbeat_back_addr":"10.20.193.25:6809/3516643521","heartbeat_front_addr":"10.20.193.25:6807/3516643521","state":["exists","up"]},{"osd":2,"uuid":"0657e5c6-fd18-44da-9cdd-bfab7000ed46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6810","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6812","nonce":2080245453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6814","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6816","nonce":2080245453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6822","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6824","nonce":2080245453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.25:6818","nonce":2080245453},{"type":"v1","addr":"10.20.193.25:6820","nonce":2080245453}]},"public_addr":"10.20.193.25:6812/2080245453","cluster_addr":"10.20.193.25:6816/2080245453","heartbeat_back_addr":"10.20.193.25:6824/2080245453","heartbeat_front_addr":"10.20.193.25:6820/2080245453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:57:24.406 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T08:57:24.406 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T08:57:24.481 INFO:teuthology.orchestra.run.trial025.stdout:{ 2026-02-17T08:57:24.481 INFO:teuthology.orchestra.run.trial025.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T08:57:24.481 INFO:teuthology.orchestra.run.trial025.stdout:} 2026-02-17T08:57:24.493 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T08:57:24.648 INFO:teuthology.orchestra.run.trial025.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T08:57:24.660 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T08:57:24.660 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T08:57:24.733 INFO:teuthology.orchestra.run.trial025.stdout:{ 2026-02-17T08:57:24.734 INFO:teuthology.orchestra.run.trial025.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T08:57:24.734 INFO:teuthology.orchestra.run.trial025.stdout:} 2026-02-17T08:57:24.743 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T08:57:24.894 INFO:teuthology.orchestra.run.trial025.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T08:57:24.906 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T08:57:24.906 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T08:57:24.987 INFO:teuthology.orchestra.run.trial025.stdout:{ 2026-02-17T08:57:24.987 INFO:teuthology.orchestra.run.trial025.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T08:57:24.988 INFO:teuthology.orchestra.run.trial025.stdout:} 2026-02-17T08:57:24.996 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T08:57:25.147 INFO:teuthology.orchestra.run.trial025.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T08:57:25.159 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T08:57:25.308 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:57:25.308 INFO:teuthology.orchestra.run.trial025.stderr:dumped all 2026-02-17T08:57:25.320 INFO:teuthology.orchestra.run.trial025.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2026-02-17T08:57:24.079610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81232,"kb_used_data":344,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491568,"statfs":{"total":322122547200,"available":322039365632,"internally_reserved":0,"allocated":352256,"data_stored":90044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":82767189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001531"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931424+0000","last_change":"2026-02-17T08:56:40.103424+0000","last_active":"2026-02-17T08:56:46.931424+0000","last_peered":"2026-02-17T08:56:46.931424+0000","last_clean":"2026-02-17T08:56:46.931424+0000","last_became_active":"2026-02-17T08:56:38.099789+0000","last_became_peered":"2026-02-17T08:56:38.099789+0000","last_unstale":"2026-02-17T08:56:46.931424+0000","last_undegraded":"2026-02-17T08:56:46.931424+0000","last_fullsized":"2026-02-17T08:56:46.931424+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:47:01.052648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931414+0000","last_change":"2026-02-17T08:56:40.103306+0000","last_active":"2026-02-17T08:56:46.931414+0000","last_peered":"2026-02-17T08:56:46.931414+0000","last_clean":"2026-02-17T08:56:46.931414+0000","last_became_active":"2026-02-17T08:56:38.100176+0000","last_became_peered":"2026-02-17T08:56:38.100176+0000","last_unstale":"2026-02-17T08:56:46.931414+0000","last_undegraded":"2026-02-17T08:56:46.931414+0000","last_fullsized":"2026-02-17T08:56:46.931414+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:48:49.184861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000254799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:47.875480+0000","last_change":"2026-02-17T08:56:40.100120+0000","last_active":"2026-02-17T08:56:47.875480+0000","last_peered":"2026-02-17T08:56:47.875480+0000","last_clean":"2026-02-17T08:56:47.875480+0000","last_became_active":"2026-02-17T08:56:38.099739+0000","last_became_peered":"2026-02-17T08:56:38.099739+0000","last_unstale":"2026-02-17T08:56:47.875480+0000","last_undegraded":"2026-02-17T08:56:47.875480+0000","last_fullsized":"2026-02-17T08:56:47.875480+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:47:08.363009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931409+0000","last_change":"2026-02-17T08:56:40.103577+0000","last_active":"2026-02-17T08:56:46.931409+0000","last_peered":"2026-02-17T08:56:46.931409+0000","last_clean":"2026-02-17T08:56:46.931409+0000","last_became_active":"2026-02-17T08:56:38.100197+0000","last_became_peered":"2026-02-17T08:56:38.100197+0000","last_unstale":"2026-02-17T08:56:46.931409+0000","last_undegraded":"2026-02-17T08:56:46.931409+0000","last_fullsized":"2026-02-17T08:56:46.931409+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:18:08.960294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050294700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"10'1","reported_seq":22,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931392+0000","last_change":"2026-02-17T08:56:40.103478+0000","last_active":"2026-02-17T08:56:46.931392+0000","last_peered":"2026-02-17T08:56:46.931392+0000","last_clean":"2026-02-17T08:56:46.931392+0000","last_became_active":"2026-02-17T08:56:38.099787+0000","last_became_peered":"2026-02-17T08:56:38.099787+0000","last_unstale":"2026-02-17T08:56:46.931392+0000","last_undegraded":"2026-02-17T08:56:46.931392+0000","last_fullsized":"2026-02-17T08:56:46.931392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:22:08.112761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"12'2","reported_seq":23,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:47.483877+0000","last_change":"2026-02-17T08:56:40.102144+0000","last_active":"2026-02-17T08:56:47.483877+0000","last_peered":"2026-02-17T08:56:47.483877+0000","last_clean":"2026-02-17T08:56:47.483877+0000","last_became_active":"2026-02-17T08:56:38.099655+0000","last_became_peered":"2026-02-17T08:56:38.099655+0000","last_unstale":"2026-02-17T08:56:47.483877+0000","last_undegraded":"2026-02-17T08:56:47.483877+0000","last_fullsized":"2026-02-17T08:56:47.483877+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:49:07.787596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052371500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:47.875469+0000","last_change":"2026-02-17T08:56:40.100138+0000","last_active":"2026-02-17T08:56:47.875469+0000","last_peered":"2026-02-17T08:56:47.875469+0000","last_clean":"2026-02-17T08:56:47.875469+0000","last_became_active":"2026-02-17T08:56:38.099710+0000","last_became_peered":"2026-02-17T08:56:38.099710+0000","last_unstale":"2026-02-17T08:56:47.875469+0000","last_undegraded":"2026-02-17T08:56:47.875469+0000","last_fullsized":"2026-02-17T08:56:47.875469+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T10:16:19.039429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000256703,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:56:46.931392+0000","last_change":"2026-02-17T08:56:40.103298+0000","last_active":"2026-02-17T08:56:46.931392+0000","last_peered":"2026-02-17T08:56:46.931392+0000","last_clean":"2026-02-17T08:56:46.931392+0000","last_became_active":"2026-02-17T08:56:38.100217+0000","last_became_peered":"2026-02-17T08:56:38.100217+0000","last_unstale":"2026-02-17T08:56:46.931392+0000","last_undegraded":"2026-02-17T08:56:46.931392+0000","last_fullsized":"2026-02-17T08:56:46.931392+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:56:37.090752+0000","last_clean_scrub_stamp":"2026-02-17T08:56:37.090752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:43:00.380089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027119900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738380,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":114688,"data_stored":30002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27080,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830520,"statfs":{"total":107374182400,"available":107346452480,"internally_reserved":0,"allocated":118784,"data_stored":30021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":118784,"data_stored":30021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T08:57:25.326 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-17T08:56:37.090752+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=56, tm_sec=37, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=57, tm_sec=23, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T08:57:25.326 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-17T08:56:37.090752+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=56, tm_sec=37, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=57, tm_sec=23, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T08:57:25.327 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-17T08:56:37.090752+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=56, tm_sec=37, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=57, tm_sec=23, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T08:57:25.327 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-17T08:56:37.090752+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=56, tm_sec=37, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=57, tm_sec=23, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T08:57:25.327 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-17T08:56:37.090752+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=56, tm_sec=37, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=57, tm_sec=23, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T08:57:25.327 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-17T08:56:37.090752+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=56, tm_sec=37, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=57, tm_sec=23, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T08:57:25.327 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-17T08:56:37.090752+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=56, tm_sec=37, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=57, tm_sec=23, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T08:57:25.328 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T08:56:37.090752+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=56, tm_sec=37, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=8, tm_min=57, tm_sec=23, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T08:57:25.328 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T08:57:45.329 DEBUG:teuthology.orchestra.run.trial025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T08:57:45.482 INFO:teuthology.orchestra.run.trial025.stdout: 2026-02-17T08:57:45.483 INFO:teuthology.orchestra.run.trial025.stderr:dumped all 2026-02-17T08:57:45.493 INFO:teuthology.orchestra.run.trial025.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2026-02-17T08:57:44.081614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":81224,"kb_used_data":344,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":314491576,"statfs":{"total":322122547200,"available":322039373824,"internally_reserved":0,"allocated":352256,"data_stored":90044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4779,"internal_metadata":82767189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.000644"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":30,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:57:25.354915+0000","last_change":"2026-02-17T08:57:25.354931+0000","last_active":"2026-02-17T08:57:25.354915+0000","last_peered":"2026-02-17T08:57:25.354915+0000","last_clean":"2026-02-17T08:57:25.354915+0000","last_became_active":"2026-02-17T08:56:38.099789+0000","last_became_peered":"2026-02-17T08:56:38.099789+0000","last_unstale":"2026-02-17T08:57:25.354915+0000","last_undegraded":"2026-02-17T08:57:25.354915+0000","last_fullsized":"2026-02-17T08:57:25.354915+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:57:25.354873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:57:25.354873+0000","last_clean_scrub_stamp":"2026-02-17T08:57:25.354873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:25:54.830959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036796799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":30,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:57:27.345710+0000","last_change":"2026-02-17T08:57:27.345734+0000","last_active":"2026-02-17T08:57:27.345710+0000","last_peered":"2026-02-17T08:57:27.345710+0000","last_clean":"2026-02-17T08:57:27.345710+0000","last_became_active":"2026-02-17T08:56:38.100176+0000","last_became_peered":"2026-02-17T08:56:38.100176+0000","last_unstale":"2026-02-17T08:57:27.345710+0000","last_undegraded":"2026-02-17T08:57:27.345710+0000","last_fullsized":"2026-02-17T08:57:27.345710+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:57:27.345624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:57:27.345624+0000","last_clean_scrub_stamp":"2026-02-17T08:57:27.345624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:21:27.923424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000254799,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":30,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:57:26.870616+0000","last_change":"2026-02-17T08:57:26.870630+0000","last_active":"2026-02-17T08:57:26.870616+0000","last_peered":"2026-02-17T08:57:26.870616+0000","last_clean":"2026-02-17T08:57:26.870616+0000","last_became_active":"2026-02-17T08:56:38.099739+0000","last_became_peered":"2026-02-17T08:56:38.099739+0000","last_unstale":"2026-02-17T08:57:26.870616+0000","last_undegraded":"2026-02-17T08:57:26.870616+0000","last_fullsized":"2026-02-17T08:57:26.870616+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:57:26.870576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:57:26.870576+0000","last_clean_scrub_stamp":"2026-02-17T08:57:26.870576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:05:41.904233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000242267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":30,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:57:26.339537+0000","last_change":"2026-02-17T08:57:26.339551+0000","last_active":"2026-02-17T08:57:26.339537+0000","last_peered":"2026-02-17T08:57:26.339537+0000","last_clean":"2026-02-17T08:57:26.339537+0000","last_became_active":"2026-02-17T08:56:38.100197+0000","last_became_peered":"2026-02-17T08:56:38.100197+0000","last_unstale":"2026-02-17T08:57:26.339537+0000","last_undegraded":"2026-02-17T08:57:26.339537+0000","last_fullsized":"2026-02-17T08:57:26.339537+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:57:26.339480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:57:26.339480+0000","last_clean_scrub_stamp":"2026-02-17T08:57:26.339480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:43:11.602590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050294700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"13'2","reported_seq":32,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:57:29.381060+0000","last_change":"2026-02-17T08:57:29.381077+0000","last_active":"2026-02-17T08:57:29.381060+0000","last_peered":"2026-02-17T08:57:29.381060+0000","last_clean":"2026-02-17T08:57:29.381060+0000","last_became_active":"2026-02-17T08:56:38.099787+0000","last_became_peered":"2026-02-17T08:56:38.099787+0000","last_unstale":"2026-02-17T08:57:29.381060+0000","last_undegraded":"2026-02-17T08:57:29.381060+0000","last_fullsized":"2026-02-17T08:57:29.381060+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'2","last_scrub_stamp":"2026-02-17T08:57:29.381020+0000","last_deep_scrub":"13'2","last_deep_scrub_stamp":"2026-02-17T08:57:29.381020+0000","last_clean_scrub_stamp":"2026-02-17T08:57:29.381020+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:44:26.996735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043061400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'3","reported_seq":33,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:57:25.325190+0000","last_change":"2026-02-17T08:57:25.325208+0000","last_active":"2026-02-17T08:57:25.325190+0000","last_peered":"2026-02-17T08:57:25.325190+0000","last_clean":"2026-02-17T08:57:25.325190+0000","last_became_active":"2026-02-17T08:56:38.099655+0000","last_became_peered":"2026-02-17T08:56:38.099655+0000","last_unstale":"2026-02-17T08:57:25.325190+0000","last_undegraded":"2026-02-17T08:57:25.325190+0000","last_fullsized":"2026-02-17T08:57:25.325190+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'3","last_scrub_stamp":"2026-02-17T08:57:25.325149+0000","last_deep_scrub":"13'3","last_deep_scrub_stamp":"2026-02-17T08:57:25.325149+0000","last_clean_scrub_stamp":"2026-02-17T08:57:25.325149+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:28:07.420675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052371500000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":30,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:57:25.852631+0000","last_change":"2026-02-17T08:57:25.852645+0000","last_active":"2026-02-17T08:57:25.852631+0000","last_peered":"2026-02-17T08:57:25.852631+0000","last_clean":"2026-02-17T08:57:25.852631+0000","last_became_active":"2026-02-17T08:56:38.099710+0000","last_became_peered":"2026-02-17T08:56:38.099710+0000","last_unstale":"2026-02-17T08:57:25.852631+0000","last_undegraded":"2026-02-17T08:57:25.852631+0000","last_fullsized":"2026-02-17T08:57:25.852631+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:57:25.852585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:57:25.852585+0000","last_clean_scrub_stamp":"2026-02-17T08:57:25.852585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:37:35.179833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000256703,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T08:57:28.360499+0000","last_change":"2026-02-17T08:57:28.360522+0000","last_active":"2026-02-17T08:57:28.360499+0000","last_peered":"2026-02-17T08:57:28.360499+0000","last_clean":"2026-02-17T08:57:28.360499+0000","last_became_active":"2026-02-17T08:56:38.100217+0000","last_became_peered":"2026-02-17T08:56:38.100217+0000","last_unstale":"2026-02-17T08:57:28.360499+0000","last_undegraded":"2026-02-17T08:57:28.360499+0000","last_fullsized":"2026-02-17T08:57:28.360499+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:57:28.360437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:57:28.360437+0000","last_clean_scrub_stamp":"2026-02-17T08:57:28.360437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T11:34:37.749469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027119900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738384,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27072,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830528,"statfs":{"total":107374182400,"available":107346460672,"internally_reserved":0,"allocated":114688,"data_stored":30002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738384,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":118784,"data_stored":30021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27076,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":104830524,"statfs":{"total":107374182400,"available":107346456576,"internally_reserved":0,"allocated":118784,"data_stored":30021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T08:57:45.494 DEBUG:teuthology.orchestra.run.trial025:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T08:57:45.653 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T08:57:45.654 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T08:57:45.654 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T08:57:45.654 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T08:57:45.737 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T08:57:45.737 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T08:57:45.737 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T08:57:45.808 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T08:57:45.809 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T08:57:45.809 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T08:57:45.889 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T08:57:45.889 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T08:57:45.889 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T08:57:45.889 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T08:57:45.916 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T08:57:45.916 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T08:57:45.916 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T08:57:45.916 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T08:57:45.969 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T08:57:45.969 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T08:57:45.970 DEBUG:teuthology.orchestra.run.trial025:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-17T08:57:46.022 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial025.front.sepia.ceph.com 2026-02-17T08:57:46.023 DEBUG:teuthology.orchestra.run.trial025:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T08:57:46.075 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial025.front.sepia.ceph.com 2026-02-17T08:57:46.076 DEBUG:teuthology.orchestra.run.trial025:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T08:57:46.128 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial025.front.sepia.ceph.com 2026-02-17T08:57:46.128 DEBUG:teuthology.orchestra.run.trial025:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T08:57:46.178 INFO:tasks.ceph:Archiving mon data... 2026-02-17T08:57:46.180 DEBUG:teuthology.misc:Transferring archived files from trial025:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51202/data/mon.a.tgz 2026-02-17T08:57:46.180 DEBUG:teuthology.orchestra.run.trial025:> mktemp 2026-02-17T08:57:46.224 INFO:teuthology.orchestra.run.trial025.stdout:/tmp/tmp.shHbk9VZS0 2026-02-17T08:57:46.224 DEBUG:teuthology.orchestra.run.trial025:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.shHbk9VZS0 2026-02-17T08:57:46.287 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 0666 /tmp/tmp.shHbk9VZS0 2026-02-17T08:57:46.386 DEBUG:teuthology.orchestra.remote:trial025:/tmp/tmp.shHbk9VZS0 is 129KB 2026-02-17T08:57:46.398 DEBUG:teuthology.orchestra.run.trial025:> rm -fr /tmp/tmp.shHbk9VZS0 2026-02-17T08:57:46.402 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T08:57:46.402 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T08:57:46.496 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T08:57:46.496 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T08:57:46.499 DEBUG:teuthology.misc:Transferring archived files from trial025:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51202/remote/trial025/crash 2026-02-17T08:57:46.500 DEBUG:teuthology.orchestra.run.trial025:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T08:57:46.548 INFO:tasks.ceph:Compressing logs... 2026-02-17T08:57:46.549 DEBUG:teuthology.orchestra.run.trial025:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T08:57:46.600 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17430.log 2026-02-17T08:57:46.604 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17588.log 2026-02-17T08:57:46.604 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17736.log 2026-02-17T08:57:46.604 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17430.log.gz 2026-02-17T08:57:46.604 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23481.log 2026-02-17T08:57:46.604 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17588.log.gz 2026-02-17T08:57:46.604 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14481.log 2026-02-17T08:57:46.605 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17736.log.gz 2026-02-17T08:57:46.605 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17762.log 2026-02-17T08:57:46.605 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23481.log.gz 2026-02-17T08:57:46.605 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.14481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14481.log.gz 2026-02-17T08:57:46.605 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17346.log 2026-02-17T08:57:46.605 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14382.log 2026-02-17T08:57:46.605 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17762.log: /var/log/ceph/ceph-client.admin.17346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17762.log.gz 2026-02-17T08:57:46.605 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17346.log.gz 2026-02-17T08:57:46.605 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23559.log 2026-02-17T08:57:46.605 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.14382.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.11736.log 2026-02-17T08:57:46.605 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14382.log.gz 2026-02-17T08:57:46.606 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23559.log.gz 2026-02-17T08:57:46.606 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T08:57:46.606 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph.tmp-client.admin.11736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23585.log 2026-02-17T08:57:46.606 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.11736.log.gz 2026-02-17T08:57:46.606 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17432.log 2026-02-17T08:57:46.606 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23585.log.gz 2026-02-17T08:57:46.606 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17583.log 2026-02-17T08:57:46.616 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17398.log 2026-02-17T08:57:46.616 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17432.log.gz 2026-02-17T08:57:46.616 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T08:57:46.616 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17583.log.gz 2026-02-17T08:57:46.616 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17431.log 2026-02-17T08:57:46.616 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17398.log.gz 2026-02-17T08:57:46.616 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14358.log 2026-02-17T08:57:46.616 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23325.log 2026-02-17T08:57:46.617 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17431.log.gz 2026-02-17T08:57:46.617 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.14358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14417.log 2026-02-17T08:57:46.617 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14358.log.gz 2026-02-17T08:57:46.617 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23635.log 2026-02-17T08:57:46.617 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23325.log.gz 2026-02-17T08:57:46.617 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.14417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17510.log 2026-02-17T08:57:46.617 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14417.log.gz 2026-02-17T08:57:46.617 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23635.log.gz 2026-02-17T08:57:46.617 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23403.log 2026-02-17T08:57:46.617 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17508.log 2026-02-17T08:57:46.617 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17510.log: /var/log/ceph/ceph-client.admin.23403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17510.log.gz 2026-02-17T08:57:46.617 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23403.log.gz 2026-02-17T08:57:46.618 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23351.log 2026-02-17T08:57:46.618 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23455.log 2026-02-17T08:57:46.618 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17508.log.gz 2026-02-17T08:57:46.618 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17301.log 2026-02-17T08:57:46.618 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23351.log: /var/log/ceph/ceph-client.admin.23455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23455.log.gz 2026-02-17T08:57:46.618 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23351.log.gz 2026-02-17T08:57:46.618 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17326.log 2026-02-17T08:57:46.618 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17666.log 2026-02-17T08:57:46.618 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17301.log.gz 2026-02-17T08:57:46.618 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17326.log.gz 2026-02-17T08:57:46.618 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23377.log 2026-02-17T08:57:46.618 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17788.log 2026-02-17T08:57:46.619 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17666.log.gz 2026-02-17T08:57:46.619 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23377.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T08:57:46.619 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23377.log.gz 2026-02-17T08:57:46.619 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17788.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T08:57:46.619 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17788.log.gz 2026-02-17T08:57:46.619 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T08:57:46.619 INFO:teuthology.orchestra.run.trial025.stderr: 87.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T08:57:46.619 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23533.log 2026-02-17T08:57:46.619 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17509.log 2026-02-17T08:57:46.619 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17252.log 2026-02-17T08:57:46.619 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23533.log: 83.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T08:57:46.619 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23533.log.gz 2026-02-17T08:57:46.620 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17509.log.gz 2026-02-17T08:57:46.620 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14283.log 2026-02-17T08:57:46.620 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17252.log.gz 2026-02-17T08:57:46.620 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14217.log 2026-02-17T08:57:46.620 INFO:teuthology.orchestra.run.trial025.stderr:gzip/var/log/ceph/ceph-client.admin.14283.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23611.log 2026-02-17T08:57:46.620 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14283.log.gz 2026-02-17T08:57:46.620 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.14217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17276.log 2026-02-17T08:57:46.620 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14217.log.gz 2026-02-17T08:57:46.620 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23611.log.gz 2026-02-17T08:57:46.620 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17661.log 2026-02-17T08:57:46.620 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17276.log.gz 2026-02-17T08:57:46.620 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14334.log 2026-02-17T08:57:46.620 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T08:57:46.621 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17661.log.gz 2026-02-17T08:57:46.621 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.14334.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.14334.log.gz -5 2026-02-17T08:57:46.621 INFO:teuthology.orchestra.run.trial025.stderr: --verbose -- /var/log/ceph/ceph-client.admin.17372.log 2026-02-17T08:57:46.621 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17584.log 2026-02-17T08:57:46.621 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23429.log 2026-02-17T08:57:46.621 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17372.log.gz 2026-02-17T08:57:46.621 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17662.log 2026-02-17T08:57:46.621 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17584.log.gz 2026-02-17T08:57:46.621 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23429.log: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T08:57:46.621 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23507.log 2026-02-17T08:57:46.621 INFO:teuthology.orchestra.run.trial025.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23429.log.gz 2026-02-17T08:57:46.621 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T08:57:46.621 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.17662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17662.log.gz 2026-02-17T08:57:46.622 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-client.admin.23507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23507.log.gz 2026-02-17T08:57:46.622 INFO:teuthology.orchestra.run.trial025.stderr:/var/log/ceph/ceph-osd.1.log: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T08:57:46.628 INFO:teuthology.orchestra.run.trial025.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T08:57:46.631 INFO:teuthology.orchestra.run.trial025.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T08:57:46.635 INFO:teuthology.orchestra.run.trial025.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T08:57:46.636 INFO:teuthology.orchestra.run.trial025.stderr: 2026-02-17T08:57:46.636 INFO:teuthology.orchestra.run.trial025.stderr:real 0m0.042s 2026-02-17T08:57:46.636 INFO:teuthology.orchestra.run.trial025.stderr:user 0m0.118s 2026-02-17T08:57:46.636 INFO:teuthology.orchestra.run.trial025.stderr:sys 0m0.016s 2026-02-17T08:57:46.637 INFO:tasks.ceph:Archiving logs... 2026-02-17T08:57:46.637 DEBUG:teuthology.misc:Transferring archived files from trial025:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51202/remote/trial025/log 2026-02-17T08:57:46.639 DEBUG:teuthology.orchestra.run.trial025:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T08:57:46.755 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T08:57:46.775 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T08:57:46.775 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T08:57:46.878 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T08:57:46.890 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T08:57:46.890 DEBUG:teuthology.orchestra.run.trial025:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T08:57:47.445 INFO:teuthology.orchestra.run.trial025.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T08:57:47.445 INFO:teuthology.orchestra.run.trial025.stdout:============================================================================== 2026-02-17T08:57:47.445 INFO:teuthology.orchestra.run.trial025.stdout: ntp.maxhost.io 132.163.97.4 2 u 53 64 3 69.963 +1.312 1.035 2026-02-17T08:57:47.445 INFO:teuthology.orchestra.run.trial025.stdout: 204.2.134.172 22.42.17.250 3 u 52 64 3 69.045 +1.299 0.611 2026-02-17T08:57:47.445 INFO:teuthology.orchestra.run.trial025.stdout: hou1.us.ntp.li 192.58.120.41 2 u 55 64 3 41.152 -1.426 1.006 2026-02-17T08:57:47.446 INFO:teuthology.orchestra.run.trial025.stdout: time1.lshiy.com 141.32.131.246 2 u 53 64 3 187.107 +1.577 1.779 2026-02-17T08:57:47.447 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T08:57:47.463 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T08:57:47.463 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T08:57:47.477 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T08:57:47.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T08:57:47.506 INFO:teuthology.task.internal:Duration was 276.088940 seconds 2026-02-17T08:57:47.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T08:57:47.520 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T08:57:47.521 DEBUG:teuthology.orchestra.run.trial025:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T08:57:47.546 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T08:57:47.546 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial025.front.sepia.ceph.com 2026-02-17T08:57:47.546 DEBUG:teuthology.orchestra.run.trial025:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T08:57:47.594 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T08:57:47.595 DEBUG:teuthology.orchestra.run.trial025:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T08:57:47.791 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T08:57:47.791 DEBUG:teuthology.orchestra.run.trial025:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T08:57:47.800 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:57:47.800 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T08:57:47.800 INFO:teuthology.orchestra.run.trial025.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T08:57:47.800 INFO:teuthology.orchestra.run.trial025.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:57:47.801 INFO:teuthology.orchestra.run.trial025.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T08:57:47.848 INFO:teuthology.orchestra.run.trial025.stderr: 81.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T08:57:47.850 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T08:57:47.868 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T08:57:47.868 DEBUG:teuthology.orchestra.run.trial025:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T08:57:47.899 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T08:57:47.911 DEBUG:teuthology.orchestra.run.trial025:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:57:47.948 INFO:teuthology.orchestra.run.trial025.stdout:kernel.core_pattern = core 2026-02-17T08:57:47.959 DEBUG:teuthology.orchestra.run.trial025:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:57:48.003 WARNING:teuthology.task.internal:Found coredumps on ubuntu@trial025.front.sepia.ceph.com, flagging run as failed 2026-02-17T08:57:48.004 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T08:57:48.022 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T08:57:48.023 DEBUG:teuthology.misc:Transferring archived files from trial025:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51202/remote/trial025 2026-02-17T08:57:48.023 DEBUG:teuthology.orchestra.run.trial025:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T08:57:50.444 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2026-02-17T08:57:50.455 INFO:teuthology.task.internal: core looks like: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51202/remote/trial025/coredump/1771318642.23097.core.gz: gzip compressed data, was "1771318642.23097.core", last modified: Tue Feb 17 08:57:48 2026, max compression, original size modulo 2^32 129228800 2026-02-17T08:57:50.455 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2026-02-17T08:57:50.613 INFO:teuthology.task.internal: core looks like: /tmp/tmpq8g1emvm: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-kvstore-tool bluestore-kv ./cephtool.4w7 destructive-repair', real uid: 1000, effective uid: 1000, real gid: 1002, effective gid: 1002, execfn: '/usr/bin/ceph-kvstore-tool', platform: 'x86_64' 2026-02-17T08:57:50.614 INFO:teuthology.task.internal: dump_program: ceph-kvstore-tool 2026-02-17T08:57:50.615 DEBUG:teuthology.orchestra.run.trial025:> which ceph-kvstore-tool 2026-02-17T08:57:50.619 INFO:teuthology.orchestra.run.trial025.stdout:/usr/bin/ceph-kvstore-tool 2026-02-17T08:57:50.666 DEBUG:teuthology.orchestra.remote:trial025:/usr/bin/ceph-kvstore-tool is 10MB 2026-02-17T08:57:50.809 DEBUG:teuthology.orchestra.run.trial025:> mktemp 2026-02-17T08:57:50.813 INFO:teuthology.orchestra.run.trial025.stdout:/tmp/tmp.CsKGYqayG0 2026-02-17T08:57:50.813 DEBUG:teuthology.orchestra.run.trial025:> sudo cp /usr/bin/ceph-kvstore-tool /tmp/tmp.CsKGYqayG0 2026-02-17T08:57:50.872 DEBUG:teuthology.orchestra.run.trial025:> sudo chmod 0666 /tmp/tmp.CsKGYqayG0 2026-02-17T08:57:50.969 DEBUG:teuthology.orchestra.remote:trial025:/tmp/tmp.CsKGYqayG0 is 10MB 2026-02-17T08:57:51.113 DEBUG:teuthology.orchestra.run.trial025:> rm -fr /tmp/tmp.CsKGYqayG0 2026-02-17T08:57:51.119 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T08:57:51.119 DEBUG:teuthology.orchestra.run.trial025:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T08:57:51.178 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T08:57:51.197 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T08:57:51.197 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T08:57:51.213 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T08:57:51.214 DEBUG:teuthology.orchestra.run.trial025:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T08:57:51.224 INFO:teuthology.orchestra.run.trial025.stdout: 1180220 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 17 08:57 /home/ubuntu/cephtest 2026-02-17T08:57:51.224 INFO:teuthology.orchestra.run.trial025.stdout: 1190572 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 17 08:56 /home/ubuntu/cephtest/mnt.0 2026-02-17T08:57:51.224 INFO:teuthology.orchestra.run.trial025.stdout: 1190573 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 17 08:57 /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T08:57:51.225 INFO:teuthology.orchestra.run.trial025.stdout: 1205327 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Feb 17 08:57 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T08:57:51.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:57:51.226 INFO:teuthology.orchestra.run.trial025.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-17T08:57:51.226 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial025 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-17T08:57:51.228 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T08:57:51.245 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T08:57:51.262 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial025 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-17T08:57:51.268 INFO:teuthology.run:Summary data: description: rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} duration: 276.08893966674805 failure_reason: 'Command failed (workunit test cephtool/test_kvstore_tool.sh) on trial025 with status 139: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh''' flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-17T08:57:51.268 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:57:51.381 INFO:teuthology.run:FAIL