2026-02-17T11:43:26.240 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T11:43:26.254 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:43:26.333 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51347 branch: wip-bharath20-testing-2026-02-13-0906-squid description: rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51347' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath20-testing-2026-02-13-0906-squid ceph: conf: global: mon election default strategy: 3 ms bind msgr1: false ms bind msgr2: true ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd pool default size: 2 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon max pg per osd: 1 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd max pg per osd hard ratio: 1 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random create_rbd_pool: false flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(TOO_FEW_PGS\) - \(PG_ - \(PENDING_CREATING_PGS\) - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath20-testing-2026-02-13-0906-squid sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 seed: 4581 sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath20-testing-2026-02-13-0906-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 targets: trial077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOm5PUSMTqSDpDWgQWUuknh/j8ZBK6IWudUUU8WCQVXUnhbaApToFOVSXuX4Djnvf8End4+jKE3sNP+KYxAzCE0= tasks: - install: null - ceph: null - osd_max_pg_per_osd: from_primary: false pg_num: 1 pool_size: 2 test_create_from_mon: false teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:10:36 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T11:43:26.334 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa; will attempt to use it 2026-02-17T11:43:26.334 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks 2026-02-17T11:43:26.334 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T11:43:26.336 INFO:teuthology.task.internal:Checking packages... 2026-02-17T11:43:26.336 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3c96dfb3f50b3d02598a82af7104764bfdcd3919' 2026-02-17T11:43:26.336 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T11:43:26.336 INFO:teuthology.packaging:ref: None 2026-02-17T11:43:26.336 INFO:teuthology.packaging:tag: None 2026-02-17T11:43:26.336 INFO:teuthology.packaging:branch: wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:43:26.336 INFO:teuthology.packaging:sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:43:26.336 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:43:26.453 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-675.g3c96dfb3 2026-02-17T11:43:26.455 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T11:43:26.468 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T11:43:26.468 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T11:43:26.481 INFO:teuthology.task.internal:Saving configuration 2026-02-17T11:43:26.492 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T11:43:26.507 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T11:43:26.587 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial077.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51347', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:40:03.182787', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOm5PUSMTqSDpDWgQWUuknh/j8ZBK6IWudUUU8WCQVXUnhbaApToFOVSXuX4Djnvf8End4+jKE3sNP+KYxAzCE0='} 2026-02-17T11:43:26.588 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T11:43:26.599 INFO:teuthology.task.internal:roles: ubuntu@trial077.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2026-02-17T11:43:26.599 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T11:43:26.684 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7b8fd01cf560>, signals=[15]) 2026-02-17T11:43:26.684 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T11:43:26.695 INFO:teuthology.task.internal:Opening connections... 2026-02-17T11:43:26.695 DEBUG:teuthology.task.internal:connecting to ubuntu@trial077.front.sepia.ceph.com 2026-02-17T11:43:26.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:43:26.761 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T11:43:26.771 DEBUG:teuthology.orchestra.run.trial077:> uname -m 2026-02-17T11:43:26.831 INFO:teuthology.orchestra.run.trial077.stdout:x86_64 2026-02-17T11:43:26.832 DEBUG:teuthology.orchestra.run.trial077:> cat /etc/os-release 2026-02-17T11:43:26.888 INFO:teuthology.orchestra.run.trial077.stdout:NAME="CentOS Stream" 2026-02-17T11:43:26.888 INFO:teuthology.orchestra.run.trial077.stdout:VERSION="9" 2026-02-17T11:43:26.888 INFO:teuthology.orchestra.run.trial077.stdout:ID="centos" 2026-02-17T11:43:26.888 INFO:teuthology.orchestra.run.trial077.stdout:ID_LIKE="rhel fedora" 2026-02-17T11:43:26.888 INFO:teuthology.orchestra.run.trial077.stdout:VERSION_ID="9" 2026-02-17T11:43:26.888 INFO:teuthology.orchestra.run.trial077.stdout:PLATFORM_ID="platform:el9" 2026-02-17T11:43:26.888 INFO:teuthology.orchestra.run.trial077.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T11:43:26.888 INFO:teuthology.orchestra.run.trial077.stdout:ANSI_COLOR="0;31" 2026-02-17T11:43:26.888 INFO:teuthology.orchestra.run.trial077.stdout:LOGO="fedora-logo-icon" 2026-02-17T11:43:26.889 INFO:teuthology.orchestra.run.trial077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T11:43:26.889 INFO:teuthology.orchestra.run.trial077.stdout:HOME_URL="https://centos.org/" 2026-02-17T11:43:26.889 INFO:teuthology.orchestra.run.trial077.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T11:43:26.889 INFO:teuthology.orchestra.run.trial077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T11:43:26.889 INFO:teuthology.orchestra.run.trial077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T11:43:26.890 INFO:teuthology.lock.ops:Updating trial077.front.sepia.ceph.com on lock server 2026-02-17T11:43:26.979 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T11:43:26.991 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T11:43:27.002 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T11:43:27.002 DEBUG:teuthology.orchestra.run.trial077:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:43:27.017 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T11:43:27.027 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T11:43:27.028 DEBUG:teuthology.orchestra.run.trial077:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:43:27.074 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T11:43:27.160 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T11:43:27.180 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T11:43:27.180 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T11:43:27.180 DEBUG:teuthology.orchestra.run.trial077:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:43:27.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:43:27.195 DEBUG:teuthology.orchestra.run.trial077:> uname -r 2026-02-17T11:43:27.250 INFO:teuthology.orchestra.run.trial077.stdout:5.14.0-645.el9.x86_64 2026-02-17T11:43:27.251 INFO:teuthology.task.kernel:Running kernel on trial077: 5.14.0-645.el9.x86_64 2026-02-17T11:43:27.251 DEBUG:teuthology.orchestra.run.trial077:> sudo yum install -y kernel 2026-02-17T11:43:28.291 INFO:teuthology.orchestra.run.trial077.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-17T11:43:32.031 INFO:teuthology.orchestra.run.trial077.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 27 MB 00:03 2026-02-17T11:43:35.271 INFO:teuthology.orchestra.run.trial077.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 7.8 MB 00:00 2026-02-17T11:43:36.098 INFO:teuthology.orchestra.run.trial077.stdout:CentOS Stream 9 - Extras packages 201 kB/s | 20 kB 00:00 2026-02-17T11:43:36.408 INFO:teuthology.orchestra.run.trial077.stdout:Extra Packages for Enterprise Linux 81 MB/s | 20 MB 00:00 2026-02-17T11:43:39.623 INFO:teuthology.orchestra.run.trial077.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-17T11:43:40.631 INFO:teuthology.orchestra.run.trial077.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T11:43:40.650 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:43:40.652 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:43:40.652 INFO:teuthology.orchestra.run.trial077.stdout: Package Architecture Version Repository Size 2026-02-17T11:43:40.652 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:43:40.652 INFO:teuthology.orchestra.run.trial077.stdout:Installing: 2026-02-17T11:43:40.652 INFO:teuthology.orchestra.run.trial077.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T11:43:40.652 INFO:teuthology.orchestra.run.trial077.stdout:Installing dependencies: 2026-02-17T11:43:40.652 INFO:teuthology.orchestra.run.trial077.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T11:43:40.652 INFO:teuthology.orchestra.run.trial077.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T11:43:40.652 INFO:teuthology.orchestra.run.trial077.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T11:43:40.653 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:43:40.653 INFO:teuthology.orchestra.run.trial077.stdout:Transaction Summary 2026-02-17T11:43:40.653 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:43:40.653 INFO:teuthology.orchestra.run.trial077.stdout:Install 4 Packages 2026-02-17T11:43:40.653 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:43:40.653 INFO:teuthology.orchestra.run.trial077.stdout:Total download size: 88 M 2026-02-17T11:43:40.653 INFO:teuthology.orchestra.run.trial077.stdout:Installed size: 135 M 2026-02-17T11:43:40.653 INFO:teuthology.orchestra.run.trial077.stdout:Downloading Packages: 2026-02-17T11:43:41.106 INFO:teuthology.orchestra.run.trial077.stdout:(1/4): kernel-core-5.14.0-681.el9.x86_64.rpm 114 MB/s | 17 MB 00:00 2026-02-17T11:43:41.113 INFO:teuthology.orchestra.run.trial077.stdout:(2/4): kernel-5.14.0-681.el9.x86_64.rpm 5.0 MB/s | 803 kB 00:00 2026-02-17T11:43:41.235 INFO:teuthology.orchestra.run.trial077.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 142 MB/s | 40 MB 00:00 2026-02-17T11:43:41.331 INFO:teuthology.orchestra.run.trial077.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 138 MB/s | 31 MB 00:00 2026-02-17T11:43:41.333 INFO:teuthology.orchestra.run.trial077.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:43:41.333 INFO:teuthology.orchestra.run.trial077.stdout:Total 130 MB/s | 88 MB 00:00 2026-02-17T11:43:41.523 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction check 2026-02-17T11:43:41.722 INFO:teuthology.orchestra.run.trial077.stdout:Transaction check succeeded. 2026-02-17T11:43:41.722 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction test 2026-02-17T11:43:42.066 INFO:teuthology.orchestra.run.trial077.stdout:Transaction test succeeded. 2026-02-17T11:43:42.066 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction 2026-02-17T11:43:43.145 INFO:teuthology.orchestra.run.trial077.stdout: Preparing : 1/1 2026-02-17T11:43:43.427 INFO:teuthology.orchestra.run.trial077.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:43:43.446 INFO:teuthology.orchestra.run.trial077.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:43:45.242 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:43:45.270 INFO:teuthology.orchestra.run.trial077.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:43:48.292 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:43:48.298 INFO:teuthology.orchestra.run.trial077.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:43:51.328 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:44:21.693 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:44:21.715 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:44:21.778 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:44:21.778 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:44:21.778 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:44:21.778 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:44:21.829 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:44:21.830 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:44:21.830 INFO:teuthology.orchestra.run.trial077.stdout:Installed: 2026-02-17T11:44:21.830 INFO:teuthology.orchestra.run.trial077.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T11:44:21.830 INFO:teuthology.orchestra.run.trial077.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T11:44:21.830 INFO:teuthology.orchestra.run.trial077.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T11:44:21.830 INFO:teuthology.orchestra.run.trial077.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T11:44:21.830 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:44:21.830 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:44:21.890 DEBUG:teuthology.orchestra.run.trial077:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:44:21.917 INFO:teuthology.orchestra.run.trial077.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:44:21.917 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:44:21.918 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T11:44:21.918 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:44:21.918 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:44:21.918 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T11:44:21.918 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial077.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:44:21.918 DEBUG:teuthology.orchestra.run.trial077:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:44:21.981 INFO:teuthology.orchestra.run.trial077.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:44:21.981 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:44:21.982 DEBUG:teuthology.orchestra.run.trial077:> sudo rpm -qi grub2-tools 2026-02-17T11:44:22.049 INFO:teuthology.orchestra.run.trial077.stdout:Name : grub2-tools 2026-02-17T11:44:22.049 INFO:teuthology.orchestra.run.trial077.stdout:Epoch : 1 2026-02-17T11:44:22.050 INFO:teuthology.orchestra.run.trial077.stdout:Version : 2.06 2026-02-17T11:44:22.050 INFO:teuthology.orchestra.run.trial077.stdout:Release : 118.el9 2026-02-17T11:44:22.050 INFO:teuthology.orchestra.run.trial077.stdout:Architecture: x86_64 2026-02-17T11:44:22.050 INFO:teuthology.orchestra.run.trial077.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T11:44:22.050 INFO:teuthology.orchestra.run.trial077.stdout:Group : Unspecified 2026-02-17T11:44:22.050 INFO:teuthology.orchestra.run.trial077.stdout:Size : 8393909 2026-02-17T11:44:22.050 INFO:teuthology.orchestra.run.trial077.stdout:License : GPLv3+ 2026-02-17T11:44:22.050 INFO:teuthology.orchestra.run.trial077.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T11:44:22.050 INFO:teuthology.orchestra.run.trial077.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T11:44:22.050 INFO:teuthology.orchestra.run.trial077.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T11:44:22.051 INFO:teuthology.orchestra.run.trial077.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T11:44:22.051 INFO:teuthology.orchestra.run.trial077.stdout:Packager : builder@centos.org 2026-02-17T11:44:22.051 INFO:teuthology.orchestra.run.trial077.stdout:Vendor : CentOS 2026-02-17T11:44:22.051 INFO:teuthology.orchestra.run.trial077.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T11:44:22.051 INFO:teuthology.orchestra.run.trial077.stdout:Summary : Support tools for GRUB. 2026-02-17T11:44:22.051 INFO:teuthology.orchestra.run.trial077.stdout:Description : 2026-02-17T11:44:22.051 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:44:22.051 INFO:teuthology.orchestra.run.trial077.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T11:44:22.051 INFO:teuthology.orchestra.run.trial077.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T11:44:22.051 INFO:teuthology.orchestra.run.trial077.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T11:44:22.051 INFO:teuthology.orchestra.run.trial077.stdout:hardware devices. 2026-02-17T11:44:22.051 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:44:22.052 INFO:teuthology.orchestra.run.trial077.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T11:44:22.053 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T11:44:22.053 INFO:teuthology.task.kernel:Updating grub on trial077 to boot 5.14.0-681.el9.x86_64 2026-02-17T11:44:22.053 DEBUG:teuthology.orchestra.run.trial077:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T11:44:22.115 INFO:teuthology.orchestra.run.trial077.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:44:22.117 DEBUG:teuthology.orchestra.run.trial077:> sudo command -v grubby && echo yes || echo no 2026-02-17T11:44:22.179 INFO:teuthology.orchestra.run.trial077.stdout:/sbin/grubby 2026-02-17T11:44:22.180 INFO:teuthology.orchestra.run.trial077.stdout:yes 2026-02-17T11:44:22.181 DEBUG:teuthology.orchestra.run.trial077:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T11:44:22.246 INFO:teuthology.orchestra.run.trial077.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:44:22.247 DEBUG:teuthology.orchestra.run.trial077:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T11:44:22.321 DEBUG:teuthology.orchestra.run.trial077:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T11:44:22.524 INFO:teuthology.orchestra.run.trial077.stderr:Generating grub configuration file ... 2026-02-17T11:44:22.587 INFO:teuthology.orchestra.run.trial077.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T11:44:22.593 INFO:teuthology.orchestra.run.trial077.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T11:44:22.838 INFO:teuthology.orchestra.run.trial077.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T11:44:22.845 INFO:teuthology.orchestra.run.trial077.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T11:44:22.876 INFO:teuthology.orchestra.run.trial077.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T11:44:22.883 INFO:teuthology.orchestra.run.trial077.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T11:44:22.906 INFO:teuthology.orchestra.run.trial077.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T11:44:22.913 INFO:teuthology.orchestra.run.trial077.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T11:44:22.995 INFO:teuthology.orchestra.run.trial077.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:44:23.003 INFO:teuthology.orchestra.run.trial077.stderr:done 2026-02-17T11:44:23.005 DEBUG:teuthology.orchestra.run.trial077:> test -d /sys/firmware/efi 2026-02-17T11:44:23.022 DEBUG:teuthology.orchestra.run.trial077:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T11:44:23.091 INFO:teuthology.orchestra.run.trial077.stdout:/boot/efi/EFI/BOOT 2026-02-17T11:44:23.092 INFO:teuthology.orchestra.run.trial077.stdout:/boot/efi/EFI/centos 2026-02-17T11:44:23.093 DEBUG:teuthology.orchestra.run.trial077:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T11:44:23.159 INFO:teuthology.orchestra.run.trial077.stdout:no 2026-02-17T11:44:23.160 DEBUG:teuthology.orchestra.run.trial077:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T11:44:23.223 INFO:teuthology.orchestra.run.trial077.stdout:yes 2026-02-17T11:44:23.224 DEBUG:teuthology.orchestra.run.trial077:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T11:44:23.289 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial077 2026-02-17T11:44:23.289 DEBUG:teuthology.orchestra.run.trial077:> sudo bash -c ' 2026-02-17T11:44:23.289 DEBUG:teuthology.orchestra.run.trial077:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:44:23.290 DEBUG:teuthology.orchestra.run.trial077:> ' 2026-02-17T11:44:53.333 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T11:44:53.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial077.front.sepia.ceph.com' 2026-02-17T11:44:53.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:45:07.584 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.77 2026-02-17T11:45:16.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial077.front.sepia.ceph.com' 2026-02-17T11:45:16.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:45:52.644 DEBUG:teuthology.orchestra.run.trial077:> true 2026-02-17T11:45:52.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial077.front.sepia.ceph.com' 2026-02-17T11:45:52.799 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T11:45:52.799 DEBUG:teuthology.orchestra.run.trial077:> uname -r 2026-02-17T11:45:52.855 INFO:teuthology.orchestra.run.trial077.stdout:5.14.0-681.el9.x86_64 2026-02-17T11:45:52.856 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T11:45:52.856 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T11:45:52.856 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T11:45:53.857 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T11:45:53.857 DEBUG:teuthology.orchestra.run.trial077:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T11:45:53.887 INFO:teuthology.orchestra.run.trial077.stdout:ttyS1 2026-02-17T11:45:53.910 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:53.910 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T11:45:53.920 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T11:45:53.921 DEBUG:teuthology.orchestra.run.trial077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T11:45:53.968 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T11:45:53.981 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T11:45:53.992 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T11:45:53.993 DEBUG:teuthology.orchestra.run.trial077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T11:45:54.030 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T11:45:54.041 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T11:45:54.041 DEBUG:teuthology.orchestra.run.trial077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T11:45:54.089 INFO:teuthology.orchestra.run.trial077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:45:54.098 INFO:teuthology.orchestra.run.trial077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:45:54.100 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T11:45:54.112 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T11:45:54.112 DEBUG:teuthology.orchestra.run.trial077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T11:45:54.166 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T11:45:54.182 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T11:45:54.182 DEBUG:teuthology.orchestra.run.trial077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T11:45:54.222 DEBUG:teuthology.orchestra.run.trial077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:45:54.382 DEBUG:teuthology.orchestra.run.trial077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:45:54.407 DEBUG:teuthology.orchestra.run.trial077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:45:54.553 DEBUG:teuthology.orchestra.run.trial077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:45:54.579 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:45:54.579 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T11:45:54.643 DEBUG:teuthology.orchestra.run.trial077:> sudo service rsyslog restart 2026-02-17T11:45:54.712 INFO:teuthology.orchestra.run.trial077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:45:54.977 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T11:45:54.992 INFO:teuthology.task.internal:Starting timer... 2026-02-17T11:45:54.992 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T11:45:55.013 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T11:45:55.034 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-17T11:45:55.035 DEBUG:teuthology.orchestra.run.trial077:> sudo service auditd rotate 2026-02-17T11:45:55.064 INFO:teuthology.orchestra.run.trial077.stdout:Rotating logs: 2026-02-17T11:45:55.066 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T11:45:55.066 DEBUG:teuthology.orchestra.run.trial077:> /usr/sbin/getenforce 2026-02-17T11:45:55.122 INFO:teuthology.orchestra.run.trial077.stdout:Permissive 2026-02-17T11:45:55.122 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial077.front.sepia.ceph.com': 'permissive'} 2026-02-17T11:45:55.123 DEBUG:teuthology.orchestra.run.trial077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:45:55.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:45:55.187 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T11:45:55.188 DEBUG:teuthology.orchestra.run.trial077:> sudo /usr/sbin/setenforce permissive 2026-02-17T11:45:55.253 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T11:45:55.273 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T11:45:55.285 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T11:45:55.287 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial077.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T11:48:39.849 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial077.front.sepia.ceph.com')] 2026-02-17T11:48:39.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial077.front.sepia.ceph.com' 2026-02-17T11:48:39.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:48:39.921 DEBUG:teuthology.orchestra.run.trial077:> true 2026-02-17T11:48:39.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial077.front.sepia.ceph.com' 2026-02-17T11:48:39.999 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T11:48:40.011 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T11:48:40.012 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:48:40.012 DEBUG:teuthology.orchestra.run.trial077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:48:40.068 INFO:teuthology.orchestra.run.trial077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T11:48:40.080 INFO:teuthology.orchestra.run.trial077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T11:48:40.100 INFO:teuthology.orchestra.run.trial077.stderr:sudo: ntpd: command not found 2026-02-17T11:48:40.110 INFO:teuthology.orchestra.run.trial077.stdout:506 Cannot talk to daemon 2026-02-17T11:48:40.123 INFO:teuthology.orchestra.run.trial077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T11:48:40.134 INFO:teuthology.orchestra.run.trial077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T11:48:40.183 INFO:teuthology.orchestra.run.trial077.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:48:40.185 INFO:teuthology.orchestra.run.trial077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:48:40.185 INFO:teuthology.orchestra.run.trial077.stdout:=============================================================================== 2026-02-17T11:48:40.186 INFO:teuthology.run_tasks:Running task install... 2026-02-17T11:48:40.199 DEBUG:teuthology.task.install:project ceph 2026-02-17T11:48:40.200 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}} 2026-02-17T11:48:40.200 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'} 2026-02-17T11:48:40.200 INFO:teuthology.task.install:Using flavor: default 2026-02-17T11:48:40.207 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T11:48:40.207 INFO:teuthology.task.install:extra packages: [] 2026-02-17T11:48:40.208 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T11:48:40.208 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:48:40.362 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T11:48:40.363 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T11:48:40.583 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T11:48:40.583 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:48:40.583 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T11:48:40.609 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T11:48:40.610 DEBUG:teuthology.orchestra.run.trial077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T11:48:40.675 DEBUG:teuthology.orchestra.run.trial077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T11:48:40.748 DEBUG:teuthology.orchestra.run.trial077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T11:48:40.811 INFO:teuthology.orchestra.run.trial077.stdout:check_obsoletes = 1 2026-02-17T11:48:40.812 DEBUG:teuthology.orchestra.run.trial077:> sudo yum clean all 2026-02-17T11:48:40.960 INFO:teuthology.orchestra.run.trial077.stdout:41 files removed 2026-02-17T11:48:40.974 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install ceph-radosgw 2026-02-17T11:48:41.468 INFO:teuthology.orchestra.run.trial077.stdout:ceph packages for x86_64 246 kB/s | 86 kB 00:00 2026-02-17T11:48:41.761 INFO:teuthology.orchestra.run.trial077.stdout:ceph noarch packages 44 kB/s | 12 kB 00:00 2026-02-17T11:48:42.048 INFO:teuthology.orchestra.run.trial077.stdout:ceph source packages 7.1 kB/s | 1.9 kB 00:00 2026-02-17T11:48:42.853 INFO:teuthology.orchestra.run.trial077.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-17T11:48:45.989 INFO:teuthology.orchestra.run.trial077.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T11:48:48.738 INFO:teuthology.orchestra.run.trial077.stdout:CentOS Stream 9 - CRB 21 MB/s | 7.8 MB 00:00 2026-02-17T11:48:49.543 INFO:teuthology.orchestra.run.trial077.stdout:CentOS Stream 9 - Extras packages 247 kB/s | 20 kB 00:00 2026-02-17T11:48:50.118 INFO:teuthology.orchestra.run.trial077.stdout:Extra Packages for Enterprise Linux 40 MB/s | 20 MB 00:00 2026-02-17T11:48:53.324 INFO:teuthology.orchestra.run.trial077.stdout:lab-extras 2.0 MB/s | 50 kB 00:00 2026-02-17T11:48:54.543 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:48:54.545 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:48:54.545 INFO:teuthology.orchestra.run.trial077.stdout: Package Arch Version Repository Size 2026-02-17T11:48:54.545 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:48:54.545 INFO:teuthology.orchestra.run.trial077.stdout:Installing: 2026-02-17T11:48:54.545 INFO:teuthology.orchestra.run.trial077.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T11:48:54.545 INFO:teuthology.orchestra.run.trial077.stdout:Upgrading: 2026-02-17T11:48:54.545 INFO:teuthology.orchestra.run.trial077.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T11:48:54.545 INFO:teuthology.orchestra.run.trial077.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T11:48:54.546 INFO:teuthology.orchestra.run.trial077.stdout:Installing dependencies: 2026-02-17T11:48:54.546 INFO:teuthology.orchestra.run.trial077.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T11:48:54.546 INFO:teuthology.orchestra.run.trial077.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T11:48:54.546 INFO:teuthology.orchestra.run.trial077.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T11:48:54.546 INFO:teuthology.orchestra.run.trial077.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T11:48:54.546 INFO:teuthology.orchestra.run.trial077.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T11:48:54.546 INFO:teuthology.orchestra.run.trial077.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T11:48:54.546 INFO:teuthology.orchestra.run.trial077.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T11:48:54.546 INFO:teuthology.orchestra.run.trial077.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T11:48:54.546 INFO:teuthology.orchestra.run.trial077.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T11:48:54.546 INFO:teuthology.orchestra.run.trial077.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T11:48:54.546 INFO:teuthology.orchestra.run.trial077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T11:48:54.547 INFO:teuthology.orchestra.run.trial077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T11:48:54.547 INFO:teuthology.orchestra.run.trial077.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T11:48:54.547 INFO:teuthology.orchestra.run.trial077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T11:48:54.547 INFO:teuthology.orchestra.run.trial077.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T11:48:54.547 INFO:teuthology.orchestra.run.trial077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T11:48:54.547 INFO:teuthology.orchestra.run.trial077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T11:48:54.547 INFO:teuthology.orchestra.run.trial077.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T11:48:54.547 INFO:teuthology.orchestra.run.trial077.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T11:48:54.547 INFO:teuthology.orchestra.run.trial077.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T11:48:54.547 INFO:teuthology.orchestra.run.trial077.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T11:48:54.547 INFO:teuthology.orchestra.run.trial077.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T11:48:54.547 INFO:teuthology.orchestra.run.trial077.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T11:48:54.548 INFO:teuthology.orchestra.run.trial077.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T11:48:54.548 INFO:teuthology.orchestra.run.trial077.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T11:48:54.548 INFO:teuthology.orchestra.run.trial077.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T11:48:54.548 INFO:teuthology.orchestra.run.trial077.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T11:48:54.548 INFO:teuthology.orchestra.run.trial077.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T11:48:54.548 INFO:teuthology.orchestra.run.trial077.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T11:48:54.548 INFO:teuthology.orchestra.run.trial077.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T11:48:54.548 INFO:teuthology.orchestra.run.trial077.stdout:Installing weak dependencies: 2026-02-17T11:48:54.548 INFO:teuthology.orchestra.run.trial077.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T11:48:54.548 INFO:teuthology.orchestra.run.trial077.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T11:48:54.548 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:48:54.548 INFO:teuthology.orchestra.run.trial077.stdout:Transaction Summary 2026-02-17T11:48:54.549 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:48:54.549 INFO:teuthology.orchestra.run.trial077.stdout:Install 33 Packages 2026-02-17T11:48:54.549 INFO:teuthology.orchestra.run.trial077.stdout:Upgrade 2 Packages 2026-02-17T11:48:54.549 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:48:54.549 INFO:teuthology.orchestra.run.trial077.stdout:Total download size: 63 M 2026-02-17T11:48:54.550 INFO:teuthology.orchestra.run.trial077.stdout:Downloading Packages: 2026-02-17T11:48:55.208 INFO:teuthology.orchestra.run.trial077.stdout:(1/35): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 16 MB/s | 5.5 MB 00:00 2026-02-17T11:48:55.250 INFO:teuthology.orchestra.run.trial077.stdout:(2/35): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 608 kB/s | 25 kB 00:00 2026-02-17T11:48:55.312 INFO:teuthology.orchestra.run.trial077.stdout:(3/35): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 16 MB/s | 999 kB 00:00 2026-02-17T11:48:55.366 INFO:teuthology.orchestra.run.trial077.stdout:(4/35): libradosstriper1-19.2.3-675.g3c96dfb3.e 9.0 MB/s | 503 kB 00:00 2026-02-17T11:48:55.465 INFO:teuthology.orchestra.run.trial077.stdout:(5/35): ceph-radosgw-19.2.3-675.g3c96dfb3.el9.x 18 MB/s | 11 MB 00:00 2026-02-17T11:48:55.518 INFO:teuthology.orchestra.run.trial077.stdout:(6/35): python3-ceph-argparse-19.2.3-675.g3c96d 865 kB/s | 45 kB 00:00 2026-02-17T11:48:55.572 INFO:teuthology.orchestra.run.trial077.stdout:(7/35): python3-ceph-common-19.2.3-675.g3c96dfb 2.5 MB/s | 142 kB 00:00 2026-02-17T11:48:55.598 INFO:teuthology.orchestra.run.trial077.stdout:(8/35): librgw2-19.2.3-675.g3c96dfb3.el9.x86_64 23 MB/s | 5.4 MB 00:00 2026-02-17T11:48:55.620 INFO:teuthology.orchestra.run.trial077.stdout:(9/35): python3-cephfs-19.2.3-675.g3c96dfb3.el9 3.3 MB/s | 165 kB 00:00 2026-02-17T11:48:55.635 INFO:teuthology.orchestra.run.trial077.stdout:(10/35): python3-rados-19.2.3-675.g3c96dfb3.el9 8.4 MB/s | 322 kB 00:00 2026-02-17T11:48:55.661 INFO:teuthology.orchestra.run.trial077.stdout:(11/35): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 7.3 MB/s | 303 kB 00:00 2026-02-17T11:48:55.671 INFO:teuthology.orchestra.run.trial077.stdout:(12/35): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 2.7 MB/s | 100 kB 00:00 2026-02-17T11:48:55.725 INFO:teuthology.orchestra.run.trial077.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 523 kB/s | 33 kB 00:00 2026-02-17T11:48:55.757 INFO:teuthology.orchestra.run.trial077.stdout:(14/35): ceph-common-19.2.3-675.g3c96dfb3.el9.x 24 MB/s | 22 MB 00:00 2026-02-17T11:48:55.778 INFO:teuthology.orchestra.run.trial077.stdout:(15/35): pciutils-3.7.0-7.el9.x86_64.rpm 1.7 MB/s | 93 kB 00:00 2026-02-17T11:48:55.820 INFO:teuthology.orchestra.run.trial077.stdout:(16/35): boost-program-options-1.75.0-13.el9.x8 1.6 MB/s | 104 kB 00:00 2026-02-17T11:48:55.822 INFO:teuthology.orchestra.run.trial077.stdout:(17/35): libnbd-1.20.3-4.el9.x86_64.rpm 3.7 MB/s | 164 kB 00:00 2026-02-17T11:48:55.841 INFO:teuthology.orchestra.run.trial077.stdout:(18/35): nvme-cli-2.13-1.el9.x86_64.rpm 6.4 MB/s | 1.1 MB 00:00 2026-02-17T11:48:55.844 INFO:teuthology.orchestra.run.trial077.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-17T11:48:55.863 INFO:teuthology.orchestra.run.trial077.stdout:(20/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.6 MB/s | 160 kB 00:00 2026-02-17T11:48:55.867 INFO:teuthology.orchestra.run.trial077.stdout:(21/35): librdkafka-1.6.1-102.el9.x86_64.rpm 25 MB/s | 662 kB 00:00 2026-02-17T11:48:55.868 INFO:teuthology.orchestra.run.trial077.stdout:(22/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 12 MB/s | 292 kB 00:00 2026-02-17T11:48:55.889 INFO:teuthology.orchestra.run.trial077.stdout:(23/35): qatlib-25.08.0-2.el9.x86_64.rpm 9.2 MB/s | 240 kB 00:00 2026-02-17T11:48:55.890 INFO:teuthology.orchestra.run.trial077.stdout:(24/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.6 MB/s | 37 kB 00:00 2026-02-17T11:48:55.890 INFO:teuthology.orchestra.run.trial077.stdout:(25/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-17T11:48:55.944 INFO:teuthology.orchestra.run.trial077.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 460 kB/s | 25 kB 00:00 2026-02-17T11:48:55.978 INFO:teuthology.orchestra.run.trial077.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2026-02-17T11:48:55.998 INFO:teuthology.orchestra.run.trial077.stdout:(28/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2026-02-17T11:48:56.001 INFO:teuthology.orchestra.run.trial077.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2026-02-17T11:48:56.040 INFO:teuthology.orchestra.run.trial077.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 4.9 MB/s | 191 kB 00:00 2026-02-17T11:48:56.046 INFO:teuthology.orchestra.run.trial077.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 17 MB/s | 838 kB 00:00 2026-02-17T11:48:56.074 INFO:teuthology.orchestra.run.trial077.stdout:(32/35): libarrow-9.0.0-15.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2026-02-17T11:48:56.107 INFO:teuthology.orchestra.run.trial077.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2026-02-17T11:48:56.127 INFO:teuthology.orchestra.run.trial077.stdout:(34/35): librados2-19.2.3-675.g3c96dfb3.el9.x86 42 MB/s | 3.4 MB 00:00 2026-02-17T11:48:56.164 INFO:teuthology.orchestra.run.trial077.stdout:(35/35): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 35 MB/s | 3.2 MB 00:00 2026-02-17T11:48:56.166 INFO:teuthology.orchestra.run.trial077.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:48:56.166 INFO:teuthology.orchestra.run.trial077.stdout:Total 39 MB/s | 63 MB 00:01 2026-02-17T11:48:56.273 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction check 2026-02-17T11:48:56.291 INFO:teuthology.orchestra.run.trial077.stdout:Transaction check succeeded. 2026-02-17T11:48:56.291 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction test 2026-02-17T11:48:56.529 INFO:teuthology.orchestra.run.trial077.stdout:Transaction test succeeded. 2026-02-17T11:48:56.529 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction 2026-02-17T11:48:56.821 INFO:teuthology.orchestra.run.trial077.stdout: Preparing : 1/1 2026-02-17T11:48:56.829 INFO:teuthology.orchestra.run.trial077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T11:48:56.832 INFO:teuthology.orchestra.run.trial077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T11:48:56.843 INFO:teuthology.orchestra.run.trial077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T11:48:56.992 INFO:teuthology.orchestra.run.trial077.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T11:48:56.997 INFO:teuthology.orchestra.run.trial077.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:48:57.027 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:48:57.070 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:48:57.071 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:48:57.082 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:48:57.086 INFO:teuthology.orchestra.run.trial077.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T11:48:57.095 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/37 2026-02-17T11:48:57.117 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:48:57.118 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:48:57.130 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:48:57.160 INFO:teuthology.orchestra.run.trial077.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T11:48:57.164 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T11:48:57.170 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T11:48:57.172 INFO:teuthology.orchestra.run.trial077.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T11:48:57.175 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T11:48:57.181 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T11:48:57.320 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:48:57.321 INFO:teuthology.orchestra.run.trial077.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:48:57.347 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:48:57.351 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/37 2026-02-17T11:48:57.357 INFO:teuthology.orchestra.run.trial077.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T11:48:57.584 INFO:teuthology.orchestra.run.trial077.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T11:48:57.585 INFO:teuthology.orchestra.run.trial077.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:48:57.602 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:48:57.605 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/37 2026-02-17T11:48:57.609 INFO:teuthology.orchestra.run.trial077.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T11:48:57.612 INFO:teuthology.orchestra.run.trial077.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T11:48:57.612 INFO:teuthology.orchestra.run.trial077.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:48:57.632 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:48:57.744 INFO:teuthology.orchestra.run.trial077.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T11:48:57.746 INFO:teuthology.orchestra.run.trial077.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:48:58.025 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:48:58.026 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:48:58.026 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:48:58.060 INFO:teuthology.orchestra.run.trial077.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T11:48:58.062 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 31/37 2026-02-17T11:48:59.046 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:48:59.049 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:48:59.333 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:48:59.336 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:48:59.378 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:48:59.378 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T11:48:59.378 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T11:48:59.378 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:48:59.381 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:49:03.915 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:49:03.915 INFO:teuthology.orchestra.run.trial077.stdout:skipping the directory /sys 2026-02-17T11:49:03.915 INFO:teuthology.orchestra.run.trial077.stdout:skipping the directory /proc 2026-02-17T11:49:03.915 INFO:teuthology.orchestra.run.trial077.stdout:skipping the directory /mnt 2026-02-17T11:49:03.915 INFO:teuthology.orchestra.run.trial077.stdout:skipping the directory /var/tmp 2026-02-17T11:49:03.915 INFO:teuthology.orchestra.run.trial077.stdout:skipping the directory /home 2026-02-17T11:49:03.916 INFO:teuthology.orchestra.run.trial077.stdout:skipping the directory /root 2026-02-17T11:49:03.916 INFO:teuthology.orchestra.run.trial077.stdout:skipping the directory /tmp 2026-02-17T11:49:03.916 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:04.368 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:49:04.391 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:49:04.391 INFO:teuthology.orchestra.run.trial077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:49:04.391 INFO:teuthology.orchestra.run.trial077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T11:49:04.392 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:49:04.392 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:49:04.392 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:04.393 INFO:teuthology.orchestra.run.trial077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:49:04.406 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:49:04.406 INFO:teuthology.orchestra.run.trial077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:49:04.462 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:49:04.462 INFO:teuthology.orchestra.run.trial077.stdout:Creating group 'qat' with GID 992. 2026-02-17T11:49:04.462 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T11:49:04.730 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T11:49:04.731 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T11:49:04.731 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:49:04.731 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T11:49:04.731 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 36/37 2026-02-17T11:49:04.791 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:49:04.791 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:04.791 INFO:teuthology.orchestra.run.trial077.stdout:Upgraded: 2026-02-17T11:49:04.791 INFO:teuthology.orchestra.run.trial077.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.791 INFO:teuthology.orchestra.run.trial077.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.791 INFO:teuthology.orchestra.run.trial077.stdout:Installed: 2026-02-17T11:49:04.791 INFO:teuthology.orchestra.run.trial077.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T11:49:04.791 INFO:teuthology.orchestra.run.trial077.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.791 INFO:teuthology.orchestra.run.trial077.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.791 INFO:teuthology.orchestra.run.trial077.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.791 INFO:teuthology.orchestra.run.trial077.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:04.792 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:04.832 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install ceph-test 2026-02-17T11:49:05.144 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:05.227 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:05.228 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:05.228 INFO:teuthology.orchestra.run.trial077.stdout: Package Arch Version Repository Size 2026-02-17T11:49:05.228 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:05.228 INFO:teuthology.orchestra.run.trial077.stdout:Installing: 2026-02-17T11:49:05.228 INFO:teuthology.orchestra.run.trial077.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T11:49:05.228 INFO:teuthology.orchestra.run.trial077.stdout:Installing dependencies: 2026-02-17T11:49:05.228 INFO:teuthology.orchestra.run.trial077.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T11:49:05.228 INFO:teuthology.orchestra.run.trial077.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T11:49:05.228 INFO:teuthology.orchestra.run.trial077.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T11:49:05.228 INFO:teuthology.orchestra.run.trial077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T11:49:05.229 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:05.229 INFO:teuthology.orchestra.run.trial077.stdout:Transaction Summary 2026-02-17T11:49:05.229 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:05.229 INFO:teuthology.orchestra.run.trial077.stdout:Install 5 Packages 2026-02-17T11:49:05.229 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:05.229 INFO:teuthology.orchestra.run.trial077.stdout:Total download size: 50 M 2026-02-17T11:49:05.229 INFO:teuthology.orchestra.run.trial077.stdout:Installed size: 212 M 2026-02-17T11:49:05.229 INFO:teuthology.orchestra.run.trial077.stdout:Downloading Packages: 2026-02-17T11:49:05.662 INFO:teuthology.orchestra.run.trial077.stdout:(1/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 472 kB/s | 163 kB 00:00 2026-02-17T11:49:06.197 INFO:teuthology.orchestra.run.trial077.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 264 kB/s | 233 kB 00:00 2026-02-17T11:49:06.282 INFO:teuthology.orchestra.run.trial077.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 745 kB/s | 64 kB 00:00 2026-02-17T11:49:06.489 INFO:teuthology.orchestra.run.trial077.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 367 kB/s | 303 kB 00:00 2026-02-17T11:49:07.756 INFO:teuthology.orchestra.run.trial077.stdout:(5/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 20 MB/s | 50 MB 00:02 2026-02-17T11:49:07.758 INFO:teuthology.orchestra.run.trial077.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:07.758 INFO:teuthology.orchestra.run.trial077.stdout:Total 20 MB/s | 50 MB 00:02 2026-02-17T11:49:07.784 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction check 2026-02-17T11:49:07.794 INFO:teuthology.orchestra.run.trial077.stdout:Transaction check succeeded. 2026-02-17T11:49:07.794 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction test 2026-02-17T11:49:07.980 INFO:teuthology.orchestra.run.trial077.stdout:Transaction test succeeded. 2026-02-17T11:49:07.980 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction 2026-02-17T11:49:08.192 INFO:teuthology.orchestra.run.trial077.stdout: Preparing : 1/1 2026-02-17T11:49:08.198 INFO:teuthology.orchestra.run.trial077.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T11:49:08.202 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T11:49:08.210 INFO:teuthology.orchestra.run.trial077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T11:49:08.211 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:49:10.465 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:49:10.482 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:49:10.704 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:49:10.704 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T11:49:10.704 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T11:49:10.704 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T11:49:10.704 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T11:49:10.755 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T11:49:10.755 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:10.755 INFO:teuthology.orchestra.run.trial077.stdout:Installed: 2026-02-17T11:49:10.755 INFO:teuthology.orchestra.run.trial077.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:10.755 INFO:teuthology.orchestra.run.trial077.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:10.756 INFO:teuthology.orchestra.run.trial077.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T11:49:10.756 INFO:teuthology.orchestra.run.trial077.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T11:49:10.756 INFO:teuthology.orchestra.run.trial077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T11:49:10.756 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:10.756 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:10.789 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install ceph 2026-02-17T11:49:11.113 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:18 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:11.201 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:11.203 INFO:teuthology.orchestra.run.trial077.stdout:====================================================================================== 2026-02-17T11:49:11.203 INFO:teuthology.orchestra.run.trial077.stdout: Package Arch Version Repository Size 2026-02-17T11:49:11.203 INFO:teuthology.orchestra.run.trial077.stdout:====================================================================================== 2026-02-17T11:49:11.204 INFO:teuthology.orchestra.run.trial077.stdout:Installing: 2026-02-17T11:49:11.204 INFO:teuthology.orchestra.run.trial077.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T11:49:11.204 INFO:teuthology.orchestra.run.trial077.stdout:Installing dependencies: 2026-02-17T11:49:11.204 INFO:teuthology.orchestra.run.trial077.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T11:49:11.204 INFO:teuthology.orchestra.run.trial077.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T11:49:11.204 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T11:49:11.204 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T11:49:11.204 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T11:49:11.204 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T11:49:11.204 INFO:teuthology.orchestra.run.trial077.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T11:49:11.204 INFO:teuthology.orchestra.run.trial077.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T11:49:11.204 INFO:teuthology.orchestra.run.trial077.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T11:49:11.205 INFO:teuthology.orchestra.run.trial077.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T11:49:11.205 INFO:teuthology.orchestra.run.trial077.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T11:49:11.205 INFO:teuthology.orchestra.run.trial077.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T11:49:11.205 INFO:teuthology.orchestra.run.trial077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T11:49:11.205 INFO:teuthology.orchestra.run.trial077.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T11:49:11.205 INFO:teuthology.orchestra.run.trial077.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T11:49:11.205 INFO:teuthology.orchestra.run.trial077.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T11:49:11.205 INFO:teuthology.orchestra.run.trial077.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T11:49:11.205 INFO:teuthology.orchestra.run.trial077.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T11:49:11.205 INFO:teuthology.orchestra.run.trial077.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T11:49:11.205 INFO:teuthology.orchestra.run.trial077.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T11:49:11.205 INFO:teuthology.orchestra.run.trial077.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T11:49:11.206 INFO:teuthology.orchestra.run.trial077.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T11:49:11.206 INFO:teuthology.orchestra.run.trial077.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T11:49:11.206 INFO:teuthology.orchestra.run.trial077.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T11:49:11.206 INFO:teuthology.orchestra.run.trial077.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T11:49:11.206 INFO:teuthology.orchestra.run.trial077.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T11:49:11.206 INFO:teuthology.orchestra.run.trial077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T11:49:11.206 INFO:teuthology.orchestra.run.trial077.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T11:49:11.206 INFO:teuthology.orchestra.run.trial077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T11:49:11.206 INFO:teuthology.orchestra.run.trial077.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T11:49:11.206 INFO:teuthology.orchestra.run.trial077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T11:49:11.206 INFO:teuthology.orchestra.run.trial077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T11:49:11.206 INFO:teuthology.orchestra.run.trial077.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T11:49:11.206 INFO:teuthology.orchestra.run.trial077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T11:49:11.207 INFO:teuthology.orchestra.run.trial077.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T11:49:11.207 INFO:teuthology.orchestra.run.trial077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T11:49:11.207 INFO:teuthology.orchestra.run.trial077.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T11:49:11.207 INFO:teuthology.orchestra.run.trial077.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T11:49:11.207 INFO:teuthology.orchestra.run.trial077.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T11:49:11.207 INFO:teuthology.orchestra.run.trial077.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T11:49:11.207 INFO:teuthology.orchestra.run.trial077.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T11:49:11.207 INFO:teuthology.orchestra.run.trial077.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T11:49:11.207 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T11:49:11.207 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T11:49:11.207 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T11:49:11.207 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T11:49:11.207 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T11:49:11.208 INFO:teuthology.orchestra.run.trial077.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T11:49:11.209 INFO:teuthology.orchestra.run.trial077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T11:49:11.209 INFO:teuthology.orchestra.run.trial077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T11:49:11.209 INFO:teuthology.orchestra.run.trial077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T11:49:11.209 INFO:teuthology.orchestra.run.trial077.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T11:49:11.209 INFO:teuthology.orchestra.run.trial077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T11:49:11.209 INFO:teuthology.orchestra.run.trial077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T11:49:11.209 INFO:teuthology.orchestra.run.trial077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T11:49:11.209 INFO:teuthology.orchestra.run.trial077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T11:49:11.209 INFO:teuthology.orchestra.run.trial077.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T11:49:11.209 INFO:teuthology.orchestra.run.trial077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T11:49:11.209 INFO:teuthology.orchestra.run.trial077.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T11:49:11.209 INFO:teuthology.orchestra.run.trial077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T11:49:11.209 INFO:teuthology.orchestra.run.trial077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T11:49:11.210 INFO:teuthology.orchestra.run.trial077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T11:49:11.210 INFO:teuthology.orchestra.run.trial077.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T11:49:11.210 INFO:teuthology.orchestra.run.trial077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T11:49:11.210 INFO:teuthology.orchestra.run.trial077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T11:49:11.210 INFO:teuthology.orchestra.run.trial077.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T11:49:11.210 INFO:teuthology.orchestra.run.trial077.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T11:49:11.210 INFO:teuthology.orchestra.run.trial077.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T11:49:11.210 INFO:teuthology.orchestra.run.trial077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T11:49:11.210 INFO:teuthology.orchestra.run.trial077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T11:49:11.210 INFO:teuthology.orchestra.run.trial077.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T11:49:11.210 INFO:teuthology.orchestra.run.trial077.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T11:49:11.210 INFO:teuthology.orchestra.run.trial077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T11:49:11.210 INFO:teuthology.orchestra.run.trial077.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T11:49:11.211 INFO:teuthology.orchestra.run.trial077.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T11:49:11.211 INFO:teuthology.orchestra.run.trial077.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T11:49:11.211 INFO:teuthology.orchestra.run.trial077.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T11:49:11.211 INFO:teuthology.orchestra.run.trial077.stdout:Installing weak dependencies: 2026-02-17T11:49:11.211 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T11:49:11.211 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T11:49:11.211 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T11:49:11.211 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T11:49:11.211 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T11:49:11.211 INFO:teuthology.orchestra.run.trial077.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T11:49:11.211 INFO:teuthology.orchestra.run.trial077.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T11:49:11.211 INFO:teuthology.orchestra.run.trial077.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T11:49:11.211 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:11.212 INFO:teuthology.orchestra.run.trial077.stdout:Transaction Summary 2026-02-17T11:49:11.212 INFO:teuthology.orchestra.run.trial077.stdout:====================================================================================== 2026-02-17T11:49:11.212 INFO:teuthology.orchestra.run.trial077.stdout:Install 99 Packages 2026-02-17T11:49:11.212 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:11.213 INFO:teuthology.orchestra.run.trial077.stdout:Total download size: 95 M 2026-02-17T11:49:11.213 INFO:teuthology.orchestra.run.trial077.stdout:Installed size: 520 M 2026-02-17T11:49:11.213 INFO:teuthology.orchestra.run.trial077.stdout:Downloading Packages: 2026-02-17T11:49:11.517 INFO:teuthology.orchestra.run.trial077.stdout:(1/99): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 129 kB/s | 6.5 kB 00:00 2026-02-17T11:49:11.608 INFO:teuthology.orchestra.run.trial077.stdout:(2/99): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 7.6 MB/s | 1.1 MB 00:00 2026-02-17T11:49:11.637 INFO:teuthology.orchestra.run.trial077.stdout:(3/99): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-17T11:49:11.671 INFO:teuthology.orchestra.run.trial077.stdout:(4/99): ceph-grafana-dashboards-19.2.3-675.g3c9 929 kB/s | 31 kB 00:00 2026-02-17T11:49:11.709 INFO:teuthology.orchestra.run.trial077.stdout:(5/99): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 3.9 MB/s | 150 kB 00:00 2026-02-17T11:49:11.735 INFO:teuthology.orchestra.run.trial077.stdout:(6/99): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_6 22 MB/s | 4.7 MB 00:00 2026-02-17T11:49:11.880 INFO:teuthology.orchestra.run.trial077.stdout:(7/99): ceph-mgr-dashboard-19.2.3-675.g3c96dfb3 22 MB/s | 3.8 MB 00:00 2026-02-17T11:49:11.923 INFO:teuthology.orchestra.run.trial077.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 513 kB/s | 22 kB 00:00 2026-02-17T11:49:11.973 INFO:teuthology.orchestra.run.trial077.stdout:(9/99): ceph-mgr-modules-core-19.2.3-675.g3c96d 5.0 MB/s | 253 kB 00:00 2026-02-17T11:49:12.021 INFO:teuthology.orchestra.run.trial077.stdout:(10/99): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 1.0 MB/s | 49 kB 00:00 2026-02-17T11:49:12.042 INFO:teuthology.orchestra.run.trial077.stdout:(11/99): ceph-mgr-diskprediction-local-19.2.3-6 24 MB/s | 7.4 MB 00:00 2026-02-17T11:49:12.044 INFO:teuthology.orchestra.run.trial077.stdout:(12/99): ceph-prometheus-alerts-19.2.3-675.g3c9 705 kB/s | 17 kB 00:00 2026-02-17T11:49:12.069 INFO:teuthology.orchestra.run.trial077.stdout:(13/99): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 11 MB/s | 299 kB 00:00 2026-02-17T11:49:12.087 INFO:teuthology.orchestra.run.trial077.stdout:(14/99): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 18 MB/s | 769 kB 00:00 2026-02-17T11:49:12.150 INFO:teuthology.orchestra.run.trial077.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 639 kB/s | 40 kB 00:00 2026-02-17T11:49:12.192 INFO:teuthology.orchestra.run.trial077.stdout:(16/99): libconfig-1.7.2-9.el9.x86_64.rpm 1.7 MB/s | 72 kB 00:00 2026-02-17T11:49:12.219 INFO:teuthology.orchestra.run.trial077.stdout:(17/99): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T11:49:12.220 INFO:teuthology.orchestra.run.trial077.stdout:(18/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 2.3 MB/s | 350 kB 00:00 2026-02-17T11:49:12.245 INFO:teuthology.orchestra.run.trial077.stdout:(19/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 10 MB/s | 253 kB 00:00 2026-02-17T11:49:12.266 INFO:teuthology.orchestra.run.trial077.stdout:(20/99): libgfortran-11.5.0-14.el9.x86_64.rpm 11 MB/s | 794 kB 00:00 2026-02-17T11:49:12.304 INFO:teuthology.orchestra.run.trial077.stdout:(21/99): python3-cryptography-36.0.1-5.el9.x86_ 21 MB/s | 1.2 MB 00:00 2026-02-17T11:49:12.321 INFO:teuthology.orchestra.run.trial077.stdout:(22/99): libquadmath-11.5.0-14.el9.x86_64.rpm 1.8 MB/s | 184 kB 00:00 2026-02-17T11:49:12.329 INFO:teuthology.orchestra.run.trial077.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 5.3 MB/s | 135 kB 00:00 2026-02-17T11:49:12.344 INFO:teuthology.orchestra.run.trial077.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 6.2 MB/s | 150 kB 00:00 2026-02-17T11:49:12.375 INFO:teuthology.orchestra.run.trial077.stdout:(25/99): python3-ply-3.11-14.el9.noarch.rpm 977 kB/s | 106 kB 00:00 2026-02-17T11:49:12.379 INFO:teuthology.orchestra.run.trial077.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 2.5 MB/s | 126 kB 00:00 2026-02-17T11:49:12.380 INFO:teuthology.orchestra.run.trial077.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 6.0 MB/s | 218 kB 00:00 2026-02-17T11:49:12.415 INFO:teuthology.orchestra.run.trial077.stdout:(28/99): zip-3.0-35.el9.x86_64.rpm 7.4 MB/s | 266 kB 00:00 2026-02-17T11:49:12.427 INFO:teuthology.orchestra.run.trial077.stdout:(29/99): flexiblas-3.0.4-9.el9.x86_64.rpm 631 kB/s | 30 kB 00:00 2026-02-17T11:49:12.449 INFO:teuthology.orchestra.run.trial077.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 697 kB/s | 15 kB 00:00 2026-02-17T11:49:12.478 INFO:teuthology.orchestra.run.trial077.stdout:(31/99): unzip-6.0-59.el9.x86_64.rpm 1.7 MB/s | 182 kB 00:00 2026-02-17T11:49:12.493 INFO:teuthology.orchestra.run.trial077.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 5.5 MB/s | 246 kB 00:00 2026-02-17T11:49:12.515 INFO:teuthology.orchestra.run.trial077.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-17T11:49:12.563 INFO:teuthology.orchestra.run.trial077.stdout:(34/99): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2026-02-17T11:49:12.592 INFO:teuthology.orchestra.run.trial077.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 17 MB/s | 3.0 MB 00:00 2026-02-17T11:49:12.646 INFO:teuthology.orchestra.run.trial077.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2026-02-17T11:49:12.653 INFO:teuthology.orchestra.run.trial077.stdout:(37/99): python3-babel-2.9.1-2.el9.noarch.rpm 98 MB/s | 6.0 MB 00:00 2026-02-17T11:49:12.671 INFO:teuthology.orchestra.run.trial077.stdout:(38/99): python3-devel-3.9.25-2.el9.x86_64.rpm 9.5 MB/s | 244 kB 00:00 2026-02-17T11:49:12.683 INFO:teuthology.orchestra.run.trial077.stdout:(39/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 31 MB/s | 5.3 MB 00:00 2026-02-17T11:49:12.683 INFO:teuthology.orchestra.run.trial077.stdout:(40/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.1 MB/s | 249 kB 00:00 2026-02-17T11:49:12.696 INFO:teuthology.orchestra.run.trial077.stdout:(41/99): python3-libstoragemgmt-1.10.1-1.el9.x8 6.9 MB/s | 177 kB 00:00 2026-02-17T11:49:12.708 INFO:teuthology.orchestra.run.trial077.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 7.0 MB/s | 172 kB 00:00 2026-02-17T11:49:12.711 INFO:teuthology.orchestra.run.trial077.stdout:(43/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 44 MB/s | 1.2 MB 00:00 2026-02-17T11:49:12.719 INFO:teuthology.orchestra.run.trial077.stdout:(44/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.5 MB/s | 35 kB 00:00 2026-02-17T11:49:12.736 INFO:teuthology.orchestra.run.trial077.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 17 MB/s | 442 kB 00:00 2026-02-17T11:49:12.742 INFO:teuthology.orchestra.run.trial077.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 3.3 MB/s | 77 kB 00:00 2026-02-17T11:49:12.764 INFO:teuthology.orchestra.run.trial077.stdout:(47/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 109 MB/s | 6.1 MB 00:00 2026-02-17T11:49:12.765 INFO:teuthology.orchestra.run.trial077.stdout:(48/99): python3-protobuf-3.14.0-17.el9.noarch. 9.0 MB/s | 267 kB 00:00 2026-02-17T11:49:12.766 INFO:teuthology.orchestra.run.trial077.stdout:(49/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.4 MB/s | 159 kB 00:00 2026-02-17T11:49:12.787 INFO:teuthology.orchestra.run.trial077.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 2.3 MB/s | 54 kB 00:00 2026-02-17T11:49:12.789 INFO:teuthology.orchestra.run.trial077.stdout:(51/99): python3-pyasn1-modules-0.4.8-6.el9.noa 11 MB/s | 279 kB 00:00 2026-02-17T11:49:12.810 INFO:teuthology.orchestra.run.trial077.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-17T11:49:12.815 INFO:teuthology.orchestra.run.trial077.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.1 MB/s | 189 kB 00:00 2026-02-17T11:49:12.832 INFO:teuthology.orchestra.run.trial077.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 4.0 MB/s | 90 kB 00:00 2026-02-17T11:49:12.931 INFO:teuthology.orchestra.run.trial077.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 193 kB/s | 22 kB 00:00 2026-02-17T11:49:13.067 INFO:teuthology.orchestra.run.trial077.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 3.6 MB/s | 862 kB 00:00 2026-02-17T11:49:13.206 INFO:teuthology.orchestra.run.trial077.stdout:(57/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 44 MB/s | 19 MB 00:00 2026-02-17T11:49:13.284 INFO:teuthology.orchestra.run.trial077.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 90 kB/s | 19 kB 00:00 2026-02-17T11:49:13.419 INFO:teuthology.orchestra.run.trial077.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.1 MB/s | 551 kB 00:00 2026-02-17T11:49:13.557 INFO:teuthology.orchestra.run.trial077.stdout:(60/99): luarocks-3.9.2-5.el9.noarch.rpm 432 kB/s | 151 kB 00:00 2026-02-17T11:49:13.630 INFO:teuthology.orchestra.run.trial077.stdout:(61/99): python3-autocommand-2.2.2-8.el9.noarch 140 kB/s | 29 kB 00:00 2026-02-17T11:49:13.786 INFO:teuthology.orchestra.run.trial077.stdout:(62/99): python3-asyncssh-2.13.2-5.el9.noarch.r 1.1 MB/s | 548 kB 00:00 2026-02-17T11:49:13.835 INFO:teuthology.orchestra.run.trial077.stdout:(63/99): python3-backports-tarfile-1.2.0-1.el9. 216 kB/s | 60 kB 00:00 2026-02-17T11:49:13.848 INFO:teuthology.orchestra.run.trial077.stdout:(64/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 200 kB/s | 43 kB 00:00 2026-02-17T11:49:13.974 INFO:teuthology.orchestra.run.trial077.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 101 kB/s | 14 kB 00:00 2026-02-17T11:49:13.998 INFO:teuthology.orchestra.run.trial077.stdout:(66/99): python3-cachetools-4.2.4-1.el9.noarch. 152 kB/s | 32 kB 00:00 2026-02-17T11:49:14.209 INFO:teuthology.orchestra.run.trial077.stdout:(67/99): python3-cheroot-10.0.1-4.el9.noarch.rp 480 kB/s | 173 kB 00:00 2026-02-17T11:49:14.390 INFO:teuthology.orchestra.run.trial077.stdout:(68/99): python3-cherrypy-18.6.1-2.el9.noarch.r 862 kB/s | 358 kB 00:00 2026-02-17T11:49:14.429 INFO:teuthology.orchestra.run.trial077.stdout:(69/99): python3-google-auth-2.45.0-1.el9.noarc 589 kB/s | 254 kB 00:00 2026-02-17T11:49:14.737 INFO:teuthology.orchestra.run.trial077.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 416 kB/s | 144 kB 00:00 2026-02-17T11:49:14.776 INFO:teuthology.orchestra.run.trial077.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 401 kB/s | 139 kB 00:00 2026-02-17T11:49:14.906 INFO:teuthology.orchestra.run.trial077.stdout:(72/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.9 MB/s | 2.0 MB 00:00 2026-02-17T11:49:14.921 INFO:teuthology.orchestra.run.trial077.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 74 kB/s | 11 kB 00:00 2026-02-17T11:49:15.023 INFO:teuthology.orchestra.run.trial077.stdout:(74/99): python3-isodate-0.6.1-3.el9.noarch.rpm 196 kB/s | 56 kB 00:00 2026-02-17T11:49:15.123 INFO:teuthology.orchestra.run.trial077.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 81 kB/s | 18 kB 00:00 2026-02-17T11:49:15.138 INFO:teuthology.orchestra.run.trial077.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 107 kB/s | 23 kB 00:00 2026-02-17T11:49:15.246 INFO:teuthology.orchestra.run.trial077.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 88 kB/s | 20 kB 00:00 2026-02-17T11:49:15.335 INFO:teuthology.orchestra.run.trial077.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 92 kB/s | 19 kB 00:00 2026-02-17T11:49:15.363 INFO:teuthology.orchestra.run.trial077.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 117 kB/s | 26 kB 00:00 2026-02-17T11:49:15.625 INFO:teuthology.orchestra.run.trial077.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 160 kB/s | 46 kB 00:00 2026-02-17T11:49:15.649 INFO:teuthology.orchestra.run.trial077.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 276 kB/s | 79 kB 00:00 2026-02-17T11:49:15.801 INFO:teuthology.orchestra.run.trial077.stdout:(82/99): python3-kubernetes-26.1.0-3.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2026-02-17T11:49:15.908 INFO:teuthology.orchestra.run.trial077.stdout:(83/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 305 kB/s | 86 kB 00:00 2026-02-17T11:49:15.933 INFO:teuthology.orchestra.run.trial077.stdout:(84/99): python3-natsort-7.1.1-5.el9.noarch.rpm 203 kB/s | 58 kB 00:00 2026-02-17T11:49:16.126 INFO:teuthology.orchestra.run.trial077.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 75 kB/s | 16 kB 00:00 2026-02-17T11:49:16.222 INFO:teuthology.orchestra.run.trial077.stdout:(86/99): python3-pecan-1.4.2-3.el9.noarch.rpm 647 kB/s | 272 kB 00:00 2026-02-17T11:49:16.228 INFO:teuthology.orchestra.run.trial077.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 305 kB/s | 90 kB 00:00 2026-02-17T11:49:16.337 INFO:teuthology.orchestra.run.trial077.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 146 kB/s | 31 kB 00:00 2026-02-17T11:49:16.509 INFO:teuthology.orchestra.run.trial077.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 211 kB/s | 59 kB 00:00 2026-02-17T11:49:16.671 INFO:teuthology.orchestra.run.trial077.stdout:(90/99): python3-routes-2.5.1-5.el9.noarch.rpm 420 kB/s | 188 kB 00:00 2026-02-17T11:49:16.688 INFO:teuthology.orchestra.run.trial077.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 356 kB/s | 125 kB 00:00 2026-02-17T11:49:16.722 INFO:teuthology.orchestra.run.trial077.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 168 kB/s | 36 kB 00:00 2026-02-17T11:49:16.961 INFO:teuthology.orchestra.run.trial077.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 299 kB/s | 86 kB 00:00 2026-02-17T11:49:17.000 INFO:teuthology.orchestra.run.trial077.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 322 kB/s | 90 kB 00:00 2026-02-17T11:49:17.107 INFO:teuthology.orchestra.run.trial077.stdout:(95/99): python3-webob-1.8.8-2.el9.noarch.rpm 550 kB/s | 230 kB 00:00 2026-02-17T11:49:17.285 INFO:teuthology.orchestra.run.trial077.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 170 kB/s | 48 kB 00:00 2026-02-17T11:49:17.329 INFO:teuthology.orchestra.run.trial077.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 100 kB/s | 22 kB 00:00 2026-02-17T11:49:17.379 INFO:teuthology.orchestra.run.trial077.stdout:(98/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.0 MB/s | 427 kB 00:00 2026-02-17T11:49:17.500 INFO:teuthology.orchestra.run.trial077.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 93 kB/s | 20 kB 00:00 2026-02-17T11:49:17.504 INFO:teuthology.orchestra.run.trial077.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:17.505 INFO:teuthology.orchestra.run.trial077.stdout:Total 15 MB/s | 95 MB 00:06 2026-02-17T11:49:17.933 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction check 2026-02-17T11:49:17.971 INFO:teuthology.orchestra.run.trial077.stdout:Transaction check succeeded. 2026-02-17T11:49:17.971 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction test 2026-02-17T11:49:18.387 INFO:teuthology.orchestra.run.trial077.stdout:Transaction test succeeded. 2026-02-17T11:49:18.387 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction 2026-02-17T11:49:18.831 INFO:teuthology.orchestra.run.trial077.stdout: Preparing : 1/1 2026-02-17T11:49:18.833 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T11:49:18.864 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T11:49:18.869 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T11:49:18.890 INFO:teuthology.orchestra.run.trial077.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T11:49:18.896 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T11:49:18.929 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T11:49:18.938 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T11:49:18.944 INFO:teuthology.orchestra.run.trial077.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T11:49:18.947 INFO:teuthology.orchestra.run.trial077.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T11:49:18.951 INFO:teuthology.orchestra.run.trial077.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T11:49:18.974 INFO:teuthology.orchestra.run.trial077.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T11:49:18.987 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T11:49:18.991 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T11:49:18.996 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T11:49:18.998 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T11:49:19.009 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T11:49:19.015 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T11:49:19.039 INFO:teuthology.orchestra.run.trial077.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T11:49:19.043 INFO:teuthology.orchestra.run.trial077.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T11:49:19.050 INFO:teuthology.orchestra.run.trial077.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T11:49:19.074 INFO:teuthology.orchestra.run.trial077.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T11:49:19.125 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T11:49:19.138 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T11:49:19.140 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T11:49:19.145 INFO:teuthology.orchestra.run.trial077.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T11:49:19.150 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T11:49:19.155 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T11:49:19.158 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T11:49:19.173 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T11:49:19.194 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T11:49:19.199 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T11:49:19.204 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T11:49:19.215 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T11:49:19.224 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T11:49:19.230 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T11:49:19.250 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T11:49:19.259 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T11:49:19.314 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T11:49:19.326 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T11:49:19.341 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T11:49:19.346 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T11:49:19.354 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T11:49:19.394 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T11:49:19.720 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T11:49:19.730 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T11:49:19.734 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T11:49:19.740 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T11:49:19.742 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T11:49:19.769 INFO:teuthology.orchestra.run.trial077.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T11:49:19.813 INFO:teuthology.orchestra.run.trial077.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T11:49:19.819 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T11:49:19.823 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T11:49:19.829 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T11:49:19.832 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T11:49:19.839 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T11:49:19.842 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T11:49:19.871 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T11:49:19.880 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T11:49:19.915 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T11:49:20.141 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T11:49:20.164 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T11:49:20.168 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T11:49:20.227 INFO:teuthology.orchestra.run.trial077.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T11:49:20.229 INFO:teuthology.orchestra.run.trial077.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T11:49:20.250 INFO:teuthology.orchestra.run.trial077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T11:49:20.578 INFO:teuthology.orchestra.run.trial077.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T11:49:20.651 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T11:49:21.324 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T11:49:21.341 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T11:49:21.351 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T11:49:21.357 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T11:49:21.371 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T11:49:21.387 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T11:49:21.462 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T11:49:21.471 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T11:49:21.494 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T11:49:21.524 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T11:49:21.575 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T11:49:21.581 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T11:49:21.585 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T11:49:21.586 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T11:49:21.604 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:49:21.605 INFO:teuthology.orchestra.run.trial077.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T11:49:21.605 INFO:teuthology.orchestra.run.trial077.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T11:49:21.605 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:21.614 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:49:21.641 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:49:21.641 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T11:49:21.641 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:21.676 INFO:teuthology.orchestra.run.trial077.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T11:49:21.740 INFO:teuthology.orchestra.run.trial077.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T11:49:21.742 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:49:21.755 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:49:21.755 INFO:teuthology.orchestra.run.trial077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:49:21.756 INFO:teuthology.orchestra.run.trial077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T11:49:21.756 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:22.486 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:49:22.511 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:49:22.511 INFO:teuthology.orchestra.run.trial077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:49:22.511 INFO:teuthology.orchestra.run.trial077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T11:49:22.511 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:49:22.512 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:49:22.512 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:22.567 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:49:22.568 INFO:teuthology.orchestra.run.trial077.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:49:22.573 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 88/99 2026-02-17T11:49:22.593 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 89/99 2026-02-17T11:49:22.594 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:49:23.089 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:49:23.092 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:49:23.558 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:49:23.559 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:49:23.571 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:49:23.572 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:49:23.629 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:49:23.680 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 94/99 2026-02-17T11:49:23.681 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:49:23.703 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:49:23.704 INFO:teuthology.orchestra.run.trial077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:49:23.704 INFO:teuthology.orchestra.run.trial077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T11:49:23.704 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:49:23.704 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:49:23.704 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:23.716 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:49:23.945 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:49:23.946 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:49:23.968 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:49:23.968 INFO:teuthology.orchestra.run.trial077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:49:23.968 INFO:teuthology.orchestra.run.trial077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T11:49:23.968 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:49:23.969 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:49:23.969 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:24.076 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:49:24.097 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:49:24.097 INFO:teuthology.orchestra.run.trial077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:49:24.097 INFO:teuthology.orchestra.run.trial077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T11:49:24.097 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:49:24.097 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:49:24.097 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:24.115 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:49:24.805 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:49:24.805 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/99 2026-02-17T11:49:24.805 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/99 2026-02-17T11:49:24.805 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/99 2026-02-17T11:49:24.805 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/99 2026-02-17T11:49:24.805 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/99 2026-02-17T11:49:24.806 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/99 2026-02-17T11:49:24.806 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/99 2026-02-17T11:49:24.806 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/99 2026-02-17T11:49:24.806 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/99 2026-02-17T11:49:24.806 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/99 2026-02-17T11:49:24.806 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/99 2026-02-17T11:49:24.806 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/99 2026-02-17T11:49:24.806 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/99 2026-02-17T11:49:24.806 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/99 2026-02-17T11:49:24.806 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/99 2026-02-17T11:49:24.806 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T11:49:24.806 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T11:49:24.806 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T11:49:24.807 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T11:49:24.807 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T11:49:24.807 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T11:49:24.807 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T11:49:24.807 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T11:49:24.807 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T11:49:24.807 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T11:49:24.807 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T11:49:24.807 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T11:49:24.807 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T11:49:24.807 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T11:49:24.807 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T11:49:24.808 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T11:49:24.808 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T11:49:24.808 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T11:49:24.808 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T11:49:24.808 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T11:49:24.808 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T11:49:24.808 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T11:49:24.808 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T11:49:24.808 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T11:49:24.808 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T11:49:24.808 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T11:49:24.808 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T11:49:24.808 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T11:49:24.809 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T11:49:24.809 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T11:49:24.809 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T11:49:24.809 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T11:49:24.809 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T11:49:24.809 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T11:49:24.809 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T11:49:24.809 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T11:49:24.809 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T11:49:24.809 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T11:49:24.809 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T11:49:24.809 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T11:49:24.809 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T11:49:24.810 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T11:49:24.810 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T11:49:24.810 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T11:49:24.810 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T11:49:24.810 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T11:49:24.810 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T11:49:24.810 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T11:49:24.810 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T11:49:24.810 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T11:49:24.810 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T11:49:24.810 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T11:49:24.810 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T11:49:24.810 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T11:49:24.811 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T11:49:24.812 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T11:49:24.812 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T11:49:24.812 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T11:49:24.812 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T11:49:24.812 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T11:49:24.812 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T11:49:24.812 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T11:49:24.812 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T11:49:24.812 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T11:49:24.812 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T11:49:24.812 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T11:49:24.812 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T11:49:24.812 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T11:49:24.813 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T11:49:24.813 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T11:49:24.868 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T11:49:24.868 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:24.868 INFO:teuthology.orchestra.run.trial077.stdout:Installed: 2026-02-17T11:49:24.868 INFO:teuthology.orchestra.run.trial077.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T11:49:24.868 INFO:teuthology.orchestra.run.trial077.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:24.868 INFO:teuthology.orchestra.run.trial077.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:49:24.868 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:24.868 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:24.868 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:49:24.868 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:49:24.868 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:49:24.868 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:49:24.868 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T11:49:24.869 INFO:teuthology.orchestra.run.trial077.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:49:24.870 INFO:teuthology.orchestra.run.trial077.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T11:49:24.871 INFO:teuthology.orchestra.run.trial077.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: zip-3.0-35.el9.x86_64 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:24.872 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:24.922 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install ceph-base 2026-02-17T11:49:25.231 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:25.294 INFO:teuthology.orchestra.run.trial077.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:49:25.311 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:25.312 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:25.312 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:25.332 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install cephadm 2026-02-17T11:49:25.640 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:25.703 INFO:teuthology.orchestra.run.trial077.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:49:25.721 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:25.721 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:25.722 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:25.742 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T11:49:26.045 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:26.127 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:26.128 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:26.128 INFO:teuthology.orchestra.run.trial077.stdout: Package Arch Version Repo Size 2026-02-17T11:49:26.128 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:26.128 INFO:teuthology.orchestra.run.trial077.stdout:Installing: 2026-02-17T11:49:26.128 INFO:teuthology.orchestra.run.trial077.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T11:49:26.128 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:26.128 INFO:teuthology.orchestra.run.trial077.stdout:Transaction Summary 2026-02-17T11:49:26.128 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:26.129 INFO:teuthology.orchestra.run.trial077.stdout:Install 1 Package 2026-02-17T11:49:26.129 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:26.129 INFO:teuthology.orchestra.run.trial077.stdout:Total download size: 145 k 2026-02-17T11:49:26.129 INFO:teuthology.orchestra.run.trial077.stdout:Installed size: 431 k 2026-02-17T11:49:26.129 INFO:teuthology.orchestra.run.trial077.stdout:Downloading Packages: 2026-02-17T11:49:26.518 INFO:teuthology.orchestra.run.trial077.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 372 kB/s | 145 kB 00:00 2026-02-17T11:49:26.518 INFO:teuthology.orchestra.run.trial077.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:26.518 INFO:teuthology.orchestra.run.trial077.stdout:Total 371 kB/s | 145 kB 00:00 2026-02-17T11:49:26.518 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction check 2026-02-17T11:49:26.522 INFO:teuthology.orchestra.run.trial077.stdout:Transaction check succeeded. 2026-02-17T11:49:26.522 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction test 2026-02-17T11:49:26.553 INFO:teuthology.orchestra.run.trial077.stdout:Transaction test succeeded. 2026-02-17T11:49:26.553 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction 2026-02-17T11:49:26.608 INFO:teuthology.orchestra.run.trial077.stdout: Preparing : 1/1 2026-02-17T11:49:26.609 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:49:26.632 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:49:26.633 INFO:teuthology.orchestra.run.trial077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:49:26.633 INFO:teuthology.orchestra.run.trial077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T11:49:26.633 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:26.927 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:49:26.928 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:26.928 INFO:teuthology.orchestra.run.trial077.stdout:Installed: 2026-02-17T11:49:26.928 INFO:teuthology.orchestra.run.trial077.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:26.928 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:26.928 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:26.954 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install ceph-mgr 2026-02-17T11:49:27.264 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:27.328 INFO:teuthology.orchestra.run.trial077.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:49:27.346 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:27.346 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:27.346 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:27.367 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T11:49:27.679 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:27.744 INFO:teuthology.orchestra.run.trial077.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:49:27.761 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:27.762 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:27.762 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:27.783 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T11:49:28.091 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:28.155 INFO:teuthology.orchestra.run.trial077.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:49:28.172 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:28.172 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:28.173 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:28.193 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install ceph-mgr-rook 2026-02-17T11:49:28.505 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:28.570 INFO:teuthology.orchestra.run.trial077.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:49:28.587 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:28.588 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:28.588 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:28.608 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T11:49:28.918 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:28.981 INFO:teuthology.orchestra.run.trial077.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:49:28.999 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:28.999 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:28.999 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:29.021 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install ceph-fuse 2026-02-17T11:49:29.329 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:29.411 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:29.411 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:29.411 INFO:teuthology.orchestra.run.trial077.stdout: Package Architecture Version Repository Size 2026-02-17T11:49:29.412 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:29.412 INFO:teuthology.orchestra.run.trial077.stdout:Installing: 2026-02-17T11:49:29.412 INFO:teuthology.orchestra.run.trial077.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T11:49:29.412 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:29.412 INFO:teuthology.orchestra.run.trial077.stdout:Transaction Summary 2026-02-17T11:49:29.412 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:29.412 INFO:teuthology.orchestra.run.trial077.stdout:Install 1 Package 2026-02-17T11:49:29.412 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:29.412 INFO:teuthology.orchestra.run.trial077.stdout:Total download size: 1.2 M 2026-02-17T11:49:29.412 INFO:teuthology.orchestra.run.trial077.stdout:Installed size: 3.6 M 2026-02-17T11:49:29.412 INFO:teuthology.orchestra.run.trial077.stdout:Downloading Packages: 2026-02-17T11:49:29.801 INFO:teuthology.orchestra.run.trial077.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 3.0 MB/s | 1.2 MB 00:00 2026-02-17T11:49:29.801 INFO:teuthology.orchestra.run.trial077.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:29.801 INFO:teuthology.orchestra.run.trial077.stdout:Total 3.0 MB/s | 1.2 MB 00:00 2026-02-17T11:49:29.801 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction check 2026-02-17T11:49:29.804 INFO:teuthology.orchestra.run.trial077.stdout:Transaction check succeeded. 2026-02-17T11:49:29.805 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction test 2026-02-17T11:49:29.838 INFO:teuthology.orchestra.run.trial077.stdout:Transaction test succeeded. 2026-02-17T11:49:29.838 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction 2026-02-17T11:49:29.938 INFO:teuthology.orchestra.run.trial077.stdout: Preparing : 1/1 2026-02-17T11:49:29.955 INFO:teuthology.orchestra.run.trial077.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:30.172 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:30.228 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:30.228 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:30.228 INFO:teuthology.orchestra.run.trial077.stdout:Installed: 2026-02-17T11:49:30.229 INFO:teuthology.orchestra.run.trial077.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:30.229 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:30.229 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:30.256 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install ceph-volume 2026-02-17T11:49:30.572 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:30.636 INFO:teuthology.orchestra.run.trial077.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:49:30.654 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:30.654 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:30.654 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:30.676 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install librados-devel 2026-02-17T11:49:30.988 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:31.071 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:31.071 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:31.071 INFO:teuthology.orchestra.run.trial077.stdout: Package Arch Version Repo Size 2026-02-17T11:49:31.072 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:31.072 INFO:teuthology.orchestra.run.trial077.stdout:Installing: 2026-02-17T11:49:31.072 INFO:teuthology.orchestra.run.trial077.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T11:49:31.072 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:31.072 INFO:teuthology.orchestra.run.trial077.stdout:Transaction Summary 2026-02-17T11:49:31.072 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:31.072 INFO:teuthology.orchestra.run.trial077.stdout:Install 1 Package 2026-02-17T11:49:31.072 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:31.072 INFO:teuthology.orchestra.run.trial077.stdout:Total download size: 127 k 2026-02-17T11:49:31.072 INFO:teuthology.orchestra.run.trial077.stdout:Installed size: 456 k 2026-02-17T11:49:31.072 INFO:teuthology.orchestra.run.trial077.stdout:Downloading Packages: 2026-02-17T11:49:31.355 INFO:teuthology.orchestra.run.trial077.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 448 kB/s | 127 kB 00:00 2026-02-17T11:49:31.355 INFO:teuthology.orchestra.run.trial077.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:31.355 INFO:teuthology.orchestra.run.trial077.stdout:Total 446 kB/s | 127 kB 00:00 2026-02-17T11:49:31.355 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction check 2026-02-17T11:49:31.358 INFO:teuthology.orchestra.run.trial077.stdout:Transaction check succeeded. 2026-02-17T11:49:31.358 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction test 2026-02-17T11:49:31.389 INFO:teuthology.orchestra.run.trial077.stdout:Transaction test succeeded. 2026-02-17T11:49:31.389 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction 2026-02-17T11:49:31.444 INFO:teuthology.orchestra.run.trial077.stdout: Preparing : 1/1 2026-02-17T11:49:31.460 INFO:teuthology.orchestra.run.trial077.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:31.540 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:31.598 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:31.598 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:31.598 INFO:teuthology.orchestra.run.trial077.stdout:Installed: 2026-02-17T11:49:31.598 INFO:teuthology.orchestra.run.trial077.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:31.599 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:31.599 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:31.630 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install libcephfs2 2026-02-17T11:49:31.945 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:32.008 INFO:teuthology.orchestra.run.trial077.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:49:32.026 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:32.027 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:32.027 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:32.047 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install libcephfs-devel 2026-02-17T11:49:32.361 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:32.443 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:32.444 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:32.444 INFO:teuthology.orchestra.run.trial077.stdout: Package Arch Version Repo Size 2026-02-17T11:49:32.444 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:32.445 INFO:teuthology.orchestra.run.trial077.stdout:Installing: 2026-02-17T11:49:32.445 INFO:teuthology.orchestra.run.trial077.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T11:49:32.445 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:32.445 INFO:teuthology.orchestra.run.trial077.stdout:Transaction Summary 2026-02-17T11:49:32.445 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:32.445 INFO:teuthology.orchestra.run.trial077.stdout:Install 1 Package 2026-02-17T11:49:32.445 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:32.445 INFO:teuthology.orchestra.run.trial077.stdout:Total download size: 34 k 2026-02-17T11:49:32.445 INFO:teuthology.orchestra.run.trial077.stdout:Installed size: 153 k 2026-02-17T11:49:32.445 INFO:teuthology.orchestra.run.trial077.stdout:Downloading Packages: 2026-02-17T11:49:32.665 INFO:teuthology.orchestra.run.trial077.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 152 kB/s | 34 kB 00:00 2026-02-17T11:49:32.666 INFO:teuthology.orchestra.run.trial077.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:32.666 INFO:teuthology.orchestra.run.trial077.stdout:Total 151 kB/s | 34 kB 00:00 2026-02-17T11:49:32.666 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction check 2026-02-17T11:49:32.669 INFO:teuthology.orchestra.run.trial077.stdout:Transaction check succeeded. 2026-02-17T11:49:32.669 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction test 2026-02-17T11:49:32.671 INFO:teuthology.orchestra.run.trial077.stdout:Transaction test succeeded. 2026-02-17T11:49:32.671 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction 2026-02-17T11:49:32.694 INFO:teuthology.orchestra.run.trial077.stdout: Preparing : 1/1 2026-02-17T11:49:32.710 INFO:teuthology.orchestra.run.trial077.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:32.765 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:32.822 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:32.823 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:32.823 INFO:teuthology.orchestra.run.trial077.stdout:Installed: 2026-02-17T11:49:32.823 INFO:teuthology.orchestra.run.trial077.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:32.823 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:32.823 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:32.849 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install librados2 2026-02-17T11:49:33.158 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:33.223 INFO:teuthology.orchestra.run.trial077.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:49:33.240 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:33.241 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:33.241 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:33.262 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install librbd1 2026-02-17T11:49:33.576 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:33.640 INFO:teuthology.orchestra.run.trial077.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:49:33.657 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:33.658 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:33.658 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:33.679 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install python3-rados 2026-02-17T11:49:33.985 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:34.049 INFO:teuthology.orchestra.run.trial077.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:49:34.066 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:34.067 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:34.067 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:34.088 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install python3-rgw 2026-02-17T11:49:34.398 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:34.462 INFO:teuthology.orchestra.run.trial077.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:49:34.479 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:34.480 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:34.480 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:34.501 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install python3-cephfs 2026-02-17T11:49:34.813 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:34.878 INFO:teuthology.orchestra.run.trial077.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:49:34.895 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:34.896 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:34.896 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:34.917 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install python3-rbd 2026-02-17T11:49:35.228 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:35.291 INFO:teuthology.orchestra.run.trial077.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:49:35.309 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:35.310 INFO:teuthology.orchestra.run.trial077.stdout:Nothing to do. 2026-02-17T11:49:35.310 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:35.331 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install rbd-fuse 2026-02-17T11:49:35.639 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:35.721 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:35.722 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:35.722 INFO:teuthology.orchestra.run.trial077.stdout: Package Architecture Version Repository Size 2026-02-17T11:49:35.722 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:35.722 INFO:teuthology.orchestra.run.trial077.stdout:Installing: 2026-02-17T11:49:35.723 INFO:teuthology.orchestra.run.trial077.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T11:49:35.723 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:35.723 INFO:teuthology.orchestra.run.trial077.stdout:Transaction Summary 2026-02-17T11:49:35.723 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:35.723 INFO:teuthology.orchestra.run.trial077.stdout:Install 1 Package 2026-02-17T11:49:35.723 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:35.723 INFO:teuthology.orchestra.run.trial077.stdout:Total download size: 85 k 2026-02-17T11:49:35.723 INFO:teuthology.orchestra.run.trial077.stdout:Installed size: 227 k 2026-02-17T11:49:35.723 INFO:teuthology.orchestra.run.trial077.stdout:Downloading Packages: 2026-02-17T11:49:35.961 INFO:teuthology.orchestra.run.trial077.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 358 kB/s | 85 kB 00:00 2026-02-17T11:49:35.963 INFO:teuthology.orchestra.run.trial077.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:35.963 INFO:teuthology.orchestra.run.trial077.stdout:Total 354 kB/s | 85 kB 00:00 2026-02-17T11:49:35.963 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction check 2026-02-17T11:49:35.967 INFO:teuthology.orchestra.run.trial077.stdout:Transaction check succeeded. 2026-02-17T11:49:35.967 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction test 2026-02-17T11:49:35.997 INFO:teuthology.orchestra.run.trial077.stdout:Transaction test succeeded. 2026-02-17T11:49:35.997 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction 2026-02-17T11:49:36.049 INFO:teuthology.orchestra.run.trial077.stdout: Preparing : 1/1 2026-02-17T11:49:36.066 INFO:teuthology.orchestra.run.trial077.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:36.145 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:36.201 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:36.201 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:36.202 INFO:teuthology.orchestra.run.trial077.stdout:Installed: 2026-02-17T11:49:36.202 INFO:teuthology.orchestra.run.trial077.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:36.202 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:36.202 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:36.230 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install rbd-mirror 2026-02-17T11:49:36.543 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:36.624 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:36.625 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:36.625 INFO:teuthology.orchestra.run.trial077.stdout: Package Arch Version Repo Size 2026-02-17T11:49:36.625 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:36.625 INFO:teuthology.orchestra.run.trial077.stdout:Installing: 2026-02-17T11:49:36.625 INFO:teuthology.orchestra.run.trial077.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T11:49:36.626 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:36.626 INFO:teuthology.orchestra.run.trial077.stdout:Transaction Summary 2026-02-17T11:49:36.626 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:36.626 INFO:teuthology.orchestra.run.trial077.stdout:Install 1 Package 2026-02-17T11:49:36.626 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:36.626 INFO:teuthology.orchestra.run.trial077.stdout:Total download size: 3.1 M 2026-02-17T11:49:36.626 INFO:teuthology.orchestra.run.trial077.stdout:Installed size: 13 M 2026-02-17T11:49:36.626 INFO:teuthology.orchestra.run.trial077.stdout:Downloading Packages: 2026-02-17T11:49:37.280 INFO:teuthology.orchestra.run.trial077.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 4.8 MB/s | 3.1 MB 00:00 2026-02-17T11:49:37.281 INFO:teuthology.orchestra.run.trial077.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:37.281 INFO:teuthology.orchestra.run.trial077.stdout:Total 4.8 MB/s | 3.1 MB 00:00 2026-02-17T11:49:37.281 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction check 2026-02-17T11:49:37.285 INFO:teuthology.orchestra.run.trial077.stdout:Transaction check succeeded. 2026-02-17T11:49:37.285 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction test 2026-02-17T11:49:37.324 INFO:teuthology.orchestra.run.trial077.stdout:Transaction test succeeded. 2026-02-17T11:49:37.324 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction 2026-02-17T11:49:37.519 INFO:teuthology.orchestra.run.trial077.stdout: Preparing : 1/1 2026-02-17T11:49:37.521 INFO:teuthology.orchestra.run.trial077.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:37.544 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:37.544 INFO:teuthology.orchestra.run.trial077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:49:37.544 INFO:teuthology.orchestra.run.trial077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T11:49:37.544 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:49:37.544 INFO:teuthology.orchestra.run.trial077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:49:37.544 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:37.826 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:37.827 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:37.827 INFO:teuthology.orchestra.run.trial077.stdout:Installed: 2026-02-17T11:49:37.827 INFO:teuthology.orchestra.run.trial077.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:37.827 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:37.827 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:37.853 DEBUG:teuthology.orchestra.run.trial077:> sudo yum -y install rbd-nbd 2026-02-17T11:49:38.167 INFO:teuthology.orchestra.run.trial077.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 11:48:53 AM UTC. 2026-02-17T11:49:38.250 INFO:teuthology.orchestra.run.trial077.stdout:Dependencies resolved. 2026-02-17T11:49:38.251 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:38.251 INFO:teuthology.orchestra.run.trial077.stdout: Package Architecture Version Repository Size 2026-02-17T11:49:38.251 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:38.251 INFO:teuthology.orchestra.run.trial077.stdout:Installing: 2026-02-17T11:49:38.251 INFO:teuthology.orchestra.run.trial077.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T11:49:38.251 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:38.251 INFO:teuthology.orchestra.run.trial077.stdout:Transaction Summary 2026-02-17T11:49:38.251 INFO:teuthology.orchestra.run.trial077.stdout:================================================================================ 2026-02-17T11:49:38.252 INFO:teuthology.orchestra.run.trial077.stdout:Install 1 Package 2026-02-17T11:49:38.252 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:38.252 INFO:teuthology.orchestra.run.trial077.stdout:Total download size: 171 k 2026-02-17T11:49:38.252 INFO:teuthology.orchestra.run.trial077.stdout:Installed size: 490 k 2026-02-17T11:49:38.252 INFO:teuthology.orchestra.run.trial077.stdout:Downloading Packages: 2026-02-17T11:49:38.372 INFO:teuthology.orchestra.run.trial077.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2026-02-17T11:49:38.372 INFO:teuthology.orchestra.run.trial077.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:49:38.372 INFO:teuthology.orchestra.run.trial077.stdout:Total 1.4 MB/s | 171 kB 00:00 2026-02-17T11:49:38.372 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction check 2026-02-17T11:49:38.376 INFO:teuthology.orchestra.run.trial077.stdout:Transaction check succeeded. 2026-02-17T11:49:38.376 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction test 2026-02-17T11:49:38.407 INFO:teuthology.orchestra.run.trial077.stdout:Transaction test succeeded. 2026-02-17T11:49:38.407 INFO:teuthology.orchestra.run.trial077.stdout:Running transaction 2026-02-17T11:49:38.462 INFO:teuthology.orchestra.run.trial077.stdout: Preparing : 1/1 2026-02-17T11:49:38.478 INFO:teuthology.orchestra.run.trial077.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:38.558 INFO:teuthology.orchestra.run.trial077.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:38.616 INFO:teuthology.orchestra.run.trial077.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:49:38.616 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:38.616 INFO:teuthology.orchestra.run.trial077.stdout:Installed: 2026-02-17T11:49:38.616 INFO:teuthology.orchestra.run.trial077.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:49:38.616 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:38.617 INFO:teuthology.orchestra.run.trial077.stdout:Complete! 2026-02-17T11:49:38.648 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:38.648 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:49:38.824 DEBUG:teuthology.orchestra.run.trial077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T11:49:38.845 INFO:teuthology.orchestra.run.trial077.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T11:49:38.845 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T11:49:38.845 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T11:49:38.848 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T11:49:38.849 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:38.849 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:49:38.911 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T11:49:38.911 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:38.911 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:49:38.975 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:49:39.038 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T11:49:39.038 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:39.038 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:49:39.103 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:49:39.167 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T11:49:39.167 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:39.167 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:49:39.231 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:49:39.296 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T11:49:39.410 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T11:49:39.410 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod 777 /var/log/ceph 2026-02-17T11:49:39.435 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T11:49:39.435 DEBUG:teuthology.orchestra.run.trial077:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:49:39.498 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T11:49:39.498 DEBUG:teuthology.orchestra.run.trial077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:49:39.574 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T11:49:39.575 INFO:tasks.ceph:config {'conf': {'global': {'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300, 'osd pool default size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon max pg per osd': 1, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max pg per osd hard ratio': 1, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(TOO_FEW_PGS\\)', '\\(PG_', '\\(PENDING_CREATING_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T11:49:39.575 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51347', 'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'description': 'rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51347', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid'}, 'ceph': {'conf': {'global': {'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300, 'osd pool default size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon max pg per osd': 1, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max pg per osd hard ratio': 1, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'create_rbd_pool': False, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(TOO_FEW_PGS\\)', '\\(PG_', '\\(PENDING_CREATING_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 4581, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'targets': {'trial077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOm5PUSMTqSDpDWgQWUuknh/j8ZBK6IWudUUU8WCQVXUnhbaApToFOVSXuX4Djnvf8End4+jKE3sNP+KYxAzCE0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'osd_max_pg_per_osd': {'from_primary': False, 'pg_num': 1, 'pool_size': 2, 'test_create_from_mon': False}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:10:36', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T11:49:39.575 DEBUG:teuthology.orchestra.run.trial077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:49:39.619 DEBUG:teuthology.orchestra.run.trial077:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:49:39.686 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:39.686 DEBUG:teuthology.orchestra.run.trial077:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:49:39.742 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:49:39.742 DEBUG:teuthology.orchestra.run.trial077:> stat /dev/vg_nvme/lv_1 2026-02-17T11:49:39.798 INFO:teuthology.orchestra.run.trial077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:49:39.798 INFO:teuthology.orchestra.run.trial077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:49:39.798 INFO:teuthology.orchestra.run.trial077.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-17T11:49:39.798 INFO:teuthology.orchestra.run.trial077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:49:39.798 INFO:teuthology.orchestra.run.trial077.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:49:39.798 INFO:teuthology.orchestra.run.trial077.stdout:Access: 2026-02-17 11:49:37.679537715 +0000 2026-02-17T11:49:39.798 INFO:teuthology.orchestra.run.trial077.stdout:Modify: 2026-02-17 11:48:58.053250012 +0000 2026-02-17T11:49:39.798 INFO:teuthology.orchestra.run.trial077.stdout:Change: 2026-02-17 11:48:58.053250012 +0000 2026-02-17T11:49:39.798 INFO:teuthology.orchestra.run.trial077.stdout: Birth: 2026-02-17 11:48:58.053250012 +0000 2026-02-17T11:49:39.798 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:49:39.863 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records in 2026-02-17T11:49:39.863 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records out 2026-02-17T11:49:39.863 INFO:teuthology.orchestra.run.trial077.stderr:512 bytes copied, 0.000157475 s, 3.3 MB/s 2026-02-17T11:49:39.865 DEBUG:teuthology.orchestra.run.trial077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:49:39.932 DEBUG:teuthology.orchestra.run.trial077:> stat /dev/vg_nvme/lv_2 2026-02-17T11:49:40.012 INFO:teuthology.orchestra.run.trial077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:49:40.012 INFO:teuthology.orchestra.run.trial077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:49:40.012 INFO:teuthology.orchestra.run.trial077.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-17T11:49:40.012 INFO:teuthology.orchestra.run.trial077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:49:40.012 INFO:teuthology.orchestra.run.trial077.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:49:40.012 INFO:teuthology.orchestra.run.trial077.stdout:Access: 2026-02-17 11:49:37.679537715 +0000 2026-02-17T11:49:40.012 INFO:teuthology.orchestra.run.trial077.stdout:Modify: 2026-02-17 11:48:58.053250012 +0000 2026-02-17T11:49:40.012 INFO:teuthology.orchestra.run.trial077.stdout:Change: 2026-02-17 11:48:58.053250012 +0000 2026-02-17T11:49:40.012 INFO:teuthology.orchestra.run.trial077.stdout: Birth: 2026-02-17 11:48:58.053250012 +0000 2026-02-17T11:49:40.012 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:49:40.083 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records in 2026-02-17T11:49:40.083 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records out 2026-02-17T11:49:40.084 INFO:teuthology.orchestra.run.trial077.stderr:512 bytes copied, 0.000146354 s, 3.5 MB/s 2026-02-17T11:49:40.085 DEBUG:teuthology.orchestra.run.trial077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:49:40.142 DEBUG:teuthology.orchestra.run.trial077:> stat /dev/vg_nvme/lv_3 2026-02-17T11:49:40.198 INFO:teuthology.orchestra.run.trial077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:49:40.199 INFO:teuthology.orchestra.run.trial077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:49:40.199 INFO:teuthology.orchestra.run.trial077.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-17T11:49:40.199 INFO:teuthology.orchestra.run.trial077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:49:40.199 INFO:teuthology.orchestra.run.trial077.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:49:40.199 INFO:teuthology.orchestra.run.trial077.stdout:Access: 2026-02-17 11:49:37.679537715 +0000 2026-02-17T11:49:40.199 INFO:teuthology.orchestra.run.trial077.stdout:Modify: 2026-02-17 11:48:58.053250012 +0000 2026-02-17T11:49:40.199 INFO:teuthology.orchestra.run.trial077.stdout:Change: 2026-02-17 11:48:58.053250012 +0000 2026-02-17T11:49:40.199 INFO:teuthology.orchestra.run.trial077.stdout: Birth: 2026-02-17 11:48:58.053250012 +0000 2026-02-17T11:49:40.200 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:49:40.262 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records in 2026-02-17T11:49:40.263 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records out 2026-02-17T11:49:40.263 INFO:teuthology.orchestra.run.trial077.stderr:512 bytes copied, 0.000244108 s, 2.1 MB/s 2026-02-17T11:49:40.264 DEBUG:teuthology.orchestra.run.trial077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:49:40.323 DEBUG:teuthology.orchestra.run.trial077:> stat /dev/vg_nvme/lv_4 2026-02-17T11:49:40.379 INFO:teuthology.orchestra.run.trial077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:49:40.379 INFO:teuthology.orchestra.run.trial077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:49:40.379 INFO:teuthology.orchestra.run.trial077.stdout:Device: 6h/6d Inode: 1313 Links: 1 2026-02-17T11:49:40.379 INFO:teuthology.orchestra.run.trial077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:49:40.379 INFO:teuthology.orchestra.run.trial077.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:49:40.380 INFO:teuthology.orchestra.run.trial077.stdout:Access: 2026-02-17 11:49:37.680537696 +0000 2026-02-17T11:49:40.380 INFO:teuthology.orchestra.run.trial077.stdout:Modify: 2026-02-17 11:48:58.054249994 +0000 2026-02-17T11:49:40.380 INFO:teuthology.orchestra.run.trial077.stdout:Change: 2026-02-17 11:48:58.054249994 +0000 2026-02-17T11:49:40.380 INFO:teuthology.orchestra.run.trial077.stdout: Birth: 2026-02-17 11:48:58.054249994 +0000 2026-02-17T11:49:40.380 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:49:40.444 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records in 2026-02-17T11:49:40.444 INFO:teuthology.orchestra.run.trial077.stderr:1+0 records out 2026-02-17T11:49:40.444 INFO:teuthology.orchestra.run.trial077.stderr:512 bytes copied, 0.000211887 s, 2.4 MB/s 2026-02-17T11:49:40.445 DEBUG:teuthology.orchestra.run.trial077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:49:40.502 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T11:49:40.502 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-17T11:49:40.502 INFO:tasks.ceph:Generating config... 2026-02-17T11:49:40.505 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-17T11:49:40.505 INFO:tasks.ceph:[global] ms bind msgr1 = False 2026-02-17T11:49:40.505 INFO:tasks.ceph:[global] ms bind msgr2 = True 2026-02-17T11:49:40.505 INFO:tasks.ceph:[global] ms type = async 2026-02-17T11:49:40.506 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T11:49:40.506 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T11:49:40.506 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T11:49:40.506 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T11:49:40.506 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T11:49:40.506 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T11:49:40.506 INFO:tasks.ceph:[mon] osd pool default size = 2 2026-02-17T11:49:40.506 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T11:49:40.506 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2026-02-17T11:49:40.506 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-17T11:49:40.506 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T11:49:40.507 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T11:49:40.507 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-17T11:49:40.507 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-17T11:49:40.507 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T11:49:40.507 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T11:49:40.507 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T11:49:40.507 INFO:tasks.ceph:[osd] mon max pg per osd = 1 2026-02-17T11:49:40.507 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T11:49:40.507 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T11:49:40.507 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T11:49:40.507 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T11:49:40.507 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T11:49:40.507 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T11:49:40.508 INFO:tasks.ceph:[osd] osd max pg per osd hard ratio = 1 2026-02-17T11:49:40.508 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T11:49:40.508 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T11:49:40.508 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T11:49:40.508 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T11:49:40.508 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T11:49:40.508 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T11:49:40.508 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T11:49:40.575 INFO:teuthology.orchestra.run.trial077.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T11:49:40.578 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T11:49:40.654 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:49:40.719 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.77')] 2026-02-17T11:49:40.720 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.77', 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon max pg per osd': 1, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max pg per osd hard ratio': 1, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300, 'osd pool default size': 2}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-17T11:49:40.721 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:40.721 DEBUG:teuthology.orchestra.run.trial077:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:49:40.776 DEBUG:teuthology.orchestra.run.trial077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.77 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:49:40.846 INFO:teuthology.orchestra.run.trial077.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:49:40.847 INFO:teuthology.orchestra.run.trial077.stdout:monmaptool: generated fsid 4d96ab44-13c8-4fda-b382-9a8084746268 2026-02-17T11:49:40.847 INFO:teuthology.orchestra.run.trial077.stdout:setting min_mon_release = quincy 2026-02-17T11:49:40.847 INFO:teuthology.orchestra.run.trial077.stdout:epoch 0 2026-02-17T11:49:40.847 INFO:teuthology.orchestra.run.trial077.stdout:fsid 4d96ab44-13c8-4fda-b382-9a8084746268 2026-02-17T11:49:40.847 INFO:teuthology.orchestra.run.trial077.stdout:last_changed 2026-02-17T11:49:40.846701+0000 2026-02-17T11:49:40.847 INFO:teuthology.orchestra.run.trial077.stdout:created 2026-02-17T11:49:40.846701+0000 2026-02-17T11:49:40.847 INFO:teuthology.orchestra.run.trial077.stdout:min_mon_release 17 (quincy) 2026-02-17T11:49:40.847 INFO:teuthology.orchestra.run.trial077.stdout:election_strategy: 3 2026-02-17T11:49:40.847 INFO:teuthology.orchestra.run.trial077.stdout:0: [v2:10.20.193.77:3300/0,v1:10.20.193.77:6789/0] mon.a 2026-02-17T11:49:40.847 INFO:teuthology.orchestra.run.trial077.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-17T11:49:40.849 DEBUG:teuthology.orchestra.run.trial077:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:49:40.906 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4d96ab44-13c8-4fda-b382-9a8084746268... 2026-02-17T11:49:40.907 DEBUG:teuthology.orchestra.run.trial077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:49:40.987 INFO:teuthology.orchestra.run.trial077.stdout:[global] 2026-02-17T11:49:40.987 INFO:teuthology.orchestra.run.trial077.stdout: chdir = "" 2026-02-17T11:49:40.988 INFO:teuthology.orchestra.run.trial077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:49:40.988 INFO:teuthology.orchestra.run.trial077.stdout: auth supported = cephx 2026-02-17T11:49:40.988 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.988 INFO:teuthology.orchestra.run.trial077.stdout: filestore xattr use omap = true 2026-02-17T11:49:40.988 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.988 INFO:teuthology.orchestra.run.trial077.stdout: mon clock drift allowed = 1.000 2026-02-17T11:49:40.988 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.988 INFO:teuthology.orchestra.run.trial077.stdout: osd crush chooseleaf type = 0 2026-02-17T11:49:40.988 INFO:teuthology.orchestra.run.trial077.stdout: auth debug = true 2026-02-17T11:49:40.988 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.989 INFO:teuthology.orchestra.run.trial077.stdout: ms die on old message = true 2026-02-17T11:49:40.989 INFO:teuthology.orchestra.run.trial077.stdout: ms die on bug = true 2026-02-17T11:49:40.989 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.989 INFO:teuthology.orchestra.run.trial077.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:49:40.989 INFO:teuthology.orchestra.run.trial077.stdout: mon pg warn max object skew = 0 2026-02-17T11:49:40.989 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.989 INFO:teuthology.orchestra.run.trial077.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:49:40.989 INFO:teuthology.orchestra.run.trial077.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:49:40.989 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.989 INFO:teuthology.orchestra.run.trial077.stdout: osd pool default size = 2 2026-02-17T11:49:40.989 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.989 INFO:teuthology.orchestra.run.trial077.stdout: mon osd allow primary affinity = true 2026-02-17T11:49:40.990 INFO:teuthology.orchestra.run.trial077.stdout: mon osd allow pg remap = true 2026-02-17T11:49:40.990 INFO:teuthology.orchestra.run.trial077.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:49:40.990 INFO:teuthology.orchestra.run.trial077.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:49:40.990 INFO:teuthology.orchestra.run.trial077.stdout: mon warn on no sortbitwise = false 2026-02-17T11:49:40.990 INFO:teuthology.orchestra.run.trial077.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:49:40.990 INFO:teuthology.orchestra.run.trial077.stdout: mon warn on too few osds = false 2026-02-17T11:49:40.990 INFO:teuthology.orchestra.run.trial077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:49:40.990 INFO:teuthology.orchestra.run.trial077.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:49:40.990 INFO:teuthology.orchestra.run.trial077.stdout: mon_allow_pool_size_one = true 2026-02-17T11:49:40.990 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.990 INFO:teuthology.orchestra.run.trial077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:49:40.990 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.991 INFO:teuthology.orchestra.run.trial077.stdout: osd default data pool replay window = 5 2026-02-17T11:49:40.991 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.991 INFO:teuthology.orchestra.run.trial077.stdout: mon allow pool delete = true 2026-02-17T11:49:40.991 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.991 INFO:teuthology.orchestra.run.trial077.stdout: mon cluster log file level = debug 2026-02-17T11:49:40.991 INFO:teuthology.orchestra.run.trial077.stdout: debug asserts on shutdown = true 2026-02-17T11:49:40.991 INFO:teuthology.orchestra.run.trial077.stdout: mon health detail to clog = false 2026-02-17T11:49:40.991 INFO:teuthology.orchestra.run.trial077.stdout: mon host = 10.20.193.77 2026-02-17T11:49:40.991 INFO:teuthology.orchestra.run.trial077.stdout: mon election default strategy = 3 2026-02-17T11:49:40.991 INFO:teuthology.orchestra.run.trial077.stdout: ms bind msgr1 = False 2026-02-17T11:49:40.991 INFO:teuthology.orchestra.run.trial077.stdout: ms bind msgr2 = True 2026-02-17T11:49:40.991 INFO:teuthology.orchestra.run.trial077.stdout: ms type = async 2026-02-17T11:49:40.992 INFO:teuthology.orchestra.run.trial077.stdout: fsid = 4d96ab44-13c8-4fda-b382-9a8084746268 2026-02-17T11:49:40.992 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.992 INFO:teuthology.orchestra.run.trial077.stdout:[osd] 2026-02-17T11:49:40.992 INFO:teuthology.orchestra.run.trial077.stdout: osd journal size = 100 2026-02-17T11:49:40.992 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.992 INFO:teuthology.orchestra.run.trial077.stdout: osd scrub load threshold = 5.0 2026-02-17T11:49:40.992 INFO:teuthology.orchestra.run.trial077.stdout: osd scrub max interval = 600 2026-02-17T11:49:40.992 INFO:teuthology.orchestra.run.trial077.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:49:40.992 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.992 INFO:teuthology.orchestra.run.trial077.stdout: osd recover clone overlap = true 2026-02-17T11:49:40.992 INFO:teuthology.orchestra.run.trial077.stdout: osd recovery max chunk = 1048576 2026-02-17T11:49:40.992 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.993 INFO:teuthology.orchestra.run.trial077.stdout: osd debug shutdown = true 2026-02-17T11:49:40.993 INFO:teuthology.orchestra.run.trial077.stdout: osd debug op order = true 2026-02-17T11:49:40.993 INFO:teuthology.orchestra.run.trial077.stdout: osd debug verify stray on activate = true 2026-02-17T11:49:40.993 INFO:teuthology.orchestra.run.trial077.stdout: osd debug trim objects = true 2026-02-17T11:49:40.993 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.993 INFO:teuthology.orchestra.run.trial077.stdout: osd open classes on start = true 2026-02-17T11:49:40.993 INFO:teuthology.orchestra.run.trial077.stdout: osd debug pg log writeout = true 2026-02-17T11:49:40.993 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.993 INFO:teuthology.orchestra.run.trial077.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:49:40.993 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.993 INFO:teuthology.orchestra.run.trial077.stdout: osd map max advance = 10 2026-02-17T11:49:40.993 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.994 INFO:teuthology.orchestra.run.trial077.stdout: journal zero on create = true 2026-02-17T11:49:40.994 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.994 INFO:teuthology.orchestra.run.trial077.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:49:40.994 INFO:teuthology.orchestra.run.trial077.stdout: filestore apply finisher threads = 3 2026-02-17T11:49:40.994 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.994 INFO:teuthology.orchestra.run.trial077.stdout: bdev debug aio = true 2026-02-17T11:49:40.994 INFO:teuthology.orchestra.run.trial077.stdout: osd debug misdirected ops = true 2026-02-17T11:49:40.994 INFO:teuthology.orchestra.run.trial077.stdout: bluestore block size = 96636764160 2026-02-17T11:49:40.994 INFO:teuthology.orchestra.run.trial077.stdout: bluestore compression algorithm = zstd 2026-02-17T11:49:40.994 INFO:teuthology.orchestra.run.trial077.stdout: bluestore compression mode = aggressive 2026-02-17T11:49:40.994 INFO:teuthology.orchestra.run.trial077.stdout: bluestore fsck on mount = True 2026-02-17T11:49:40.994 INFO:teuthology.orchestra.run.trial077.stdout: bluestore zero block detection = True 2026-02-17T11:49:40.995 INFO:teuthology.orchestra.run.trial077.stdout: debug bluefs = 20 2026-02-17T11:49:40.995 INFO:teuthology.orchestra.run.trial077.stdout: debug bluestore = 20 2026-02-17T11:49:40.995 INFO:teuthology.orchestra.run.trial077.stdout: debug ms = 1 2026-02-17T11:49:40.995 INFO:teuthology.orchestra.run.trial077.stdout: debug osd = 20 2026-02-17T11:49:40.995 INFO:teuthology.orchestra.run.trial077.stdout: debug rocksdb = 10 2026-02-17T11:49:40.995 INFO:teuthology.orchestra.run.trial077.stdout: mon max pg per osd = 1 2026-02-17T11:49:40.995 INFO:teuthology.orchestra.run.trial077.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T11:49:40.995 INFO:teuthology.orchestra.run.trial077.stdout: mon osd full ratio = 0.9 2026-02-17T11:49:40.995 INFO:teuthology.orchestra.run.trial077.stdout: mon osd nearfull ratio = 0.8 2026-02-17T11:49:40.995 INFO:teuthology.orchestra.run.trial077.stdout: osd debug verify cached snaps = True 2026-02-17T11:49:40.995 INFO:teuthology.orchestra.run.trial077.stdout: osd debug verify missing on start = True 2026-02-17T11:49:40.995 INFO:teuthology.orchestra.run.trial077.stdout: osd failsafe full ratio = 0.95 2026-02-17T11:49:40.995 INFO:teuthology.orchestra.run.trial077.stdout: osd max pg per osd hard ratio = 1 2026-02-17T11:49:40.996 INFO:teuthology.orchestra.run.trial077.stdout: osd mclock override recovery settings = True 2026-02-17T11:49:40.996 INFO:teuthology.orchestra.run.trial077.stdout: osd objectstore = bluestore 2026-02-17T11:49:40.996 INFO:teuthology.orchestra.run.trial077.stdout: osd op queue = debug_random 2026-02-17T11:49:40.996 INFO:teuthology.orchestra.run.trial077.stdout: osd op queue cut off = debug_random 2026-02-17T11:49:40.996 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.996 INFO:teuthology.orchestra.run.trial077.stdout:[mgr] 2026-02-17T11:49:40.996 INFO:teuthology.orchestra.run.trial077.stdout: debug ms = 1 2026-02-17T11:49:40.996 INFO:teuthology.orchestra.run.trial077.stdout: debug mgr = 20 2026-02-17T11:49:40.996 INFO:teuthology.orchestra.run.trial077.stdout: debug mon = 20 2026-02-17T11:49:40.996 INFO:teuthology.orchestra.run.trial077.stdout: debug auth = 20 2026-02-17T11:49:40.996 INFO:teuthology.orchestra.run.trial077.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:49:40.996 INFO:teuthology.orchestra.run.trial077.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:49:40.996 INFO:teuthology.orchestra.run.trial077.stdout: mgr/telemetry/nag = false 2026-02-17T11:49:40.997 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.997 INFO:teuthology.orchestra.run.trial077.stdout:[mon] 2026-02-17T11:49:40.997 INFO:teuthology.orchestra.run.trial077.stdout: debug ms = 1 2026-02-17T11:49:40.997 INFO:teuthology.orchestra.run.trial077.stdout: debug mon = 20 2026-02-17T11:49:40.997 INFO:teuthology.orchestra.run.trial077.stdout: debug paxos = 20 2026-02-17T11:49:40.997 INFO:teuthology.orchestra.run.trial077.stdout: debug auth = 20 2026-02-17T11:49:40.997 INFO:teuthology.orchestra.run.trial077.stdout: mon data avail warn = 5 2026-02-17T11:49:40.997 INFO:teuthology.orchestra.run.trial077.stdout: mon mgr mkfs grace = 240 2026-02-17T11:49:40.997 INFO:teuthology.orchestra.run.trial077.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:49:40.997 INFO:teuthology.orchestra.run.trial077.stdout: mon osd reporter subtree level = osd 2026-02-17T11:49:40.997 INFO:teuthology.orchestra.run.trial077.stdout: mon osd prime pg temp = true 2026-02-17T11:49:40.997 INFO:teuthology.orchestra.run.trial077.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:49:40.998 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.998 INFO:teuthology.orchestra.run.trial077.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:49:40.998 INFO:teuthology.orchestra.run.trial077.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:49:40.998 INFO:teuthology.orchestra.run.trial077.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:49:40.998 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.998 INFO:teuthology.orchestra.run.trial077.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:49:40.998 INFO:teuthology.orchestra.run.trial077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:49:40.998 INFO:teuthology.orchestra.run.trial077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:49:40.998 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.998 INFO:teuthology.orchestra.run.trial077.stdout: # 1m isn't quite enough 2026-02-17T11:49:40.998 INFO:teuthology.orchestra.run.trial077.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:49:40.998 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.998 INFO:teuthology.orchestra.run.trial077.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:49:40.999 INFO:teuthology.orchestra.run.trial077.stdout: mon scrub interval = 300 2026-02-17T11:49:40.999 INFO:teuthology.orchestra.run.trial077.stdout: osd pool default size = 2 2026-02-17T11:49:40.999 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:49:40.999 INFO:teuthology.orchestra.run.trial077.stdout:[client] 2026-02-17T11:49:40.999 INFO:teuthology.orchestra.run.trial077.stdout: rgw cache enabled = true 2026-02-17T11:49:40.999 INFO:teuthology.orchestra.run.trial077.stdout: rgw enable ops log = true 2026-02-17T11:49:40.999 INFO:teuthology.orchestra.run.trial077.stdout: rgw enable usage log = true 2026-02-17T11:49:40.999 INFO:teuthology.orchestra.run.trial077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:49:40.999 INFO:teuthology.orchestra.run.trial077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:49:40.999 INFO:teuthology.orchestra.run.trial077.stdout:[mon.a] 2026-02-17T11:49:41.000 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T11:49:41.001 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T11:49:41.084 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T11:49:41.085 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:41.085 DEBUG:teuthology.orchestra.run.trial077:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T11:49:41.141 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:41.141 DEBUG:teuthology.orchestra.run.trial077:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T11:49:41.197 INFO:tasks.ceph:Sending monmap to node ubuntu@trial077.front.sepia.ceph.com 2026-02-17T11:49:41.197 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:41.197 DEBUG:teuthology.orchestra.run.trial077:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:49:41.197 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:49:41.271 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:41.271 DEBUG:teuthology.orchestra.run.trial077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:49:41.326 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T11:49:41.327 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T11:49:41.327 DEBUG:teuthology.orchestra.run.trial077:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:49:41.409 INFO:teuthology.orchestra.run.trial077.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:49:41.411 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T11:49:41.411 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T11:49:41.411 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T11:49:41.412 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-17T11:49:41.412 DEBUG:teuthology.orchestra.run.trial077:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T11:49:41.475 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T11:49:41.475 INFO:tasks.ceph:role: osd.0 2026-02-17T11:49:41.475 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T11:49:41.476 DEBUG:teuthology.orchestra.run.trial077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:49:41.540 INFO:teuthology.orchestra.run.trial077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:49:41.540 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:49:41.540 INFO:teuthology.orchestra.run.trial077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:49:41.540 INFO:teuthology.orchestra.run.trial077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:49:41.540 INFO:teuthology.orchestra.run.trial077.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:49:41.540 INFO:teuthology.orchestra.run.trial077.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:49:41.540 INFO:teuthology.orchestra.run.trial077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:49:41.540 INFO:teuthology.orchestra.run.trial077.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:49:41.540 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:49:41.540 INFO:teuthology.orchestra.run.trial077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:49:42.109 INFO:teuthology.orchestra.run.trial077.stdout:Discarding blocks...Done. 2026-02-17T11:49:42.112 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial077.front.sepia.ceph.com -o noatime 2026-02-17T11:49:42.113 DEBUG:teuthology.orchestra.run.trial077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T11:49:42.182 DEBUG:teuthology.orchestra.run.trial077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T11:49:42.248 DEBUG:teuthology.orchestra.run.trial077:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T11:49:42.312 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T11:49:42.312 INFO:tasks.ceph:role: osd.1 2026-02-17T11:49:42.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T11:49:42.313 DEBUG:teuthology.orchestra.run.trial077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:49:42.378 INFO:teuthology.orchestra.run.trial077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:49:42.378 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:49:42.378 INFO:teuthology.orchestra.run.trial077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:49:42.378 INFO:teuthology.orchestra.run.trial077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:49:42.378 INFO:teuthology.orchestra.run.trial077.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:49:42.378 INFO:teuthology.orchestra.run.trial077.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:49:42.378 INFO:teuthology.orchestra.run.trial077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:49:42.378 INFO:teuthology.orchestra.run.trial077.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:49:42.378 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:49:42.379 INFO:teuthology.orchestra.run.trial077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:49:42.938 INFO:teuthology.orchestra.run.trial077.stdout:Discarding blocks...Done. 2026-02-17T11:49:42.940 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial077.front.sepia.ceph.com -o noatime 2026-02-17T11:49:42.940 DEBUG:teuthology.orchestra.run.trial077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T11:49:43.007 DEBUG:teuthology.orchestra.run.trial077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T11:49:43.075 DEBUG:teuthology.orchestra.run.trial077:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T11:49:43.137 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T11:49:43.138 INFO:tasks.ceph:role: osd.2 2026-02-17T11:49:43.138 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T11:49:43.138 DEBUG:teuthology.orchestra.run.trial077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:49:43.202 INFO:teuthology.orchestra.run.trial077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:49:43.202 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:49:43.202 INFO:teuthology.orchestra.run.trial077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:49:43.202 INFO:teuthology.orchestra.run.trial077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:49:43.202 INFO:teuthology.orchestra.run.trial077.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:49:43.202 INFO:teuthology.orchestra.run.trial077.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:49:43.202 INFO:teuthology.orchestra.run.trial077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:49:43.202 INFO:teuthology.orchestra.run.trial077.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:49:43.203 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:49:43.203 INFO:teuthology.orchestra.run.trial077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:49:43.764 INFO:teuthology.orchestra.run.trial077.stdout:Discarding blocks...Done. 2026-02-17T11:49:43.766 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial077.front.sepia.ceph.com -o noatime 2026-02-17T11:49:43.766 DEBUG:teuthology.orchestra.run.trial077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T11:49:43.834 DEBUG:teuthology.orchestra.run.trial077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T11:49:43.901 DEBUG:teuthology.orchestra.run.trial077:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-17T11:49:43.965 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T11:49:43.965 INFO:tasks.ceph:role: osd.3 2026-02-17T11:49:43.965 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T11:49:43.966 DEBUG:teuthology.orchestra.run.trial077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T11:49:44.029 INFO:teuthology.orchestra.run.trial077.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:49:44.030 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:49:44.030 INFO:teuthology.orchestra.run.trial077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:49:44.030 INFO:teuthology.orchestra.run.trial077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:49:44.030 INFO:teuthology.orchestra.run.trial077.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:49:44.030 INFO:teuthology.orchestra.run.trial077.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:49:44.030 INFO:teuthology.orchestra.run.trial077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:49:44.030 INFO:teuthology.orchestra.run.trial077.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:49:44.030 INFO:teuthology.orchestra.run.trial077.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:49:44.030 INFO:teuthology.orchestra.run.trial077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:49:44.588 INFO:teuthology.orchestra.run.trial077.stdout:Discarding blocks...Done. 2026-02-17T11:49:44.590 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial077.front.sepia.ceph.com -o noatime 2026-02-17T11:49:44.590 DEBUG:teuthology.orchestra.run.trial077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-17T11:49:44.673 DEBUG:teuthology.orchestra.run.trial077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-17T11:49:44.739 DEBUG:teuthology.orchestra.run.trial077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:49:44.818 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:44.816+0000 7f0254c12780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T11:49:44.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:44.817+0000 7f0254c12780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T11:49:44.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:44.817+0000 7f0254c12780 -1 bdev(0x56213e365800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T11:49:44.819 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:44.817+0000 7f0254c12780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T11:49:47.725 DEBUG:teuthology.orchestra.run.trial077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T11:49:47.790 DEBUG:teuthology.orchestra.run.trial077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:49:47.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:47.869+0000 7fe124639780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T11:49:47.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:47.869+0000 7fe124639780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T11:49:47.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:47.869+0000 7fe124639780 -1 bdev(0x562150d6b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T11:49:47.871 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:47.869+0000 7fe124639780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T11:49:51.030 DEBUG:teuthology.orchestra.run.trial077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T11:49:51.096 DEBUG:teuthology.orchestra.run.trial077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:49:51.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:51.173+0000 7fee01d84780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T11:49:51.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:51.173+0000 7fee01d84780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T11:49:51.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:51.173+0000 7fee01d84780 -1 bdev(0x55efd7cdd800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T11:49:51.175 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:51.173+0000 7fee01d84780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T11:49:54.573 DEBUG:teuthology.orchestra.run.trial077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T11:49:54.638 DEBUG:teuthology.orchestra.run.trial077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:49:54.715 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:54.714+0000 7f7b4499c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-17T11:49:54.715 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:54.714+0000 7f7b4499c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-17T11:49:54.715 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:54.714+0000 7f7b4499c780 -1 bdev(0x559a19217800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-17T11:49:54.715 INFO:teuthology.orchestra.run.trial077.stderr:2026-02-17T11:49:54.715+0000 7f7b4499c780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-17T11:49:57.872 DEBUG:teuthology.orchestra.run.trial077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-17T11:49:57.939 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T11:49:57.939 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:57.940 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T11:49:58.003 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:58.004 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T11:49:58.067 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:58.067 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T11:49:58.131 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:58.131 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T11:49:58.194 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:58.195 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-17T11:49:58.258 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T11:49:58.258 DEBUG:teuthology.orchestra.run.trial077:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T11:49:58.320 INFO:teuthology.orchestra.run.trial077.stdout:[mgr.x] 2026-02-17T11:49:58.320 INFO:teuthology.orchestra.run.trial077.stdout: key = AQDVVZRpxetfGBAAA/xpt1m18YlOxXhAwyUN5g== 2026-02-17T11:49:58.320 INFO:teuthology.orchestra.run.trial077.stdout:[osd.0] 2026-02-17T11:49:58.321 INFO:teuthology.orchestra.run.trial077.stdout: key = AQDYVZRp3o7FMBAAYukTUS0mKLaAkFUXyGpVIg== 2026-02-17T11:49:58.321 INFO:teuthology.orchestra.run.trial077.stdout:[osd.1] 2026-02-17T11:49:58.321 INFO:teuthology.orchestra.run.trial077.stdout: key = AQDbVZRpQUbkMxAARI4nbISWGO0gLJPF9WzieA== 2026-02-17T11:49:58.321 INFO:teuthology.orchestra.run.trial077.stdout:[osd.2] 2026-02-17T11:49:58.321 INFO:teuthology.orchestra.run.trial077.stdout: key = AQDfVZRpSUNqChAA3QyVOh5OS4VeIcGXYyomlg== 2026-02-17T11:49:58.322 INFO:teuthology.orchestra.run.trial077.stdout:[osd.3] 2026-02-17T11:49:58.322 INFO:teuthology.orchestra.run.trial077.stdout: key = AQDiVZRpt5icKhAAbyvuTZpuvdJSUJGrT/NJNg== 2026-02-17T11:49:58.324 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:49:58.402 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:49:58.481 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:49:58.561 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:49:58.640 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:49:58.720 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T11:49:58.720 DEBUG:teuthology.orchestra.run.trial077:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T11:49:58.785 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T11:49:58.867 DEBUG:teuthology.orchestra.run.trial077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T11:49:58.932 DEBUG:teuthology.orchestra.run.trial077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:49:58.987 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T11:49:58.988 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T11:49:58.988 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T11:49:59.030 INFO:tasks.ceph.mon.a:Started 2026-02-17T11:49:59.031 DEBUG:teuthology.orchestra.run.trial077:> sudo ceph config set mgr mgr_pool false --force 2026-02-17T11:49:59.140 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T11:49:59.140 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T11:49:59.140 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T11:49:59.142 INFO:tasks.ceph.mgr.x:Started 2026-02-17T11:49:59.143 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T11:49:59.143 DEBUG:teuthology.orchestra.run.trial077:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T11:49:59.241 INFO:teuthology.orchestra.run.trial077.stderr:adjusted tunables profile to default 2026-02-17T11:49:59.248 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T11:49:59.248 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T11:49:59.249 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:59.249 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T11:49:59.273 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:59.273 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T11:49:59.336 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:59.336 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T11:49:59.402 DEBUG:teuthology.orchestra.run.trial077:> set -ex 2026-02-17T11:49:59.402 DEBUG:teuthology.orchestra.run.trial077:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-17T11:49:59.464 DEBUG:teuthology.orchestra.run.trial077:> sudo ceph --cluster ceph osd new 06177586-2b45-40c3-b057-27ca047bcee0 0 2026-02-17T11:49:59.553 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:49:59.552+0000 7fb1125cc140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T11:49:59.610 INFO:teuthology.orchestra.run.trial077.stdout:0 2026-02-17T11:49:59.618 DEBUG:teuthology.orchestra.run.trial077:> sudo ceph --cluster ceph osd new b27a2a57-5389-4f5b-9c07-b2763002c491 1 2026-02-17T11:49:59.677 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:49:59.675+0000 7fb1125cc140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T11:49:59.704 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:49:59.703+0000 7fb1125cc140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T11:49:59.722 INFO:teuthology.orchestra.run.trial077.stdout:1 2026-02-17T11:49:59.728 DEBUG:teuthology.orchestra.run.trial077:> sudo ceph --cluster ceph osd new 0ddddeda-62c7-4530-9403-865bcc4a3d7f 2 2026-02-17T11:49:59.738 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:49:59.737+0000 7fb1125cc140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T11:49:59.762 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:49:59.760+0000 7fb1125cc140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T11:49:59.788 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:49:59.787+0000 7fb1125cc140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T11:49:59.831 INFO:teuthology.orchestra.run.trial077.stdout:2 2026-02-17T11:49:59.839 DEBUG:teuthology.orchestra.run.trial077:> sudo ceph --cluster ceph osd new 8158b67f-f2f9-4ae4-af05-ca370365fe36 3 2026-02-17T11:49:59.845 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:49:59.843+0000 7fb1125cc140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T11:49:59.907 INFO:tasks.ceph.mgr.x.trial077.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T11:49:59.907 INFO:tasks.ceph.mgr.x.trial077.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T11:49:59.908 INFO:tasks.ceph.mgr.x.trial077.stderr: from numpy import show_config as show_numpy_config 2026-02-17T11:49:59.911 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:49:59.909+0000 7fb1125cc140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T11:49:59.936 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:49:59.935+0000 7fb1125cc140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T11:49:59.948 INFO:teuthology.orchestra.run.trial077.stdout:3 2026-02-17T11:49:59.956 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T11:49:59.957 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T11:49:59.959 INFO:tasks.ceph.osd.0:Started 2026-02-17T11:49:59.959 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T11:49:59.959 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T11:49:59.962 INFO:tasks.ceph.osd.1:Started 2026-02-17T11:49:59.962 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T11:49:59.962 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T11:49:59.965 INFO:tasks.ceph.osd.2:Started 2026-02-17T11:49:59.965 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-17T11:49:59.965 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-17T11:49:59.967 INFO:tasks.ceph.osd.3:Started 2026-02-17T11:49:59.968 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:49:59.993 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:49:59.992+0000 7fb1125cc140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T11:50:00.039 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.038+0000 7fb1125cc140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T11:50:00.066 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.064+0000 7fb1125cc140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T11:50:00.067 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:00.067 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":6,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:49:59.947887+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:50:00.075 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T11:50:00.075 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T11:50:00.090 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.089+0000 7fb1125cc140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T11:50:00.116 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.114+0000 7fb1125cc140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T11:50:00.139 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.137+0000 7fb1125cc140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T11:50:00.331 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.330+0000 7fb1125cc140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T11:50:00.386 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.385+0000 7fb1125cc140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T11:50:00.409 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.407+0000 7fb1125cc140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T11:50:00.432 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.430+0000 7fb1125cc140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T11:50:00.479 DEBUG:teuthology.orchestra.run.trial077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:50:00.486 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.484+0000 7fb1125cc140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:50:00.506 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.505+0000 7fb1125cc140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T11:50:00.560 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.558+0000 7fb1125cc140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:50:00.571 INFO:teuthology.misc.health.trial077.stdout: 2026-02-17T11:50:00.571 INFO:teuthology.misc.health.trial077.stdout:{"epoch":6,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:49:59.947887+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:50:00.578 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-17T11:50:00.962 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.960+0000 7fb1125cc140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T11:50:00.985 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:00.983+0000 7fb1125cc140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T11:50:01.329 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:01.327+0000 7fb1125cc140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T11:50:01.389 INFO:tasks.ceph.osd.2.trial077.stderr:2026-02-17T11:50:01.387+0000 7f2015020780 -1 Falling back to public interface 2026-02-17T11:50:01.409 INFO:tasks.ceph.osd.1.trial077.stderr:2026-02-17T11:50:01.407+0000 7f3a38c39780 -1 Falling back to public interface 2026-02-17T11:50:01.638 INFO:tasks.ceph.osd.0.trial077.stderr:2026-02-17T11:50:01.636+0000 7f77c2e0d780 -1 Falling back to public interface 2026-02-17T11:50:01.923 INFO:tasks.ceph.osd.3.trial077.stderr:2026-02-17T11:50:01.921+0000 7f28895f9780 -1 Falling back to public interface 2026-02-17T11:50:02.336 INFO:tasks.ceph.mgr.x.trial077.stderr:2026-02-17T11:50:02.334+0000 7fb02f17e640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-17T11:50:05.122 INFO:tasks.ceph.osd.0.trial077.stderr:2026-02-17T11:50:05.121+0000 7f77c2e0d780 -1 osd.0 0 log_to_monitors true 2026-02-17T11:50:05.181 INFO:tasks.ceph.osd.2.trial077.stderr:2026-02-17T11:50:05.179+0000 7f2015020780 -1 osd.2 0 log_to_monitors true 2026-02-17T11:50:05.465 INFO:tasks.ceph.osd.1.trial077.stderr:2026-02-17T11:50:05.463+0000 7f3a38c39780 -1 osd.1 0 log_to_monitors true 2026-02-17T11:50:05.679 INFO:tasks.ceph.osd.3.trial077.stderr:2026-02-17T11:50:05.677+0000 7f28895f9780 -1 osd.3 0 log_to_monitors true 2026-02-17T11:50:06.343 INFO:tasks.ceph.osd.2.trial077.stderr:2026-02-17T11:50:06.341+0000 7f2010958640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T11:50:06.343 INFO:tasks.ceph.osd.0.trial077.stderr:2026-02-17T11:50:06.341+0000 7f77be6e6640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T11:50:06.345 INFO:tasks.ceph.osd.2.trial077.stderr:2026-02-17T11:50:06.344+0000 7f200c782640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:50:06.346 INFO:tasks.ceph.osd.0.trial077.stderr:2026-02-17T11:50:06.345+0000 7f77ba510640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:50:06.982 DEBUG:teuthology.orchestra.run.trial077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:50:07.132 INFO:teuthology.misc.health.trial077.stdout: 2026-02-17T11:50:07.133 INFO:teuthology.misc.health.trial077.stdout:{"epoch":8,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:50:06.337854+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:50:07.139 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-17T11:50:07.680 INFO:tasks.ceph.osd.1.trial077.stderr:2026-02-17T11:50:07.679+0000 7f3a34bc6640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T11:50:07.683 INFO:tasks.ceph.osd.1.trial077.stderr:2026-02-17T11:50:07.681+0000 7f3a2c9e8640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:50:07.698 INFO:tasks.ceph.osd.3.trial077.stderr:2026-02-17T11:50:07.696+0000 7f2885588640 -1 osd.3 0 waiting for initial osdmap 2026-02-17T11:50:07.700 INFO:tasks.ceph.osd.3.trial077.stderr:2026-02-17T11:50:07.698+0000 7f287d3aa640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:50:13.542 DEBUG:teuthology.orchestra.run.trial077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:50:13.692 INFO:teuthology.misc.health.trial077.stdout: 2026-02-17T11:50:13.692 INFO:teuthology.misc.health.trial077.stdout:{"epoch":10,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:50:08.680878+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:50:13.699 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-17T11:50:13.700 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T11:50:13.700 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T11:50:13.700 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T11:50:13.700 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T11:50:13.701 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T11:50:13.881 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:13.888 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":4,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6800","nonce":1845190458}]},"active_addr":"10.20.193.77:6800/1845190458","active_change":"2026-02-17T11:50:01.329507+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.77:0","nonce":3790535139}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.77:0","nonce":2685987826}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.77:0","nonce":1163355597}]}]} 2026-02-17T11:50:13.892 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T11:50:13.892 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T11:50:13.892 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:50:14.048 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:14.048 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":10,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:50:08.680878+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:50:14.056 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T11:50:14.056 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:50:14.212 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:14.213 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":10,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:50:08.680878+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:50:14.222 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:50:14.223 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:50:14.224 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:50:14.224 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:50:14.311 INFO:teuthology.orchestra.run.trial077.stdout:42949672963 2026-02-17T11:50:14.312 INFO:teuthology.orchestra.run.trial077.stdout:38654705668 2026-02-17T11:50:14.313 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:14.314 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:14.315 INFO:teuthology.orchestra.run.trial077.stdout:42949672964 2026-02-17T11:50:14.315 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:14.316 INFO:teuthology.orchestra.run.trial077.stdout:38654705669 2026-02-17T11:50:14.317 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:14.511 INFO:teuthology.orchestra.run.trial077.stdout:38654705666 2026-02-17T11:50:14.513 INFO:teuthology.orchestra.run.trial077.stdout:42949672963 2026-02-17T11:50:14.517 INFO:teuthology.orchestra.run.trial077.stdout:42949672962 2026-02-17T11:50:14.517 INFO:teuthology.orchestra.run.trial077.stdout:38654705667 2026-02-17T11:50:14.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705666 for osd.2 2026-02-17T11:50:14.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.3 2026-02-17T11:50:14.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672963 got 42949672962 for osd.1 2026-02-17T11:50:14.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2026-02-17T11:50:15.522 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:15.523 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:15.528 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:15.529 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:15.682 INFO:teuthology.orchestra.run.trial077.stdout:42949672963 2026-02-17T11:50:15.685 INFO:teuthology.orchestra.run.trial077.stdout:38654705668 2026-02-17T11:50:15.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.3 2026-02-17T11:50:15.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.2 2026-02-17T11:50:15.696 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:15.723 INFO:teuthology.orchestra.run.trial077.stdout:42949672964 2026-02-17T11:50:15.728 INFO:teuthology.orchestra.run.trial077.stdout:38654705669 2026-02-17T11:50:15.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672963 got 42949672964 for osd.1 2026-02-17T11:50:15.732 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:15.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2026-02-17T11:50:15.737 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:16.694 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:16.849 INFO:teuthology.orchestra.run.trial077.stdout:42949672965 2026-02-17T11:50:16.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672965 for osd.3 2026-02-17T11:50:16.858 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:16.858 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:50:16.858 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:17.012 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:17.013 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:50:17.020 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-17T11:50:15.333121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":112368,"kb_used_data":352,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374992,"statfs":{"total":386547056640,"available":386431991808,"internally_reserved":0,"allocated":360448,"data_stored":74780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31212,"kb_used_data":88,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340628,"statfs":{"total":96636764160,"available":96604803072,"internally_reserved":0,"allocated":90112,"data_stored":18695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27052,"kb_used_data":88,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344788,"statfs":{"total":96636764160,"available":96609062912,"internally_reserved":0,"allocated":90112,"data_stored":18695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27052,"kb_used_data":88,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344788,"statfs":{"total":96636764160,"available":96609062912,"internally_reserved":0,"allocated":90112,"data_stored":18695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27052,"kb_used_data":88,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344788,"statfs":{"total":96636764160,"available":96609062912,"internally_reserved":0,"allocated":90112,"data_stored":18695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T11:50:17.021 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:17.176 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:17.176 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:50:17.184 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-17T11:50:15.333121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":112368,"kb_used_data":352,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374992,"statfs":{"total":386547056640,"available":386431991808,"internally_reserved":0,"allocated":360448,"data_stored":74780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31212,"kb_used_data":88,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340628,"statfs":{"total":96636764160,"available":96604803072,"internally_reserved":0,"allocated":90112,"data_stored":18695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27052,"kb_used_data":88,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344788,"statfs":{"total":96636764160,"available":96609062912,"internally_reserved":0,"allocated":90112,"data_stored":18695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27052,"kb_used_data":88,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344788,"statfs":{"total":96636764160,"available":96609062912,"internally_reserved":0,"allocated":90112,"data_stored":18695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27052,"kb_used_data":88,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344788,"statfs":{"total":96636764160,"available":96609062912,"internally_reserved":0,"allocated":90112,"data_stored":18695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T11:50:17.185 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:50:17.185 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T11:50:17.185 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T11:50:17.185 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:50:17.354 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:17.355 INFO:teuthology.orchestra.run.trial077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T11:50:17.362 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T11:50:17.363 INFO:teuthology.run_tasks:Running task osd_max_pg_per_osd... 2026-02-17T11:50:17.380 INFO:tasks.osd_max_pg_per_osd:1. creating pool.a 2026-02-17T11:50:17.380 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-17T11:50:17.380 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 1 2026-02-17T11:50:17.689 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_0' created 2026-02-17T11:50:17.699 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-17T11:50:18.692 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-17T11:50:19.703 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:50:19.861 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:19.861 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":13,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:50:19.692596+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:50:19.870 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:50:19.870 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:50:19.870 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:50:19.871 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:50:19.956 INFO:teuthology.orchestra.run.trial077.stdout:42949672966 2026-02-17T11:50:19.956 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:19.957 INFO:teuthology.orchestra.run.trial077.stdout:38654705670 2026-02-17T11:50:19.957 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:19.957 INFO:teuthology.orchestra.run.trial077.stdout:38654705671 2026-02-17T11:50:19.958 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:19.961 INFO:teuthology.orchestra.run.trial077.stdout:42949672967 2026-02-17T11:50:19.961 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:20.120 INFO:teuthology.orchestra.run.trial077.stdout:42949672964 2026-02-17T11:50:20.124 INFO:teuthology.orchestra.run.trial077.stdout:38654705670 2026-02-17T11:50:20.127 INFO:teuthology.orchestra.run.trial077.stdout:42949672965 2026-02-17T11:50:20.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672964 for osd.1 2026-02-17T11:50:20.129 INFO:teuthology.orchestra.run.trial077.stdout:38654705669 2026-02-17T11:50:20.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.0 2026-02-17T11:50:20.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672965 for osd.3 2026-02-17T11:50:20.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.2 2026-02-17T11:50:21.130 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:21.135 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:21.138 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:21.140 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:21.291 INFO:teuthology.orchestra.run.trial077.stdout:42949672964 2026-02-17T11:50:21.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672964 for osd.1 2026-02-17T11:50:21.334 INFO:teuthology.orchestra.run.trial077.stdout:38654705669 2026-02-17T11:50:21.334 INFO:teuthology.orchestra.run.trial077.stdout:38654705670 2026-02-17T11:50:21.335 INFO:teuthology.orchestra.run.trial077.stdout:42949672965 2026-02-17T11:50:21.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.2 2026-02-17T11:50:21.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.0 2026-02-17T11:50:21.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672965 for osd.3 2026-02-17T11:50:22.301 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:22.344 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:22.345 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:22.347 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:22.462 INFO:teuthology.orchestra.run.trial077.stdout:42949672966 2026-02-17T11:50:22.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.1 2026-02-17T11:50:22.472 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:22.503 INFO:teuthology.orchestra.run.trial077.stdout:38654705670 2026-02-17T11:50:22.505 INFO:teuthology.orchestra.run.trial077.stdout:38654705671 2026-02-17T11:50:22.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2026-02-17T11:50:22.514 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:22.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2026-02-17T11:50:22.515 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:22.541 INFO:teuthology.orchestra.run.trial077.stdout:42949672967 2026-02-17T11:50:22.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672967 for osd.3 2026-02-17T11:50:22.550 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:22.551 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:22.745 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:22.745 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:50:22.753 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2026-02-17T11:50:21.333606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":112428,"kb_used_data":400,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374932,"statfs":{"total":386547056640,"available":386431930368,"internally_reserved":0,"allocated":409600,"data_stored":92717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-17T11:50:19.695229+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:50:19.695229+0000","last_peered":"2026-02-17T11:50:19.695229+0000","last_clean":"2026-02-17T11:50:19.695229+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:50:19.695229+0000","last_undegraded":"2026-02-17T11:50:19.695229+0000","last_fullsized":"2026-02-17T11:50:19.695229+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31232,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340608,"statfs":{"total":96636764160,"available":96604782592,"internally_reserved":0,"allocated":106496,"data_stored":24674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27072,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344768,"statfs":{"total":96636764160,"available":96609042432,"internally_reserved":0,"allocated":106496,"data_stored":24674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27052,"kb_used_data":88,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344788,"statfs":{"total":96636764160,"available":96609062912,"internally_reserved":0,"allocated":90112,"data_stored":18695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27072,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344768,"statfs":{"total":96636764160,"available":96609042432,"internally_reserved":0,"allocated":106496,"data_stored":24674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:50:28.755 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:50:28.756 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:50:28.757 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:50:28.757 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:50:28.843 INFO:teuthology.orchestra.run.trial077.stdout:38654705674 2026-02-17T11:50:28.844 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:28.844 INFO:teuthology.orchestra.run.trial077.stdout:42949672968 2026-02-17T11:50:28.844 INFO:teuthology.orchestra.run.trial077.stdout:42949672969 2026-02-17T11:50:28.844 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:28.845 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:28.845 INFO:teuthology.orchestra.run.trial077.stdout:38654705673 2026-02-17T11:50:28.845 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:29.043 INFO:teuthology.orchestra.run.trial077.stdout:42949672967 2026-02-17T11:50:29.045 INFO:teuthology.orchestra.run.trial077.stdout:42949672968 2026-02-17T11:50:29.045 INFO:teuthology.orchestra.run.trial077.stdout:38654705672 2026-02-17T11:50:29.051 INFO:teuthology.orchestra.run.trial077.stdout:38654705671 2026-02-17T11:50:29.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672967 for osd.1 2026-02-17T11:50:29.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672969 got 42949672968 for osd.3 2026-02-17T11:50:29.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705672 for osd.0 2026-02-17T11:50:29.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705671 for osd.2 2026-02-17T11:50:30.053 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:30.056 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:30.056 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:30.062 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:30.217 INFO:teuthology.orchestra.run.trial077.stdout:38654705674 2026-02-17T11:50:30.219 INFO:teuthology.orchestra.run.trial077.stdout:42949672968 2026-02-17T11:50:30.221 INFO:teuthology.orchestra.run.trial077.stdout:42949672969 2026-02-17T11:50:30.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705674 for osd.0 2026-02-17T11:50:30.228 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:30.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.1 2026-02-17T11:50:30.229 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:30.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672969 got 42949672969 for osd.3 2026-02-17T11:50:30.231 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:30.257 INFO:teuthology.orchestra.run.trial077.stdout:38654705673 2026-02-17T11:50:30.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.2 2026-02-17T11:50:30.267 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:30.267 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:30.460 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:30.461 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:50:30.468 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-17T11:50:29.705377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":112476,"kb_used_data":456,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374884,"statfs":{"total":386547056640,"available":386431881216,"internally_reserved":0,"allocated":466944,"data_stored":113286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T11:50:29.168565+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:50:29.168565+0000","last_peered":"2026-02-17T11:50:29.168565+0000","last_clean":"2026-02-17T11:50:29.168565+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:50:29.168565+0000","last_undegraded":"2026-02-17T11:50:29.168565+0000","last_fullsized":"2026-02-17T11:50:29.168565+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31244,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340596,"statfs":{"total":96636764160,"available":96604770304,"internally_reserved":0,"allocated":122880,"data_stored":30336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672969,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27076,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344764,"statfs":{"total":96636764160,"available":96609038336,"internally_reserved":0,"allocated":114688,"data_stored":27650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27080,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":114688,"data_stored":27650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27076,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344764,"statfs":{"total":96636764160,"available":96609038336,"internally_reserved":0,"allocated":114688,"data_stored":27650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:50:30.469 INFO:tasks.osd_max_pg_per_osd:2. creating pool.b 2026-02-17T11:50:30.469 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2026-02-17T11:50:30.470 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 1 2026-02-17T11:50:30.707 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_1' created 2026-02-17T11:50:30.717 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2026-02-17T11:50:31.710 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_1' 2026-02-17T11:50:32.723 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:50:32.881 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:32.882 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":17,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:50:31.707794+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"unique_pool_1","create_time":"2026-02-17T11:50:30.629824+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:50:32.890 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:50:32.890 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:50:32.890 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:50:32.891 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:50:32.975 INFO:teuthology.orchestra.run.trial077.stdout:42949672971 2026-02-17T11:50:32.975 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:32.976 INFO:teuthology.orchestra.run.trial077.stdout:38654705674 2026-02-17T11:50:32.976 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:32.977 INFO:teuthology.orchestra.run.trial077.stdout:38654705675 2026-02-17T11:50:32.977 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:32.978 INFO:teuthology.orchestra.run.trial077.stdout:42949672970 2026-02-17T11:50:32.978 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:33.136 INFO:teuthology.orchestra.run.trial077.stdout:38654705673 2026-02-17T11:50:33.141 INFO:teuthology.orchestra.run.trial077.stdout:38654705674 2026-02-17T11:50:33.141 INFO:teuthology.orchestra.run.trial077.stdout:42949672970 2026-02-17T11:50:33.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705673 for osd.2 2026-02-17T11:50:33.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672971 got 42949672970 for osd.3 2026-02-17T11:50:33.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705674 for osd.0 2026-02-17T11:50:33.179 INFO:teuthology.orchestra.run.trial077.stdout:42949672969 2026-02-17T11:50:33.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672970 got 42949672969 for osd.1 2026-02-17T11:50:34.147 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:34.152 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:34.152 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:34.189 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:34.309 INFO:teuthology.orchestra.run.trial077.stdout:38654705674 2026-02-17T11:50:34.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705674 for osd.2 2026-02-17T11:50:34.320 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:34.349 INFO:teuthology.orchestra.run.trial077.stdout:38654705675 2026-02-17T11:50:34.353 INFO:teuthology.orchestra.run.trial077.stdout:42949672971 2026-02-17T11:50:34.355 INFO:teuthology.orchestra.run.trial077.stdout:42949672970 2026-02-17T11:50:34.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705675 for osd.0 2026-02-17T11:50:34.360 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:34.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672971 got 42949672971 for osd.3 2026-02-17T11:50:34.364 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:34.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672970 got 42949672970 for osd.1 2026-02-17T11:50:34.366 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:34.367 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:34.562 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:34.562 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:50:34.571 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2026-02-17T11:50:33.334935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":112588,"kb_used_data":568,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374772,"statfs":{"total":386547056640,"available":386431766528,"internally_reserved":0,"allocated":581632,"data_stored":155975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":17,"state":"creating+activating","last_fresh":"2026-02-17T11:50:31.712080+0000","last_change":"2026-02-17T11:50:31.712080+0000","last_active":"2026-02-17T11:50:30.705546+0000","last_peered":"2026-02-17T11:50:30.705546+0000","last_clean":"2026-02-17T11:50:30.705546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:50:31.712080+0000","last_undegraded":"2026-02-17T11:50:31.712080+0000","last_fullsized":"2026-02-17T11:50:31.712080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:30.705546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:30.705546+0000","last_clean_scrub_stamp":"2026-02-17T11:50:30.705546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-17T11:50:31.711263+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:50:31.711263+0000","last_peered":"2026-02-17T11:50:31.711263+0000","last_clean":"2026-02-17T11:50:31.711263+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:50:31.711263+0000","last_undegraded":"2026-02-17T11:50:31.711263+0000","last_fullsized":"2026-02-17T11:50:31.711263+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31268,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340572,"statfs":{"total":96636764160,"available":96604745728,"internally_reserved":0,"allocated":147456,"data_stored":39831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672970,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27108,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344732,"statfs":{"total":96636764160,"available":96609005568,"internally_reserved":0,"allocated":147456,"data_stored":39831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":139264,"data_stored":36482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27108,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344732,"statfs":{"total":96636764160,"available":96609005568,"internally_reserved":0,"allocated":147456,"data_stored":39831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:50:40.573 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:50:40.574 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:50:40.574 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:50:40.575 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:50:40.663 INFO:teuthology.orchestra.run.trial077.stdout:42949672974 2026-02-17T11:50:40.664 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:40.665 INFO:teuthology.orchestra.run.trial077.stdout:42949672973 2026-02-17T11:50:40.666 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:40.667 INFO:teuthology.orchestra.run.trial077.stdout:38654705677 2026-02-17T11:50:40.667 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:40.668 INFO:teuthology.orchestra.run.trial077.stdout:38654705678 2026-02-17T11:50:40.669 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:40.866 INFO:teuthology.orchestra.run.trial077.stdout:42949672971 2026-02-17T11:50:40.870 INFO:teuthology.orchestra.run.trial077.stdout:42949672972 2026-02-17T11:50:40.872 INFO:teuthology.orchestra.run.trial077.stdout:38654705676 2026-02-17T11:50:40.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672973 got 42949672971 for osd.1 2026-02-17T11:50:40.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672974 got 42949672972 for osd.3 2026-02-17T11:50:40.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705677 got 38654705676 for osd.2 2026-02-17T11:50:40.911 INFO:teuthology.orchestra.run.trial077.stdout:38654705677 2026-02-17T11:50:40.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705678 got 38654705677 for osd.0 2026-02-17T11:50:41.877 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:41.882 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:41.883 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:41.921 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:42.037 INFO:teuthology.orchestra.run.trial077.stdout:42949672973 2026-02-17T11:50:42.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672973 got 42949672973 for osd.1 2026-02-17T11:50:42.049 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:42.079 INFO:teuthology.orchestra.run.trial077.stdout:38654705677 2026-02-17T11:50:42.084 INFO:teuthology.orchestra.run.trial077.stdout:42949672974 2026-02-17T11:50:42.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705677 got 38654705677 for osd.2 2026-02-17T11:50:42.090 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:42.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672974 got 42949672974 for osd.3 2026-02-17T11:50:42.095 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:42.119 INFO:teuthology.orchestra.run.trial077.stdout:38654705678 2026-02-17T11:50:42.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705678 got 38654705678 for osd.0 2026-02-17T11:50:42.129 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:42.129 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:42.325 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:42.325 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:50:42.333 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2026-02-17T11:50:41.335959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":112592,"kb_used_data":576,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374768,"statfs":{"total":386547056640,"available":386431762432,"internally_reserved":0,"allocated":589824,"data_stored":159324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":17,"state":"creating+activating","last_fresh":"2026-02-17T11:50:31.712080+0000","last_change":"2026-02-17T11:50:31.712080+0000","last_active":"2026-02-17T11:50:30.705546+0000","last_peered":"2026-02-17T11:50:30.705546+0000","last_clean":"2026-02-17T11:50:30.705546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:50:31.712080+0000","last_undegraded":"2026-02-17T11:50:31.712080+0000","last_fullsized":"2026-02-17T11:50:31.712080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:30.705546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:30.705546+0000","last_clean_scrub_stamp":"2026-02-17T11:50:30.705546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-17T11:50:31.711263+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:50:31.711263+0000","last_peered":"2026-02-17T11:50:31.711263+0000","last_clean":"2026-02-17T11:50:31.711263+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:50:31.711263+0000","last_undegraded":"2026-02-17T11:50:31.711263+0000","last_fullsized":"2026-02-17T11:50:31.711263+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672974,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31268,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340572,"statfs":{"total":96636764160,"available":96604745728,"internally_reserved":0,"allocated":147456,"data_stored":39831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672973,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27108,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344732,"statfs":{"total":96636764160,"available":96609005568,"internally_reserved":0,"allocated":147456,"data_stored":39831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705677,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27108,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344732,"statfs":{"total":96636764160,"available":96609005568,"internally_reserved":0,"allocated":147456,"data_stored":39831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27108,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344732,"statfs":{"total":96636764160,"available":96609005568,"internally_reserved":0,"allocated":147456,"data_stored":39831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:50:42.333 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2026-02-17T11:50:42.333 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2026-02-17T11:50:42.718 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_1' removed 2026-02-17T11:50:42.730 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_2 2026-02-17T11:50:42.731 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_2 1 2026-02-17T11:50:43.724 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_2' created 2026-02-17T11:50:43.735 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2026-02-17T11:50:44.724 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_2' 2026-02-17T11:50:45.735 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:50:45.890 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:45.891 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":20,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:50:44.723581+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"unique_pool_2","create_time":"2026-02-17T11:50:42.890766+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:50:45.898 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:50:45.899 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:50:45.899 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:50:45.899 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:50:45.983 INFO:teuthology.orchestra.run.trial077.stdout:38654705680 2026-02-17T11:50:45.984 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:45.985 INFO:teuthology.orchestra.run.trial077.stdout:42949672976 2026-02-17T11:50:45.985 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:45.986 INFO:teuthology.orchestra.run.trial077.stdout:42949672975 2026-02-17T11:50:45.987 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:45.988 INFO:teuthology.orchestra.run.trial077.stdout:38654705679 2026-02-17T11:50:45.988 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:46.183 INFO:teuthology.orchestra.run.trial077.stdout:38654705679 2026-02-17T11:50:46.184 INFO:teuthology.orchestra.run.trial077.stdout:42949672975 2026-02-17T11:50:46.191 INFO:teuthology.orchestra.run.trial077.stdout:42949672974 2026-02-17T11:50:46.191 INFO:teuthology.orchestra.run.trial077.stdout:38654705678 2026-02-17T11:50:46.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705680 got 38654705679 for osd.0 2026-02-17T11:50:46.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672975 for osd.3 2026-02-17T11:50:46.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672975 got 42949672974 for osd.1 2026-02-17T11:50:46.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705679 got 38654705678 for osd.2 2026-02-17T11:50:47.194 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:47.195 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:47.201 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:47.202 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:47.358 INFO:teuthology.orchestra.run.trial077.stdout:42949672975 2026-02-17T11:50:47.360 INFO:teuthology.orchestra.run.trial077.stdout:38654705679 2026-02-17T11:50:47.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672975 for osd.3 2026-02-17T11:50:47.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705680 got 38654705679 for osd.0 2026-02-17T11:50:47.398 INFO:teuthology.orchestra.run.trial077.stdout:38654705678 2026-02-17T11:50:47.402 INFO:teuthology.orchestra.run.trial077.stdout:42949672974 2026-02-17T11:50:47.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705679 got 38654705678 for osd.2 2026-02-17T11:50:47.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672975 got 42949672974 for osd.1 2026-02-17T11:50:48.370 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:48.371 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:48.409 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:48.413 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:48.533 INFO:teuthology.orchestra.run.trial077.stdout:38654705680 2026-02-17T11:50:48.535 INFO:teuthology.orchestra.run.trial077.stdout:42949672976 2026-02-17T11:50:48.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705680 got 38654705680 for osd.0 2026-02-17T11:50:48.544 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:48.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672976 for osd.3 2026-02-17T11:50:48.547 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:48.576 INFO:teuthology.orchestra.run.trial077.stdout:38654705679 2026-02-17T11:50:48.577 INFO:teuthology.orchestra.run.trial077.stdout:42949672975 2026-02-17T11:50:48.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705679 got 38654705679 for osd.2 2026-02-17T11:50:48.586 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:48.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672975 got 42949672975 for osd.1 2026-02-17T11:50:48.588 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:48.588 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:48.784 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:48.784 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:50:48.792 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2026-02-17T11:50:47.336831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":112712,"kb_used_data":680,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374648,"statfs":{"total":386547056640,"available":386431639552,"internally_reserved":0,"allocated":696320,"data_stored":194823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:50:43.721132+0000","last_change":"2026-02-17T11:50:43.721132+0000","last_active":"2026-02-17T11:50:43.721132+0000","last_peered":"2026-02-17T11:50:43.721132+0000","last_clean":"2026-02-17T11:50:43.721132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:50:43.721132+0000","last_undegraded":"2026-02-17T11:50:43.721132+0000","last_fullsized":"2026-02-17T11:50:43.721132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:43.721132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:43.721132+0000","last_clean_scrub_stamp":"2026-02-17T11:50:43.721132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:50:45.069724+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:50:45.069724+0000","last_peered":"2026-02-17T11:50:45.069724+0000","last_clean":"2026-02-17T11:50:45.069724+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:50:45.069724+0000","last_undegraded":"2026-02-17T11:50:45.069724+0000","last_fullsized":"2026-02-17T11:50:45.069724+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31300,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":176128,"data_stored":49541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":176128,"data_stored":49541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27132,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":167936,"data_stored":46200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":176128,"data_stored":49541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:50:54.794 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:50:54.795 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:50:54.796 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:50:54.796 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:50:54.883 INFO:teuthology.orchestra.run.trial077.stdout:38654705682 2026-02-17T11:50:54.883 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:54.884 INFO:teuthology.orchestra.run.trial077.stdout:42949672979 2026-02-17T11:50:54.885 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:54.886 INFO:teuthology.orchestra.run.trial077.stdout:38654705683 2026-02-17T11:50:54.886 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:54.887 INFO:teuthology.orchestra.run.trial077.stdout:42949672978 2026-02-17T11:50:54.888 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:55.086 INFO:teuthology.orchestra.run.trial077.stdout:38654705681 2026-02-17T11:50:55.087 INFO:teuthology.orchestra.run.trial077.stdout:38654705680 2026-02-17T11:50:55.088 INFO:teuthology.orchestra.run.trial077.stdout:42949672976 2026-02-17T11:50:55.090 INFO:teuthology.orchestra.run.trial077.stdout:42949672977 2026-02-17T11:50:55.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705683 got 38654705681 for osd.0 2026-02-17T11:50:55.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705682 got 38654705680 for osd.2 2026-02-17T11:50:55.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672978 got 42949672976 for osd.1 2026-02-17T11:50:55.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672979 got 42949672977 for osd.3 2026-02-17T11:50:56.097 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:50:56.099 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:50:56.101 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:50:56.102 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:50:56.257 INFO:teuthology.orchestra.run.trial077.stdout:38654705682 2026-02-17T11:50:56.260 INFO:teuthology.orchestra.run.trial077.stdout:38654705683 2026-02-17T11:50:56.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705682 got 38654705682 for osd.2 2026-02-17T11:50:56.267 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:56.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705683 got 38654705683 for osd.0 2026-02-17T11:50:56.270 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:56.299 INFO:teuthology.orchestra.run.trial077.stdout:42949672979 2026-02-17T11:50:56.301 INFO:teuthology.orchestra.run.trial077.stdout:42949672978 2026-02-17T11:50:56.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672979 got 42949672979 for osd.3 2026-02-17T11:50:56.310 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:56.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672978 got 42949672978 for osd.1 2026-02-17T11:50:56.311 DEBUG:teuthology.parallel:result is None 2026-02-17T11:50:56.311 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:56.505 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:56.506 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:50:56.514 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-17T11:50:55.337626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":112716,"kb_used_data":688,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374644,"statfs":{"total":386547056640,"available":386431635456,"internally_reserved":0,"allocated":704512,"data_stored":198164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:50:43.721132+0000","last_change":"2026-02-17T11:50:43.721132+0000","last_active":"2026-02-17T11:50:43.721132+0000","last_peered":"2026-02-17T11:50:43.721132+0000","last_clean":"2026-02-17T11:50:43.721132+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:50:43.721132+0000","last_undegraded":"2026-02-17T11:50:43.721132+0000","last_fullsized":"2026-02-17T11:50:43.721132+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:43.721132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:43.721132+0000","last_clean_scrub_stamp":"2026-02-17T11:50:43.721132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:50:45.069724+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:50:45.069724+0000","last_peered":"2026-02-17T11:50:45.069724+0000","last_clean":"2026-02-17T11:50:45.069724+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:50:45.069724+0000","last_undegraded":"2026-02-17T11:50:45.069724+0000","last_fullsized":"2026-02-17T11:50:45.069724+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31300,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":176128,"data_stored":49541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":176128,"data_stored":49541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705682,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27136,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":176128,"data_stored":49541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":176128,"data_stored":49541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:50:56.515 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_2 2026-02-17T11:50:56.515 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2026-02-17T11:50:56.788 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_2' removed 2026-02-17T11:50:56.800 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_3 2026-02-17T11:50:56.801 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_3 1 2026-02-17T11:50:57.794 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_3' created 2026-02-17T11:50:57.805 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2026-02-17T11:50:58.795 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_3' 2026-02-17T11:50:59.809 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:50:59.968 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:50:59.968 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":23,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:50:58.793490+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"unique_pool_3","create_time":"2026-02-17T11:50:56.962250+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:50:59.977 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:50:59.977 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:50:59.977 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:50:59.977 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:51:00.064 INFO:teuthology.orchestra.run.trial077.stdout:38654705684 2026-02-17T11:51:00.064 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:00.066 INFO:teuthology.orchestra.run.trial077.stdout:38654705685 2026-02-17T11:51:00.066 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:00.067 INFO:teuthology.orchestra.run.trial077.stdout:42949672981 2026-02-17T11:51:00.067 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:00.068 INFO:teuthology.orchestra.run.trial077.stdout:42949672980 2026-02-17T11:51:00.069 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:00.265 INFO:teuthology.orchestra.run.trial077.stdout:42949672979 2026-02-17T11:51:00.267 INFO:teuthology.orchestra.run.trial077.stdout:42949672978 2026-02-17T11:51:00.269 INFO:teuthology.orchestra.run.trial077.stdout:38654705684 2026-02-17T11:51:00.272 INFO:teuthology.orchestra.run.trial077.stdout:38654705683 2026-02-17T11:51:00.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672981 got 42949672979 for osd.3 2026-02-17T11:51:00.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672980 got 42949672978 for osd.1 2026-02-17T11:51:00.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705685 got 38654705684 for osd.0 2026-02-17T11:51:00.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705684 got 38654705683 for osd.2 2026-02-17T11:51:01.277 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:01.279 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:01.280 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:01.283 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:01.442 INFO:teuthology.orchestra.run.trial077.stdout:42949672979 2026-02-17T11:51:01.443 INFO:teuthology.orchestra.run.trial077.stdout:38654705684 2026-02-17T11:51:01.445 INFO:teuthology.orchestra.run.trial077.stdout:42949672978 2026-02-17T11:51:01.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705685 got 38654705684 for osd.0 2026-02-17T11:51:01.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672981 got 42949672979 for osd.3 2026-02-17T11:51:01.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672980 got 42949672978 for osd.1 2026-02-17T11:51:01.482 INFO:teuthology.orchestra.run.trial077.stdout:38654705683 2026-02-17T11:51:01.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705684 got 38654705683 for osd.2 2026-02-17T11:51:02.454 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:02.455 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:02.456 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:02.492 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:02.620 INFO:teuthology.orchestra.run.trial077.stdout:42949672981 2026-02-17T11:51:02.620 INFO:teuthology.orchestra.run.trial077.stdout:42949672980 2026-02-17T11:51:02.622 INFO:teuthology.orchestra.run.trial077.stdout:38654705685 2026-02-17T11:51:02.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672981 got 42949672981 for osd.3 2026-02-17T11:51:02.630 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:02.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672980 got 42949672980 for osd.1 2026-02-17T11:51:02.630 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:02.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705685 got 38654705685 for osd.0 2026-02-17T11:51:02.632 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:02.657 INFO:teuthology.orchestra.run.trial077.stdout:38654705684 2026-02-17T11:51:02.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705684 got 38654705684 for osd.2 2026-02-17T11:51:02.667 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:02.667 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:51:02.862 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:51:02.862 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:51:02.870 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2026-02-17T11:51:01.338255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":112824,"kb_used_data":800,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374536,"statfs":{"total":386547056640,"available":386431524864,"internally_reserved":0,"allocated":819200,"data_stored":237036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.0","version":"0'0","reported_seq":3,"reported_epoch":23,"state":"creating+activating","last_fresh":"2026-02-17T11:50:58.795905+0000","last_change":"2026-02-17T11:50:58.795905+0000","last_active":"2026-02-17T11:50:57.790980+0000","last_peered":"2026-02-17T11:50:57.790980+0000","last_clean":"2026-02-17T11:50:57.790980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:50:58.795905+0000","last_undegraded":"2026-02-17T11:50:58.795905+0000","last_fullsized":"2026-02-17T11:50:58.795905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:57.790980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:57.790980+0000","last_clean_scrub_stamp":"2026-02-17T11:50:57.790980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T11:50:58.884226+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:50:58.884226+0000","last_peered":"2026-02-17T11:50:58.884226+0000","last_clean":"2026-02-17T11:50:58.884226+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:50:58.884226+0000","last_undegraded":"2026-02-17T11:50:58.884226+0000","last_fullsized":"2026-02-17T11:50:58.884226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672981,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":204800,"data_stored":59259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672980,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":204800,"data_stored":59259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27168,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":204800,"data_stored":59259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705685,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":204800,"data_stored":59259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:51:08.871 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:51:08.872 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:51:08.873 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:51:08.873 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:51:08.962 INFO:teuthology.orchestra.run.trial077.stdout:38654705688 2026-02-17T11:51:08.962 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:08.963 INFO:teuthology.orchestra.run.trial077.stdout:38654705687 2026-02-17T11:51:08.963 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:08.964 INFO:teuthology.orchestra.run.trial077.stdout:42949672982 2026-02-17T11:51:08.965 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:08.966 INFO:teuthology.orchestra.run.trial077.stdout:42949672983 2026-02-17T11:51:08.966 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:09.163 INFO:teuthology.orchestra.run.trial077.stdout:42949672981 2026-02-17T11:51:09.166 INFO:teuthology.orchestra.run.trial077.stdout:38654705686 2026-02-17T11:51:09.168 INFO:teuthology.orchestra.run.trial077.stdout:38654705685 2026-02-17T11:51:09.171 INFO:teuthology.orchestra.run.trial077.stdout:42949672982 2026-02-17T11:51:09.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672982 got 42949672981 for osd.1 2026-02-17T11:51:09.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705688 got 38654705686 for osd.0 2026-02-17T11:51:09.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705687 got 38654705685 for osd.2 2026-02-17T11:51:09.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672983 got 42949672982 for osd.3 2026-02-17T11:51:10.173 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:10.177 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:10.178 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:10.182 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:10.335 INFO:teuthology.orchestra.run.trial077.stdout:42949672982 2026-02-17T11:51:10.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672982 got 42949672982 for osd.1 2026-02-17T11:51:10.345 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:10.375 INFO:teuthology.orchestra.run.trial077.stdout:38654705687 2026-02-17T11:51:10.375 INFO:teuthology.orchestra.run.trial077.stdout:42949672983 2026-02-17T11:51:10.380 INFO:teuthology.orchestra.run.trial077.stdout:38654705688 2026-02-17T11:51:10.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705687 got 38654705687 for osd.2 2026-02-17T11:51:10.385 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:10.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672983 got 42949672983 for osd.3 2026-02-17T11:51:10.389 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:10.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705688 got 38654705688 for osd.0 2026-02-17T11:51:10.391 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:10.391 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:51:10.587 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:51:10.588 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:51:10.596 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2026-02-17T11:51:09.339007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":112824,"kb_used_data":800,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374536,"statfs":{"total":386547056640,"available":386431524864,"internally_reserved":0,"allocated":819200,"data_stored":237036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.0","version":"0'0","reported_seq":3,"reported_epoch":23,"state":"creating+activating","last_fresh":"2026-02-17T11:50:58.795905+0000","last_change":"2026-02-17T11:50:58.795905+0000","last_active":"2026-02-17T11:50:57.790980+0000","last_peered":"2026-02-17T11:50:57.790980+0000","last_clean":"2026-02-17T11:50:57.790980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:50:58.795905+0000","last_undegraded":"2026-02-17T11:50:58.795905+0000","last_fullsized":"2026-02-17T11:50:58.795905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:57.790980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:57.790980+0000","last_clean_scrub_stamp":"2026-02-17T11:50:57.790980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T11:50:58.884226+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:50:58.884226+0000","last_peered":"2026-02-17T11:50:58.884226+0000","last_clean":"2026-02-17T11:50:58.884226+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:50:58.884226+0000","last_undegraded":"2026-02-17T11:50:58.884226+0000","last_fullsized":"2026-02-17T11:50:58.884226+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":204800,"data_stored":59259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":204800,"data_stored":59259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705687,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27168,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":204800,"data_stored":59259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705688,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":204800,"data_stored":59259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:51:10.597 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_3 2026-02-17T11:51:10.597 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2026-02-17T11:51:10.811 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_3' removed 2026-02-17T11:51:10.820 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_4 2026-02-17T11:51:10.820 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_4 1 2026-02-17T11:51:11.814 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_4' created 2026-02-17T11:51:11.827 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2026-02-17T11:51:12.817 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_4' 2026-02-17T11:51:13.830 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:51:13.990 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:51:13.991 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":26,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:51:12.814120+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"unique_pool_4","create_time":"2026-02-17T11:51:10.981653+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:51:14.001 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:51:14.002 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:51:14.002 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:51:14.003 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:51:14.090 INFO:teuthology.orchestra.run.trial077.stdout:38654705690 2026-02-17T11:51:14.090 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:14.091 INFO:teuthology.orchestra.run.trial077.stdout:42949672984 2026-02-17T11:51:14.091 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:14.092 INFO:teuthology.orchestra.run.trial077.stdout:38654705689 2026-02-17T11:51:14.094 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:14.095 INFO:teuthology.orchestra.run.trial077.stdout:42949672985 2026-02-17T11:51:14.096 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:14.250 INFO:teuthology.orchestra.run.trial077.stdout:38654705688 2026-02-17T11:51:14.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705690 got 38654705688 for osd.0 2026-02-17T11:51:14.295 INFO:teuthology.orchestra.run.trial077.stdout:38654705687 2026-02-17T11:51:14.296 INFO:teuthology.orchestra.run.trial077.stdout:42949672983 2026-02-17T11:51:14.300 INFO:teuthology.orchestra.run.trial077.stdout:42949672984 2026-02-17T11:51:14.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672984 got 42949672983 for osd.1 2026-02-17T11:51:14.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705689 got 38654705687 for osd.2 2026-02-17T11:51:14.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672985 got 42949672984 for osd.3 2026-02-17T11:51:15.261 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:15.308 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:15.308 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:15.311 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:15.428 INFO:teuthology.orchestra.run.trial077.stdout:38654705688 2026-02-17T11:51:15.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705690 got 38654705688 for osd.0 2026-02-17T11:51:15.467 INFO:teuthology.orchestra.run.trial077.stdout:42949672983 2026-02-17T11:51:15.472 INFO:teuthology.orchestra.run.trial077.stdout:38654705687 2026-02-17T11:51:15.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672984 got 42949672983 for osd.1 2026-02-17T11:51:15.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705689 got 38654705687 for osd.2 2026-02-17T11:51:15.508 INFO:teuthology.orchestra.run.trial077.stdout:42949672984 2026-02-17T11:51:15.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672985 got 42949672984 for osd.3 2026-02-17T11:51:16.440 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:16.478 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:16.483 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:16.518 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:16.603 INFO:teuthology.orchestra.run.trial077.stdout:38654705690 2026-02-17T11:51:16.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705690 got 38654705690 for osd.0 2026-02-17T11:51:16.614 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:16.642 INFO:teuthology.orchestra.run.trial077.stdout:38654705689 2026-02-17T11:51:16.650 INFO:teuthology.orchestra.run.trial077.stdout:42949672985 2026-02-17T11:51:16.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705689 got 38654705689 for osd.2 2026-02-17T11:51:16.655 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:16.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672984 got 42949672985 for osd.1 2026-02-17T11:51:16.661 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:16.683 INFO:teuthology.orchestra.run.trial077.stdout:42949672986 2026-02-17T11:51:16.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672985 got 42949672986 for osd.3 2026-02-17T11:51:16.694 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:16.694 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:51:16.888 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:51:16.888 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:51:16.897 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2026-02-17T11:51:15.339711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":112956,"kb_used_data":912,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374404,"statfs":{"total":386547056640,"available":386431389696,"internally_reserved":0,"allocated":933888,"data_stored":275908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"5.0","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"creating+activating","last_fresh":"2026-02-17T11:51:12.819087+0000","last_change":"2026-02-17T11:51:12.819087+0000","last_active":"2026-02-17T11:51:11.811069+0000","last_peered":"2026-02-17T11:51:11.811069+0000","last_clean":"2026-02-17T11:51:11.811069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:51:12.819087+0000","last_undegraded":"2026-02-17T11:51:12.819087+0000","last_fullsized":"2026-02-17T11:51:12.819087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:51:11.811069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:51:11.811069+0000","last_clean_scrub_stamp":"2026-02-17T11:51:11.811069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2026-02-17T11:51:12.952476+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:51:12.952476+0000","last_peered":"2026-02-17T11:51:12.952476+0000","last_clean":"2026-02-17T11:51:12.952476+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:51:12.952476+0000","last_undegraded":"2026-02-17T11:51:12.952476+0000","last_fullsized":"2026-02-17T11:51:12.952476+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672986,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":233472,"data_stored":68977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672985,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":233472,"data_stored":68977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705689,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27196,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":233472,"data_stored":68977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705690,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":233472,"data_stored":68977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:51:22.900 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:51:22.900 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:51:22.901 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:51:22.902 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:51:22.989 INFO:teuthology.orchestra.run.trial077.stdout:42949672987 2026-02-17T11:51:22.989 INFO:teuthology.orchestra.run.trial077.stdout:38654705691 2026-02-17T11:51:22.990 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:22.990 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:22.991 INFO:teuthology.orchestra.run.trial077.stdout:38654705692 2026-02-17T11:51:22.991 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:22.991 INFO:teuthology.orchestra.run.trial077.stdout:42949672988 2026-02-17T11:51:22.991 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:23.192 INFO:teuthology.orchestra.run.trial077.stdout:38654705690 2026-02-17T11:51:23.193 INFO:teuthology.orchestra.run.trial077.stdout:42949672987 2026-02-17T11:51:23.194 INFO:teuthology.orchestra.run.trial077.stdout:42949672986 2026-02-17T11:51:23.197 INFO:teuthology.orchestra.run.trial077.stdout:38654705691 2026-02-17T11:51:23.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.2 2026-02-17T11:51:23.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672988 got 42949672987 for osd.3 2026-02-17T11:51:23.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.0 2026-02-17T11:51:23.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672987 got 42949672986 for osd.1 2026-02-17T11:51:24.203 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:24.205 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:24.207 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:24.209 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:24.365 INFO:teuthology.orchestra.run.trial077.stdout:42949672988 2026-02-17T11:51:24.367 INFO:teuthology.orchestra.run.trial077.stdout:38654705691 2026-02-17T11:51:24.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672988 got 42949672988 for osd.3 2026-02-17T11:51:24.376 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:24.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705691 for osd.2 2026-02-17T11:51:24.377 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:24.407 INFO:teuthology.orchestra.run.trial077.stdout:38654705692 2026-02-17T11:51:24.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705692 for osd.0 2026-02-17T11:51:24.417 INFO:teuthology.orchestra.run.trial077.stdout:42949672987 2026-02-17T11:51:24.418 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:24.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672987 got 42949672987 for osd.1 2026-02-17T11:51:24.426 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:24.427 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:51:24.624 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:51:24.625 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:51:24.632 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2026-02-17T11:51:23.340449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":112956,"kb_used_data":912,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374404,"statfs":{"total":386547056640,"available":386431389696,"internally_reserved":0,"allocated":933888,"data_stored":275908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"5.0","version":"0'0","reported_seq":3,"reported_epoch":26,"state":"creating+activating","last_fresh":"2026-02-17T11:51:12.819087+0000","last_change":"2026-02-17T11:51:12.819087+0000","last_active":"2026-02-17T11:51:11.811069+0000","last_peered":"2026-02-17T11:51:11.811069+0000","last_clean":"2026-02-17T11:51:11.811069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:51:12.819087+0000","last_undegraded":"2026-02-17T11:51:12.819087+0000","last_fullsized":"2026-02-17T11:51:12.819087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:51:11.811069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:51:11.811069+0000","last_clean_scrub_stamp":"2026-02-17T11:51:11.811069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2026-02-17T11:51:12.952476+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:51:12.952476+0000","last_peered":"2026-02-17T11:51:12.952476+0000","last_clean":"2026-02-17T11:51:12.952476+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:51:12.952476+0000","last_undegraded":"2026-02-17T11:51:12.952476+0000","last_fullsized":"2026-02-17T11:51:12.952476+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672988,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":233472,"data_stored":68977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672987,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":233472,"data_stored":68977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705691,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27196,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":233472,"data_stored":68977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":233472,"data_stored":68977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:51:24.633 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_4 2026-02-17T11:51:24.633 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2026-02-17T11:51:24.831 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_4' removed 2026-02-17T11:51:24.841 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_5 2026-02-17T11:51:24.841 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_5 1 2026-02-17T11:51:25.835 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_5' created 2026-02-17T11:51:25.847 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_5 rados --yes-i-really-mean-it || true 2026-02-17T11:51:26.836 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_5' 2026-02-17T11:51:27.847 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:51:28.011 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:51:28.011 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":29,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:51:26.834299+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"unique_pool_5","create_time":"2026-02-17T11:51:25.001582+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:51:28.020 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:51:28.021 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:51:28.021 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:51:28.022 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:51:28.108 INFO:teuthology.orchestra.run.trial077.stdout:38654705694 2026-02-17T11:51:28.109 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:28.109 INFO:teuthology.orchestra.run.trial077.stdout:38654705693 2026-02-17T11:51:28.110 INFO:teuthology.orchestra.run.trial077.stdout:42949672990 2026-02-17T11:51:28.111 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:28.111 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:28.112 INFO:teuthology.orchestra.run.trial077.stdout:42949672989 2026-02-17T11:51:28.113 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:28.310 INFO:teuthology.orchestra.run.trial077.stdout:38654705692 2026-02-17T11:51:28.313 INFO:teuthology.orchestra.run.trial077.stdout:42949672988 2026-02-17T11:51:28.314 INFO:teuthology.orchestra.run.trial077.stdout:38654705693 2026-02-17T11:51:28.316 INFO:teuthology.orchestra.run.trial077.stdout:42949672989 2026-02-17T11:51:28.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2026-02-17T11:51:28.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.0 2026-02-17T11:51:28.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672989 got 42949672988 for osd.1 2026-02-17T11:51:28.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672990 got 42949672989 for osd.3 2026-02-17T11:51:29.321 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:29.324 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:29.324 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:29.327 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:29.483 INFO:teuthology.orchestra.run.trial077.stdout:38654705692 2026-02-17T11:51:29.485 INFO:teuthology.orchestra.run.trial077.stdout:38654705693 2026-02-17T11:51:29.491 INFO:teuthology.orchestra.run.trial077.stdout:42949672988 2026-02-17T11:51:29.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.2 2026-02-17T11:51:29.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.0 2026-02-17T11:51:29.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672989 got 42949672988 for osd.1 2026-02-17T11:51:29.523 INFO:teuthology.orchestra.run.trial077.stdout:42949672989 2026-02-17T11:51:29.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672990 got 42949672989 for osd.3 2026-02-17T11:51:30.495 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:30.497 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:30.502 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:30.533 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:30.657 INFO:teuthology.orchestra.run.trial077.stdout:38654705695 2026-02-17T11:51:30.657 INFO:teuthology.orchestra.run.trial077.stdout:38654705694 2026-02-17T11:51:30.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.0 2026-02-17T11:51:30.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705694 for osd.2 2026-02-17T11:51:30.668 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:30.668 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:30.698 INFO:teuthology.orchestra.run.trial077.stdout:42949672990 2026-02-17T11:51:30.701 INFO:teuthology.orchestra.run.trial077.stdout:42949672989 2026-02-17T11:51:30.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672990 got 42949672990 for osd.3 2026-02-17T11:51:30.708 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:30.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672989 got 42949672989 for osd.1 2026-02-17T11:51:30.711 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:30.711 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:51:30.905 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:51:30.905 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:51:30.913 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2026-02-17T11:51:29.341197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":113052,"kb_used_data":1024,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374308,"statfs":{"total":386547056640,"available":386431291392,"internally_reserved":0,"allocated":1048576,"data_stored":314748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:51:25.831378+0000","last_change":"2026-02-17T11:51:25.831378+0000","last_active":"2026-02-17T11:51:25.831378+0000","last_peered":"2026-02-17T11:51:25.831378+0000","last_clean":"2026-02-17T11:51:25.831378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:51:25.831378+0000","last_undegraded":"2026-02-17T11:51:25.831378+0000","last_fullsized":"2026-02-17T11:51:25.831378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:51:25.831378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:51:25.831378+0000","last_clean_scrub_stamp":"2026-02-17T11:51:25.831378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T11:51:26.884780+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:51:26.884780+0000","last_peered":"2026-02-17T11:51:26.884780+0000","last_clean":"2026-02-17T11:51:26.884780+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:51:26.884780+0000","last_undegraded":"2026-02-17T11:51:26.884780+0000","last_fullsized":"2026-02-17T11:51:26.884780+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31384,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":262144,"data_stored":78687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672989,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":262144,"data_stored":78687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":262144,"data_stored":78687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":262144,"data_stored":78687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:51:36.914 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:51:36.914 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:51:36.914 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:51:36.915 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:51:37.002 INFO:teuthology.orchestra.run.trial077.stdout:38654705696 2026-02-17T11:51:37.002 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:37.003 INFO:teuthology.orchestra.run.trial077.stdout:42949672992 2026-02-17T11:51:37.004 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:37.005 INFO:teuthology.orchestra.run.trial077.stdout:42949672993 2026-02-17T11:51:37.005 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:37.007 INFO:teuthology.orchestra.run.trial077.stdout:38654705697 2026-02-17T11:51:37.007 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:37.206 INFO:teuthology.orchestra.run.trial077.stdout:38654705695 2026-02-17T11:51:37.209 INFO:teuthology.orchestra.run.trial077.stdout:42949672991 2026-02-17T11:51:37.211 INFO:teuthology.orchestra.run.trial077.stdout:42949672992 2026-02-17T11:51:37.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705695 for osd.2 2026-02-17T11:51:37.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672991 for osd.1 2026-02-17T11:51:37.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672993 got 42949672992 for osd.3 2026-02-17T11:51:37.245 INFO:teuthology.orchestra.run.trial077.stdout:38654705696 2026-02-17T11:51:37.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705697 got 38654705696 for osd.0 2026-02-17T11:51:38.217 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:38.219 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:38.222 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:38.255 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:38.380 INFO:teuthology.orchestra.run.trial077.stdout:38654705696 2026-02-17T11:51:38.382 INFO:teuthology.orchestra.run.trial077.stdout:42949672992 2026-02-17T11:51:38.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705696 for osd.2 2026-02-17T11:51:38.392 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:38.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672992 for osd.1 2026-02-17T11:51:38.393 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:38.419 INFO:teuthology.orchestra.run.trial077.stdout:38654705697 2026-02-17T11:51:38.426 INFO:teuthology.orchestra.run.trial077.stdout:42949672993 2026-02-17T11:51:38.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705697 got 38654705697 for osd.0 2026-02-17T11:51:38.429 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:38.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672993 got 42949672993 for osd.3 2026-02-17T11:51:38.437 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:38.437 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:51:38.629 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:51:38.630 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:51:38.638 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2026-02-17T11:51:37.342070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":113052,"kb_used_data":1024,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374308,"statfs":{"total":386547056640,"available":386431291392,"internally_reserved":0,"allocated":1048576,"data_stored":314748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:51:25.831378+0000","last_change":"2026-02-17T11:51:25.831378+0000","last_active":"2026-02-17T11:51:25.831378+0000","last_peered":"2026-02-17T11:51:25.831378+0000","last_clean":"2026-02-17T11:51:25.831378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:51:25.831378+0000","last_undegraded":"2026-02-17T11:51:25.831378+0000","last_fullsized":"2026-02-17T11:51:25.831378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:51:25.831378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:51:25.831378+0000","last_clean_scrub_stamp":"2026-02-17T11:51:25.831378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-17T11:51:26.884780+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:51:26.884780+0000","last_peered":"2026-02-17T11:51:26.884780+0000","last_clean":"2026-02-17T11:51:26.884780+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:51:26.884780+0000","last_undegraded":"2026-02-17T11:51:26.884780+0000","last_fullsized":"2026-02-17T11:51:26.884780+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31384,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":262144,"data_stored":78687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672992,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":262144,"data_stored":78687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27224,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":262144,"data_stored":78687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705697,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":262144,"data_stored":78687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:51:38.639 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_5 2026-02-17T11:51:38.639 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_5 unique_pool_5 --yes-i-really-really-mean-it 2026-02-17T11:51:38.851 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_5' removed 2026-02-17T11:51:38.861 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_6 2026-02-17T11:51:38.861 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_6 1 2026-02-17T11:51:39.853 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_6' created 2026-02-17T11:51:39.864 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_6 rados --yes-i-really-mean-it || true 2026-02-17T11:51:40.856 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_6' 2026-02-17T11:51:41.869 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:51:42.031 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:51:42.031 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":32,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:51:40.853317+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"unique_pool_6","create_time":"2026-02-17T11:51:39.022281+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:51:42.041 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:51:42.041 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:51:42.042 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:51:42.042 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:51:42.131 INFO:teuthology.orchestra.run.trial077.stdout:38654705699 2026-02-17T11:51:42.132 INFO:teuthology.orchestra.run.trial077.stdout:38654705698 2026-02-17T11:51:42.133 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:42.133 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:42.134 INFO:teuthology.orchestra.run.trial077.stdout:42949672994 2026-02-17T11:51:42.135 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:42.136 INFO:teuthology.orchestra.run.trial077.stdout:42949672995 2026-02-17T11:51:42.136 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:42.336 INFO:teuthology.orchestra.run.trial077.stdout:42949672993 2026-02-17T11:51:42.341 INFO:teuthology.orchestra.run.trial077.stdout:38654705698 2026-02-17T11:51:42.342 INFO:teuthology.orchestra.run.trial077.stdout:38654705697 2026-02-17T11:51:42.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672994 got 42949672993 for osd.1 2026-02-17T11:51:42.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705697 for osd.2 2026-02-17T11:51:42.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705699 got 38654705698 for osd.0 2026-02-17T11:51:42.376 INFO:teuthology.orchestra.run.trial077.stdout:42949672994 2026-02-17T11:51:42.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.3 2026-02-17T11:51:43.347 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:43.352 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:43.353 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:43.385 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:43.511 INFO:teuthology.orchestra.run.trial077.stdout:42949672993 2026-02-17T11:51:43.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672994 got 42949672993 for osd.1 2026-02-17T11:51:43.549 INFO:teuthology.orchestra.run.trial077.stdout:38654705698 2026-02-17T11:51:43.551 INFO:teuthology.orchestra.run.trial077.stdout:38654705697 2026-02-17T11:51:43.556 INFO:teuthology.orchestra.run.trial077.stdout:42949672994 2026-02-17T11:51:43.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705699 got 38654705698 for osd.0 2026-02-17T11:51:43.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705697 for osd.2 2026-02-17T11:51:43.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672994 for osd.3 2026-02-17T11:51:44.523 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:44.560 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:44.562 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:44.567 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:44.686 INFO:teuthology.orchestra.run.trial077.stdout:42949672994 2026-02-17T11:51:44.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672994 got 42949672994 for osd.1 2026-02-17T11:51:44.697 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:44.724 INFO:teuthology.orchestra.run.trial077.stdout:42949672995 2026-02-17T11:51:44.727 INFO:teuthology.orchestra.run.trial077.stdout:38654705698 2026-02-17T11:51:44.732 INFO:teuthology.orchestra.run.trial077.stdout:38654705699 2026-02-17T11:51:44.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672995 got 42949672995 for osd.3 2026-02-17T11:51:44.734 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:44.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705698 for osd.2 2026-02-17T11:51:44.737 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:44.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705699 got 38654705699 for osd.0 2026-02-17T11:51:44.743 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:44.743 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:51:44.941 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:51:44.941 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:51:44.949 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2026-02-17T11:51:43.342775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":113116,"kb_used_data":1096,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374244,"statfs":{"total":386547056640,"available":386431225856,"internally_reserved":0,"allocated":1122304,"data_stored":336845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:51:39.851179+0000","last_change":"2026-02-17T11:51:39.851179+0000","last_active":"2026-02-17T11:51:39.851179+0000","last_peered":"2026-02-17T11:51:39.851179+0000","last_clean":"2026-02-17T11:51:39.851179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:51:39.851179+0000","last_undegraded":"2026-02-17T11:51:39.851179+0000","last_fullsized":"2026-02-17T11:51:39.851179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:51:39.851179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:51:39.851179+0000","last_clean_scrub_stamp":"2026-02-17T11:51:39.851179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T11:51:40.856936+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:51:40.856936+0000","last_peered":"2026-02-17T11:51:40.856936+0000","last_clean":"2026-02-17T11:51:40.856936+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:51:40.856936+0000","last_undegraded":"2026-02-17T11:51:40.856936+0000","last_fullsized":"2026-02-17T11:51:40.856936+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31404,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":282624,"data_stored":85056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":290816,"data_stored":88397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705698,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":274432,"data_stored":81696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":274432,"data_stored":81696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:51:50.951 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:51:50.952 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:51:50.952 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:51:50.953 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:51:51.041 INFO:teuthology.orchestra.run.trial077.stdout:42949672997 2026-02-17T11:51:51.042 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:51.043 INFO:teuthology.orchestra.run.trial077.stdout:38654705702 2026-02-17T11:51:51.043 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:51.044 INFO:teuthology.orchestra.run.trial077.stdout:38654705701 2026-02-17T11:51:51.045 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:51.046 INFO:teuthology.orchestra.run.trial077.stdout:42949672998 2026-02-17T11:51:51.046 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:51.243 INFO:teuthology.orchestra.run.trial077.stdout:42949672995 2026-02-17T11:51:51.244 INFO:teuthology.orchestra.run.trial077.stdout:38654705700 2026-02-17T11:51:51.250 INFO:teuthology.orchestra.run.trial077.stdout:42949672996 2026-02-17T11:51:51.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672997 got 42949672995 for osd.1 2026-02-17T11:51:51.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705701 got 38654705700 for osd.2 2026-02-17T11:51:51.254 INFO:teuthology.orchestra.run.trial077.stdout:38654705701 2026-02-17T11:51:51.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672998 got 42949672996 for osd.3 2026-02-17T11:51:51.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705702 got 38654705701 for osd.0 2026-02-17T11:51:52.253 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:52.254 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:52.261 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:52.265 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:52.422 INFO:teuthology.orchestra.run.trial077.stdout:38654705701 2026-02-17T11:51:52.423 INFO:teuthology.orchestra.run.trial077.stdout:42949672997 2026-02-17T11:51:52.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705701 got 38654705701 for osd.2 2026-02-17T11:51:52.433 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:52.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672997 got 42949672997 for osd.1 2026-02-17T11:51:52.434 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:52.459 INFO:teuthology.orchestra.run.trial077.stdout:38654705702 2026-02-17T11:51:52.460 INFO:teuthology.orchestra.run.trial077.stdout:42949672998 2026-02-17T11:51:52.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705702 got 38654705702 for osd.0 2026-02-17T11:51:52.470 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:52.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672998 got 42949672998 for osd.3 2026-02-17T11:51:52.470 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:52.471 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:51:52.665 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:51:52.665 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:51:52.674 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2026-02-17T11:51:51.343719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":113156,"kb_used_data":1136,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374204,"statfs":{"total":386547056640,"available":386431184896,"internally_reserved":0,"allocated":1163264,"data_stored":353588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:51:39.851179+0000","last_change":"2026-02-17T11:51:39.851179+0000","last_active":"2026-02-17T11:51:39.851179+0000","last_peered":"2026-02-17T11:51:39.851179+0000","last_clean":"2026-02-17T11:51:39.851179+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:51:39.851179+0000","last_undegraded":"2026-02-17T11:51:39.851179+0000","last_fullsized":"2026-02-17T11:51:39.851179+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:51:39.851179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:51:39.851179+0000","last_clean_scrub_stamp":"2026-02-17T11:51:39.851179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T11:51:40.856936+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:51:40.856936+0000","last_peered":"2026-02-17T11:51:40.856936+0000","last_clean":"2026-02-17T11:51:40.856936+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:51:40.856936+0000","last_undegraded":"2026-02-17T11:51:40.856936+0000","last_fullsized":"2026-02-17T11:51:40.856936+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31408,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":290816,"data_stored":88397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672997,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":290816,"data_stored":88397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705701,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":290816,"data_stored":88397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":290816,"data_stored":88397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:51:52.674 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_6 2026-02-17T11:51:52.674 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_6 unique_pool_6 --yes-i-really-really-mean-it 2026-02-17T11:51:52.870 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_6' removed 2026-02-17T11:51:52.879 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_7 2026-02-17T11:51:52.879 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_7 1 2026-02-17T11:51:53.873 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_7' created 2026-02-17T11:51:53.884 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_7 rados --yes-i-really-mean-it || true 2026-02-17T11:51:54.876 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_7' 2026-02-17T11:51:55.888 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:51:56.049 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:51:56.049 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":35,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:51:54.872762+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"unique_pool_7","create_time":"2026-02-17T11:51:53.039824+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:51:56.058 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:51:56.059 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:51:56.059 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:51:56.059 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:51:56.147 INFO:teuthology.orchestra.run.trial077.stdout:42949673000 2026-02-17T11:51:56.149 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:56.149 INFO:teuthology.orchestra.run.trial077.stdout:38654705704 2026-02-17T11:51:56.150 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:56.151 INFO:teuthology.orchestra.run.trial077.stdout:42949672999 2026-02-17T11:51:56.151 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:56.152 INFO:teuthology.orchestra.run.trial077.stdout:38654705703 2026-02-17T11:51:56.153 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:56.349 INFO:teuthology.orchestra.run.trial077.stdout:38654705703 2026-02-17T11:51:56.350 INFO:teuthology.orchestra.run.trial077.stdout:42949672999 2026-02-17T11:51:56.352 INFO:teuthology.orchestra.run.trial077.stdout:38654705702 2026-02-17T11:51:56.354 INFO:teuthology.orchestra.run.trial077.stdout:42949672998 2026-02-17T11:51:56.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705704 got 38654705703 for osd.0 2026-02-17T11:51:56.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673000 got 42949672999 for osd.3 2026-02-17T11:51:56.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705702 for osd.2 2026-02-17T11:51:56.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672999 got 42949672998 for osd.1 2026-02-17T11:51:57.361 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:57.362 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:57.364 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:57.365 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:57.524 INFO:teuthology.orchestra.run.trial077.stdout:42949672999 2026-02-17T11:51:57.527 INFO:teuthology.orchestra.run.trial077.stdout:38654705702 2026-02-17T11:51:57.527 INFO:teuthology.orchestra.run.trial077.stdout:38654705703 2026-02-17T11:51:57.529 INFO:teuthology.orchestra.run.trial077.stdout:42949672998 2026-02-17T11:51:57.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673000 got 42949672999 for osd.3 2026-02-17T11:51:57.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705702 for osd.2 2026-02-17T11:51:57.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705704 got 38654705703 for osd.0 2026-02-17T11:51:57.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672999 got 42949672998 for osd.1 2026-02-17T11:51:58.535 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:51:58.538 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:51:58.539 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:51:58.540 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:51:58.695 INFO:teuthology.orchestra.run.trial077.stdout:38654705703 2026-02-17T11:51:58.698 INFO:teuthology.orchestra.run.trial077.stdout:42949673000 2026-02-17T11:51:58.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705703 got 38654705703 for osd.2 2026-02-17T11:51:58.707 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:58.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673000 got 42949673000 for osd.3 2026-02-17T11:51:58.709 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:58.737 INFO:teuthology.orchestra.run.trial077.stdout:38654705704 2026-02-17T11:51:58.739 INFO:teuthology.orchestra.run.trial077.stdout:42949672999 2026-02-17T11:51:58.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705704 got 38654705704 for osd.0 2026-02-17T11:51:58.747 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:58.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672999 got 42949672999 for osd.1 2026-02-17T11:51:58.749 DEBUG:teuthology.parallel:result is None 2026-02-17T11:51:58.749 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:51:58.945 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:51:58.946 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:51:58.953 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2026-02-17T11:51:57.344454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":113276,"kb_used_data":1240,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374084,"statfs":{"total":386547056640,"available":386431062016,"internally_reserved":0,"allocated":1269760,"data_stored":389111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"8.0","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2026-02-17T11:51:54.877269+0000","last_change":"2026-02-17T11:51:54.877269+0000","last_active":"2026-02-17T11:51:53.869826+0000","last_peered":"2026-02-17T11:51:53.869826+0000","last_clean":"2026-02-17T11:51:53.869826+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:51:54.877269+0000","last_undegraded":"2026-02-17T11:51:54.877269+0000","last_fullsized":"2026-02-17T11:51:54.877269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:51:53.869826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:51:53.869826+0000","last_clean_scrub_stamp":"2026-02-17T11:51:53.869826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:51:55.207211+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:51:55.207211+0000","last_peered":"2026-02-17T11:51:55.207211+0000","last_clean":"2026-02-17T11:51:55.207211+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:51:55.207211+0000","last_undegraded":"2026-02-17T11:51:55.207211+0000","last_fullsized":"2026-02-17T11:51:55.207211+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":319488,"data_stored":98115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672999,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":311296,"data_stored":94766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705703,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27280,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":319488,"data_stored":98115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":319488,"data_stored":98115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:52:04.955 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:52:04.956 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:52:04.956 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:52:04.957 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:52:05.045 INFO:teuthology.orchestra.run.trial077.stdout:38654705706 2026-02-17T11:52:05.046 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:05.047 INFO:teuthology.orchestra.run.trial077.stdout:42949673002 2026-02-17T11:52:05.047 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:05.048 INFO:teuthology.orchestra.run.trial077.stdout:38654705707 2026-02-17T11:52:05.049 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:05.050 INFO:teuthology.orchestra.run.trial077.stdout:42949673003 2026-02-17T11:52:05.050 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:05.246 INFO:teuthology.orchestra.run.trial077.stdout:42949673001 2026-02-17T11:52:05.249 INFO:teuthology.orchestra.run.trial077.stdout:42949673000 2026-02-17T11:52:05.251 INFO:teuthology.orchestra.run.trial077.stdout:38654705705 2026-02-17T11:52:05.253 INFO:teuthology.orchestra.run.trial077.stdout:38654705704 2026-02-17T11:52:05.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673003 got 42949673001 for osd.3 2026-02-17T11:52:05.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673002 got 42949673000 for osd.1 2026-02-17T11:52:05.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705707 got 38654705705 for osd.0 2026-02-17T11:52:05.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705706 got 38654705704 for osd.2 2026-02-17T11:52:06.257 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:06.261 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:06.264 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:06.265 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:06.416 INFO:teuthology.orchestra.run.trial077.stdout:42949673003 2026-02-17T11:52:06.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673003 got 42949673003 for osd.3 2026-02-17T11:52:06.426 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:06.461 INFO:teuthology.orchestra.run.trial077.stdout:42949673002 2026-02-17T11:52:06.463 INFO:teuthology.orchestra.run.trial077.stdout:38654705706 2026-02-17T11:52:06.464 INFO:teuthology.orchestra.run.trial077.stdout:38654705707 2026-02-17T11:52:06.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673002 got 42949673002 for osd.1 2026-02-17T11:52:06.470 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:06.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705706 got 38654705706 for osd.2 2026-02-17T11:52:06.473 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:06.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705707 got 38654705707 for osd.0 2026-02-17T11:52:06.475 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:06.475 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:52:06.671 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:52:06.672 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:52:06.680 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2026-02-17T11:52:05.345300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":113288,"kb_used_data":1248,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377374072,"statfs":{"total":386547056640,"available":386431049728,"internally_reserved":0,"allocated":1277952,"data_stored":392460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"8.0","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2026-02-17T11:51:54.877269+0000","last_change":"2026-02-17T11:51:54.877269+0000","last_active":"2026-02-17T11:51:53.869826+0000","last_peered":"2026-02-17T11:51:53.869826+0000","last_clean":"2026-02-17T11:51:53.869826+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:51:54.877269+0000","last_undegraded":"2026-02-17T11:51:54.877269+0000","last_fullsized":"2026-02-17T11:51:54.877269+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:51:53.869826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:51:53.869826+0000","last_clean_scrub_stamp":"2026-02-17T11:51:53.869826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2026-02-17T11:51:55.207211+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:51:55.207211+0000","last_peered":"2026-02-17T11:51:55.207211+0000","last_clean":"2026-02-17T11:51:55.207211+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:51:55.207211+0000","last_undegraded":"2026-02-17T11:51:55.207211+0000","last_fullsized":"2026-02-17T11:51:55.207211+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673003,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":319488,"data_stored":98115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":319488,"data_stored":98115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705706,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27280,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":319488,"data_stored":98115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705707,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":319488,"data_stored":98115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:52:06.680 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_7 2026-02-17T11:52:06.681 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_7 unique_pool_7 --yes-i-really-really-mean-it 2026-02-17T11:52:06.888 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_7' removed 2026-02-17T11:52:06.898 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_8 2026-02-17T11:52:06.898 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_8 1 2026-02-17T11:52:07.892 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_8' created 2026-02-17T11:52:07.904 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_8 rados --yes-i-really-mean-it || true 2026-02-17T11:52:08.894 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_8' 2026-02-17T11:52:09.904 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:52:10.065 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:52:10.065 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":38,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:52:08.892085+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"unique_pool_8","create_time":"2026-02-17T11:52:07.059376+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:52:10.075 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:52:10.075 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:52:10.076 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:52:10.076 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:52:10.163 INFO:teuthology.orchestra.run.trial077.stdout:42949673005 2026-02-17T11:52:10.163 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:10.164 INFO:teuthology.orchestra.run.trial077.stdout:38654705708 2026-02-17T11:52:10.164 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:10.164 INFO:teuthology.orchestra.run.trial077.stdout:38654705709 2026-02-17T11:52:10.165 INFO:teuthology.orchestra.run.trial077.stdout:42949673004 2026-02-17T11:52:10.165 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:10.165 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:10.363 INFO:teuthology.orchestra.run.trial077.stdout:38654705707 2026-02-17T11:52:10.365 INFO:teuthology.orchestra.run.trial077.stdout:42949673002 2026-02-17T11:52:10.369 INFO:teuthology.orchestra.run.trial077.stdout:42949673003 2026-02-17T11:52:10.372 INFO:teuthology.orchestra.run.trial077.stdout:38654705708 2026-02-17T11:52:10.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705708 got 38654705707 for osd.2 2026-02-17T11:52:10.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673004 got 42949673002 for osd.1 2026-02-17T11:52:10.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673005 got 42949673003 for osd.3 2026-02-17T11:52:10.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705709 got 38654705708 for osd.0 2026-02-17T11:52:11.374 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:11.375 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:11.380 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:11.383 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:11.535 INFO:teuthology.orchestra.run.trial077.stdout:38654705707 2026-02-17T11:52:11.540 INFO:teuthology.orchestra.run.trial077.stdout:42949673002 2026-02-17T11:52:11.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705708 got 38654705707 for osd.2 2026-02-17T11:52:11.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673004 got 42949673002 for osd.1 2026-02-17T11:52:11.581 INFO:teuthology.orchestra.run.trial077.stdout:38654705708 2026-02-17T11:52:11.581 INFO:teuthology.orchestra.run.trial077.stdout:42949673003 2026-02-17T11:52:11.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705709 got 38654705708 for osd.0 2026-02-17T11:52:11.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673005 got 42949673003 for osd.3 2026-02-17T11:52:12.546 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:12.551 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:12.593 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:12.595 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:12.711 INFO:teuthology.orchestra.run.trial077.stdout:38654705708 2026-02-17T11:52:12.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705708 got 38654705708 for osd.2 2026-02-17T11:52:12.722 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:12.749 INFO:teuthology.orchestra.run.trial077.stdout:42949673004 2026-02-17T11:52:12.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673004 got 42949673004 for osd.1 2026-02-17T11:52:12.760 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:12.793 INFO:teuthology.orchestra.run.trial077.stdout:38654705709 2026-02-17T11:52:12.797 INFO:teuthology.orchestra.run.trial077.stdout:42949673005 2026-02-17T11:52:12.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705709 got 38654705709 for osd.0 2026-02-17T11:52:12.803 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:12.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673005 got 42949673005 for osd.3 2026-02-17T11:52:12.807 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:12.808 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:52:13.007 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:52:13.008 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:52:13.015 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2026-02-17T11:52:11.345944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":113380,"kb_used_data":1352,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377373980,"statfs":{"total":386547056640,"available":386430955520,"internally_reserved":0,"allocated":1384448,"data_stored":427959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:52:07.889325+0000","last_change":"2026-02-17T11:52:07.889325+0000","last_active":"2026-02-17T11:52:07.889325+0000","last_peered":"2026-02-17T11:52:07.889325+0000","last_clean":"2026-02-17T11:52:07.889325+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:52:07.889325+0000","last_undegraded":"2026-02-17T11:52:07.889325+0000","last_fullsized":"2026-02-17T11:52:07.889325+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:52:07.889325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:52:07.889325+0000","last_clean_scrub_stamp":"2026-02-17T11:52:07.889325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-17T11:52:09.273904+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:52:09.273904+0000","last_peered":"2026-02-17T11:52:09.273904+0000","last_clean":"2026-02-17T11:52:09.273904+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:52:09.273904+0000","last_undegraded":"2026-02-17T11:52:09.273904+0000","last_fullsized":"2026-02-17T11:52:09.273904+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31468,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":348160,"data_stored":107825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673004,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":348160,"data_stored":107825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27300,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":339968,"data_stored":104484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":348160,"data_stored":107825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:52:19.017 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:52:19.018 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:52:19.018 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:52:19.018 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:52:19.107 INFO:teuthology.orchestra.run.trial077.stdout:42949673007 2026-02-17T11:52:19.107 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:19.108 INFO:teuthology.orchestra.run.trial077.stdout:38654705712 2026-02-17T11:52:19.109 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:19.110 INFO:teuthology.orchestra.run.trial077.stdout:42949673006 2026-02-17T11:52:19.110 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:19.112 INFO:teuthology.orchestra.run.trial077.stdout:38654705711 2026-02-17T11:52:19.113 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:19.312 INFO:teuthology.orchestra.run.trial077.stdout:42949673005 2026-02-17T11:52:19.314 INFO:teuthology.orchestra.run.trial077.stdout:38654705710 2026-02-17T11:52:19.317 INFO:teuthology.orchestra.run.trial077.stdout:42949673006 2026-02-17T11:52:19.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673006 got 42949673005 for osd.1 2026-02-17T11:52:19.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705712 got 38654705710 for osd.0 2026-02-17T11:52:19.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673007 got 42949673006 for osd.3 2026-02-17T11:52:19.352 INFO:teuthology.orchestra.run.trial077.stdout:38654705709 2026-02-17T11:52:19.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705711 got 38654705709 for osd.2 2026-02-17T11:52:20.322 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:20.324 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:20.329 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:20.362 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:20.486 INFO:teuthology.orchestra.run.trial077.stdout:38654705712 2026-02-17T11:52:20.492 INFO:teuthology.orchestra.run.trial077.stdout:42949673006 2026-02-17T11:52:20.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705712 got 38654705712 for osd.0 2026-02-17T11:52:20.496 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:20.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673006 got 42949673006 for osd.1 2026-02-17T11:52:20.501 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:20.528 INFO:teuthology.orchestra.run.trial077.stdout:42949673007 2026-02-17T11:52:20.528 INFO:teuthology.orchestra.run.trial077.stdout:38654705711 2026-02-17T11:52:20.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673007 got 42949673007 for osd.3 2026-02-17T11:52:20.539 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:20.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705711 got 38654705711 for osd.2 2026-02-17T11:52:20.539 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:20.540 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:52:20.735 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:52:20.736 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:52:20.743 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2026-02-17T11:52:19.346795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":113384,"kb_used_data":1360,"kb_used_omap":6,"kb_used_meta":111929,"kb_avail":377373976,"statfs":{"total":386547056640,"available":386430951424,"internally_reserved":0,"allocated":1392640,"data_stored":431300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":114616090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:52:07.889325+0000","last_change":"2026-02-17T11:52:07.889325+0000","last_active":"2026-02-17T11:52:07.889325+0000","last_peered":"2026-02-17T11:52:07.889325+0000","last_clean":"2026-02-17T11:52:07.889325+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:52:07.889325+0000","last_undegraded":"2026-02-17T11:52:07.889325+0000","last_fullsized":"2026-02-17T11:52:07.889325+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:52:07.889325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:52:07.889325+0000","last_clean_scrub_stamp":"2026-02-17T11:52:07.889325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-17T11:52:09.273904+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:52:09.273904+0000","last_peered":"2026-02-17T11:52:09.273904+0000","last_clean":"2026-02-17T11:52:09.273904+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:52:09.273904+0000","last_undegraded":"2026-02-17T11:52:09.273904+0000","last_fullsized":"2026-02-17T11:52:09.273904+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673007,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31468,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":348160,"data_stored":107825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673006,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":348160,"data_stored":107825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705711,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27304,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":348160,"data_stored":107825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":348160,"data_stored":107825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:52:20.744 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_8 2026-02-17T11:52:20.744 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_8 unique_pool_8 --yes-i-really-really-mean-it 2026-02-17T11:52:20.909 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_8' removed 2026-02-17T11:52:20.917 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_9 2026-02-17T11:52:20.917 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_9 1 2026-02-17T11:52:21.912 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_9' created 2026-02-17T11:52:21.925 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_9 rados --yes-i-really-mean-it || true 2026-02-17T11:52:22.913 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_9' 2026-02-17T11:52:23.924 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:52:24.082 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:52:24.082 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":41,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:52:22.911750+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"unique_pool_9","create_time":"2026-02-17T11:52:21.078697+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:52:24.091 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:52:24.091 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:52:24.092 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:52:24.092 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:52:24.178 INFO:teuthology.orchestra.run.trial077.stdout:38654705714 2026-02-17T11:52:24.178 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:24.179 INFO:teuthology.orchestra.run.trial077.stdout:38654705713 2026-02-17T11:52:24.179 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:24.179 INFO:teuthology.orchestra.run.trial077.stdout:42949673008 2026-02-17T11:52:24.180 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:24.184 INFO:teuthology.orchestra.run.trial077.stdout:42949673009 2026-02-17T11:52:24.184 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:24.344 INFO:teuthology.orchestra.run.trial077.stdout:38654705711 2026-02-17T11:52:24.350 INFO:teuthology.orchestra.run.trial077.stdout:38654705712 2026-02-17T11:52:24.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705713 got 38654705711 for osd.2 2026-02-17T11:52:24.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705714 got 38654705712 for osd.0 2026-02-17T11:52:24.388 INFO:teuthology.orchestra.run.trial077.stdout:42949673007 2026-02-17T11:52:24.390 INFO:teuthology.orchestra.run.trial077.stdout:42949673008 2026-02-17T11:52:24.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673008 got 42949673007 for osd.1 2026-02-17T11:52:24.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673009 got 42949673008 for osd.3 2026-02-17T11:52:25.355 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:25.361 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:25.398 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:25.400 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:25.517 INFO:teuthology.orchestra.run.trial077.stdout:38654705711 2026-02-17T11:52:25.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705713 got 38654705711 for osd.2 2026-02-17T11:52:25.559 INFO:teuthology.orchestra.run.trial077.stdout:38654705712 2026-02-17T11:52:25.560 INFO:teuthology.orchestra.run.trial077.stdout:42949673008 2026-02-17T11:52:25.563 INFO:teuthology.orchestra.run.trial077.stdout:42949673007 2026-02-17T11:52:25.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705714 got 38654705712 for osd.0 2026-02-17T11:52:25.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673009 got 42949673008 for osd.3 2026-02-17T11:52:25.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673008 got 42949673007 for osd.1 2026-02-17T11:52:26.527 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:26.570 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:26.571 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:26.575 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:26.689 INFO:teuthology.orchestra.run.trial077.stdout:38654705713 2026-02-17T11:52:26.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705713 got 38654705713 for osd.2 2026-02-17T11:52:26.700 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:26.732 INFO:teuthology.orchestra.run.trial077.stdout:42949673010 2026-02-17T11:52:26.733 INFO:teuthology.orchestra.run.trial077.stdout:38654705714 2026-02-17T11:52:26.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673009 got 42949673010 for osd.3 2026-02-17T11:52:26.744 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:26.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705714 got 38654705714 for osd.0 2026-02-17T11:52:26.744 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:26.773 INFO:teuthology.orchestra.run.trial077.stdout:42949673009 2026-02-17T11:52:26.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673008 got 42949673009 for osd.1 2026-02-17T11:52:26.782 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:26.782 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:52:26.978 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:52:26.979 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:52:26.987 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2026-02-17T11:52:25.347605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":117648,"kb_used_data":1456,"kb_used_omap":6,"kb_used_meta":116089,"kb_avail":377369712,"statfs":{"total":386547056640,"available":386426585088,"internally_reserved":0,"allocated":1490944,"data_stored":463474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":118875930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"10.0","version":"0'0","reported_seq":3,"reported_epoch":41,"state":"creating+activating","last_fresh":"2026-02-17T11:52:22.913322+0000","last_change":"2026-02-17T11:52:22.913322+0000","last_active":"2026-02-17T11:52:21.909073+0000","last_peered":"2026-02-17T11:52:21.909073+0000","last_clean":"2026-02-17T11:52:21.909073+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:52:22.913322+0000","last_undegraded":"2026-02-17T11:52:22.913322+0000","last_fullsized":"2026-02-17T11:52:22.913322+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:52:21.909073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:52:21.909073+0000","last_clean_scrub_stamp":"2026-02-17T11:52:21.909073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":68,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-17T11:52:23.419992+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:52:23.419992+0000","last_peered":"2026-02-17T11:52:23.419992+0000","last_clean":"2026-02-17T11:52:23.419992+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:52:23.419992+0000","last_undegraded":"2026-02-17T11:52:23.419992+0000","last_fullsized":"2026-02-17T11:52:23.419992+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31488,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":368640,"data_stored":114194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673009,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":368640,"data_stored":114194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705713,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":376832,"data_stored":117543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":117543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:52:32.989 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:52:32.990 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:52:32.990 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:52:32.990 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:52:33.079 INFO:teuthology.orchestra.run.trial077.stdout:38654705716 2026-02-17T11:52:33.080 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:33.081 INFO:teuthology.orchestra.run.trial077.stdout:42949673011 2026-02-17T11:52:33.081 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:33.082 INFO:teuthology.orchestra.run.trial077.stdout:42949673012 2026-02-17T11:52:33.082 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:33.083 INFO:teuthology.orchestra.run.trial077.stdout:38654705715 2026-02-17T11:52:33.084 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:33.279 INFO:teuthology.orchestra.run.trial077.stdout:38654705715 2026-02-17T11:52:33.280 INFO:teuthology.orchestra.run.trial077.stdout:42949673011 2026-02-17T11:52:33.282 INFO:teuthology.orchestra.run.trial077.stdout:42949673010 2026-02-17T11:52:33.284 INFO:teuthology.orchestra.run.trial077.stdout:38654705714 2026-02-17T11:52:33.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673012 got 42949673011 for osd.3 2026-02-17T11:52:33.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705716 got 38654705715 for osd.0 2026-02-17T11:52:33.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673011 got 42949673010 for osd.1 2026-02-17T11:52:33.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705715 got 38654705714 for osd.2 2026-02-17T11:52:34.291 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:34.292 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:34.294 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:34.296 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:34.452 INFO:teuthology.orchestra.run.trial077.stdout:42949673011 2026-02-17T11:52:34.454 INFO:teuthology.orchestra.run.trial077.stdout:38654705716 2026-02-17T11:52:34.456 INFO:teuthology.orchestra.run.trial077.stdout:42949673012 2026-02-17T11:52:34.459 INFO:teuthology.orchestra.run.trial077.stdout:38654705715 2026-02-17T11:52:34.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673011 got 42949673011 for osd.1 2026-02-17T11:52:34.464 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:34.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705716 got 38654705716 for osd.0 2026-02-17T11:52:34.465 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:34.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673012 got 42949673012 for osd.3 2026-02-17T11:52:34.468 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:34.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705715 got 38654705715 for osd.2 2026-02-17T11:52:34.471 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:34.471 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:52:34.665 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:52:34.666 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:52:34.673 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2026-02-17T11:52:33.348471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":117656,"kb_used_data":1472,"kb_used_omap":6,"kb_used_meta":116089,"kb_avail":377369704,"statfs":{"total":386547056640,"available":386426576896,"internally_reserved":0,"allocated":1507328,"data_stored":470172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":118875930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"10.0","version":"0'0","reported_seq":3,"reported_epoch":41,"state":"creating+activating","last_fresh":"2026-02-17T11:52:22.913322+0000","last_change":"2026-02-17T11:52:22.913322+0000","last_active":"2026-02-17T11:52:21.909073+0000","last_peered":"2026-02-17T11:52:21.909073+0000","last_clean":"2026-02-17T11:52:21.909073+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:52:22.913322+0000","last_undegraded":"2026-02-17T11:52:22.913322+0000","last_fullsized":"2026-02-17T11:52:22.913322+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:52:21.909073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:52:21.909073+0000","last_clean_scrub_stamp":"2026-02-17T11:52:21.909073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":68,"reported_epoch":41,"state":"active+clean","last_fresh":"2026-02-17T11:52:23.419992+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:52:23.419992+0000","last_peered":"2026-02-17T11:52:23.419992+0000","last_clean":"2026-02-17T11:52:23.419992+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:52:23.419992+0000","last_undegraded":"2026-02-17T11:52:23.419992+0000","last_fullsized":"2026-02-17T11:52:23.419992+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673012,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31492,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":376832,"data_stored":117543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":376832,"data_stored":117543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":376832,"data_stored":117543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":376832,"data_stored":117543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:52:34.674 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_9 2026-02-17T11:52:34.674 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_9 unique_pool_9 --yes-i-really-really-mean-it 2026-02-17T11:52:34.928 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_9' removed 2026-02-17T11:52:34.938 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_10 2026-02-17T11:52:34.938 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_10 1 2026-02-17T11:52:35.930 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_10' created 2026-02-17T11:52:35.941 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_10 rados --yes-i-really-mean-it || true 2026-02-17T11:52:36.933 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_10' 2026-02-17T11:52:37.946 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:52:38.105 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:52:38.105 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":44,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:52:36.930055+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"unique_pool_10","create_time":"2026-02-17T11:52:35.100343+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:52:38.114 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:52:38.114 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:52:38.115 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:52:38.115 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:52:38.201 INFO:teuthology.orchestra.run.trial077.stdout:42949673013 2026-02-17T11:52:38.202 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:38.203 INFO:teuthology.orchestra.run.trial077.stdout:38654705718 2026-02-17T11:52:38.203 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:38.204 INFO:teuthology.orchestra.run.trial077.stdout:38654705717 2026-02-17T11:52:38.205 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:38.206 INFO:teuthology.orchestra.run.trial077.stdout:42949673014 2026-02-17T11:52:38.206 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:38.401 INFO:teuthology.orchestra.run.trial077.stdout:42949673012 2026-02-17T11:52:38.405 INFO:teuthology.orchestra.run.trial077.stdout:38654705716 2026-02-17T11:52:38.408 INFO:teuthology.orchestra.run.trial077.stdout:38654705717 2026-02-17T11:52:38.409 INFO:teuthology.orchestra.run.trial077.stdout:42949673013 2026-02-17T11:52:38.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673013 got 42949673012 for osd.1 2026-02-17T11:52:38.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705717 got 38654705716 for osd.2 2026-02-17T11:52:38.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705718 got 38654705717 for osd.0 2026-02-17T11:52:38.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673014 got 42949673013 for osd.3 2026-02-17T11:52:39.413 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:39.415 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:39.420 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:39.420 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:39.576 INFO:teuthology.orchestra.run.trial077.stdout:42949673012 2026-02-17T11:52:39.581 INFO:teuthology.orchestra.run.trial077.stdout:38654705716 2026-02-17T11:52:39.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673013 got 42949673012 for osd.1 2026-02-17T11:52:39.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705717 got 38654705716 for osd.2 2026-02-17T11:52:39.615 INFO:teuthology.orchestra.run.trial077.stdout:38654705717 2026-02-17T11:52:39.617 INFO:teuthology.orchestra.run.trial077.stdout:42949673013 2026-02-17T11:52:39.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705718 got 38654705717 for osd.0 2026-02-17T11:52:39.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673014 got 42949673013 for osd.3 2026-02-17T11:52:40.588 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:40.594 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:40.627 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:40.628 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:40.750 INFO:teuthology.orchestra.run.trial077.stdout:42949673013 2026-02-17T11:52:40.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673013 got 42949673013 for osd.1 2026-02-17T11:52:40.761 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:40.789 INFO:teuthology.orchestra.run.trial077.stdout:38654705718 2026-02-17T11:52:40.790 INFO:teuthology.orchestra.run.trial077.stdout:38654705719 2026-02-17T11:52:40.794 INFO:teuthology.orchestra.run.trial077.stdout:42949673014 2026-02-17T11:52:40.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705717 got 38654705718 for osd.2 2026-02-17T11:52:40.799 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:40.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705718 got 38654705719 for osd.0 2026-02-17T11:52:40.800 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:40.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673014 got 42949673014 for osd.3 2026-02-17T11:52:40.805 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:40.805 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:52:40.999 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:52:40.999 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:52:41.008 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2026-02-17T11:52:39.349124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":117768,"kb_used_data":1576,"kb_used_omap":6,"kb_used_meta":116089,"kb_avail":377369592,"statfs":{"total":386547056640,"available":386426462208,"internally_reserved":0,"allocated":1613824,"data_stored":505682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":118875930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:52:35.928113+0000","last_change":"2026-02-17T11:52:35.928113+0000","last_active":"2026-02-17T11:52:35.928113+0000","last_peered":"2026-02-17T11:52:35.928113+0000","last_clean":"2026-02-17T11:52:35.928113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:52:35.928113+0000","last_undegraded":"2026-02-17T11:52:35.928113+0000","last_fullsized":"2026-02-17T11:52:35.928113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:52:35.928113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:52:35.928113+0000","last_clean_scrub_stamp":"2026-02-17T11:52:35.928113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":74,"reported_epoch":44,"state":"active+clean","last_fresh":"2026-02-17T11:52:37.788736+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:52:37.788736+0000","last_peered":"2026-02-17T11:52:37.788736+0000","last_clean":"2026-02-17T11:52:37.788736+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:52:37.788736+0000","last_undegraded":"2026-02-17T11:52:37.788736+0000","last_fullsized":"2026-02-17T11:52:37.788736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673014,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31524,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":405504,"data_stored":127256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673013,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":397312,"data_stored":123914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705718,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27360,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":405504,"data_stored":127256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":405504,"data_stored":127256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:52:47.009 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:52:47.010 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:52:47.010 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:52:47.011 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:52:47.099 INFO:teuthology.orchestra.run.trial077.stdout:42949673017 2026-02-17T11:52:47.100 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:47.101 INFO:teuthology.orchestra.run.trial077.stdout:38654705720 2026-02-17T11:52:47.102 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:47.103 INFO:teuthology.orchestra.run.trial077.stdout:42949673016 2026-02-17T11:52:47.103 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:47.104 INFO:teuthology.orchestra.run.trial077.stdout:38654705721 2026-02-17T11:52:47.104 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:47.299 INFO:teuthology.orchestra.run.trial077.stdout:42949673016 2026-02-17T11:52:47.302 INFO:teuthology.orchestra.run.trial077.stdout:42949673015 2026-02-17T11:52:47.304 INFO:teuthology.orchestra.run.trial077.stdout:38654705719 2026-02-17T11:52:47.305 INFO:teuthology.orchestra.run.trial077.stdout:38654705720 2026-02-17T11:52:47.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673017 got 42949673016 for osd.3 2026-02-17T11:52:47.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673016 got 42949673015 for osd.1 2026-02-17T11:52:47.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705720 got 38654705719 for osd.2 2026-02-17T11:52:47.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705721 got 38654705720 for osd.0 2026-02-17T11:52:48.311 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:48.313 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:48.316 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:48.317 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:48.484 INFO:teuthology.orchestra.run.trial077.stdout:42949673017 2026-02-17T11:52:48.487 INFO:teuthology.orchestra.run.trial077.stdout:42949673016 2026-02-17T11:52:48.491 INFO:teuthology.orchestra.run.trial077.stdout:38654705720 2026-02-17T11:52:48.494 INFO:teuthology.orchestra.run.trial077.stdout:38654705721 2026-02-17T11:52:48.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673017 got 42949673017 for osd.3 2026-02-17T11:52:48.495 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:48.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673016 got 42949673016 for osd.1 2026-02-17T11:52:48.498 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:48.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705720 got 38654705720 for osd.2 2026-02-17T11:52:48.501 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:48.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705721 got 38654705721 for osd.0 2026-02-17T11:52:48.505 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:48.505 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:52:48.702 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:52:48.702 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:52:48.711 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2026-02-17T11:52:47.349967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":117772,"kb_used_data":1584,"kb_used_omap":6,"kb_used_meta":116089,"kb_avail":377369588,"statfs":{"total":386547056640,"available":386426458112,"internally_reserved":0,"allocated":1622016,"data_stored":509024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":118875930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:52:35.928113+0000","last_change":"2026-02-17T11:52:35.928113+0000","last_active":"2026-02-17T11:52:35.928113+0000","last_peered":"2026-02-17T11:52:35.928113+0000","last_clean":"2026-02-17T11:52:35.928113+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:52:35.928113+0000","last_undegraded":"2026-02-17T11:52:35.928113+0000","last_fullsized":"2026-02-17T11:52:35.928113+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:52:35.928113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:52:35.928113+0000","last_clean_scrub_stamp":"2026-02-17T11:52:35.928113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":74,"reported_epoch":44,"state":"active+clean","last_fresh":"2026-02-17T11:52:37.788736+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:52:37.788736+0000","last_peered":"2026-02-17T11:52:37.788736+0000","last_clean":"2026-02-17T11:52:37.788736+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:52:37.788736+0000","last_undegraded":"2026-02-17T11:52:37.788736+0000","last_fullsized":"2026-02-17T11:52:37.788736+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673017,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31524,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":405504,"data_stored":127256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":405504,"data_stored":127256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705720,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27360,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":405504,"data_stored":127256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":405504,"data_stored":127256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:52:48.712 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_10 2026-02-17T11:52:48.712 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_10 unique_pool_10 --yes-i-really-really-mean-it 2026-02-17T11:52:48.947 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_10' removed 2026-02-17T11:52:48.957 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_11 2026-02-17T11:52:48.957 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_11 1 2026-02-17T11:52:49.951 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_11' created 2026-02-17T11:52:49.961 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_11 rados --yes-i-really-mean-it || true 2026-02-17T11:52:50.954 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_11' 2026-02-17T11:52:51.966 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:52:52.123 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:52:52.123 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":47,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:52:50.950694+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"unique_pool_11","create_time":"2026-02-17T11:52:49.116773+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:52:52.133 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:52:52.133 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:52:52.134 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:52:52.134 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:52:52.221 INFO:teuthology.orchestra.run.trial077.stdout:38654705723 2026-02-17T11:52:52.221 INFO:teuthology.orchestra.run.trial077.stdout:38654705722 2026-02-17T11:52:52.222 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:52.223 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:52.224 INFO:teuthology.orchestra.run.trial077.stdout:42949673019 2026-02-17T11:52:52.224 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:52.225 INFO:teuthology.orchestra.run.trial077.stdout:42949673018 2026-02-17T11:52:52.225 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:52.424 INFO:teuthology.orchestra.run.trial077.stdout:38654705721 2026-02-17T11:52:52.426 INFO:teuthology.orchestra.run.trial077.stdout:38654705722 2026-02-17T11:52:52.428 INFO:teuthology.orchestra.run.trial077.stdout:42949673018 2026-02-17T11:52:52.428 INFO:teuthology.orchestra.run.trial077.stdout:42949673017 2026-02-17T11:52:52.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705722 got 38654705721 for osd.2 2026-02-17T11:52:52.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705723 got 38654705722 for osd.0 2026-02-17T11:52:52.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673019 got 42949673018 for osd.3 2026-02-17T11:52:52.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673018 got 42949673017 for osd.1 2026-02-17T11:52:53.436 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:53.437 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:53.439 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:53.439 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:53.605 INFO:teuthology.orchestra.run.trial077.stdout:38654705721 2026-02-17T11:52:53.605 INFO:teuthology.orchestra.run.trial077.stdout:38654705722 2026-02-17T11:52:53.610 INFO:teuthology.orchestra.run.trial077.stdout:42949673018 2026-02-17T11:52:53.612 INFO:teuthology.orchestra.run.trial077.stdout:42949673017 2026-02-17T11:52:53.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705723 got 38654705722 for osd.0 2026-02-17T11:52:53.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705722 got 38654705721 for osd.2 2026-02-17T11:52:53.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673019 got 42949673018 for osd.3 2026-02-17T11:52:53.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673018 got 42949673017 for osd.1 2026-02-17T11:52:54.616 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:52:54.616 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:52:54.620 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:52:54.622 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:52:54.775 INFO:teuthology.orchestra.run.trial077.stdout:38654705723 2026-02-17T11:52:54.782 INFO:teuthology.orchestra.run.trial077.stdout:38654705722 2026-02-17T11:52:54.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705723 got 38654705723 for osd.0 2026-02-17T11:52:54.787 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:54.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705722 got 38654705722 for osd.2 2026-02-17T11:52:54.792 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:54.816 INFO:teuthology.orchestra.run.trial077.stdout:42949673018 2026-02-17T11:52:54.821 INFO:teuthology.orchestra.run.trial077.stdout:42949673019 2026-02-17T11:52:54.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673018 got 42949673018 for osd.1 2026-02-17T11:52:54.826 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:54.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673019 got 42949673019 for osd.3 2026-02-17T11:52:54.831 DEBUG:teuthology.parallel:result is None 2026-02-17T11:52:54.831 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:52:55.028 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:52:55.028 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:52:55.036 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2026-02-17T11:52:53.350676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":117880,"kb_used_data":1696,"kb_used_omap":6,"kb_used_meta":116089,"kb_avail":377369480,"statfs":{"total":386547056640,"available":386426347520,"internally_reserved":0,"allocated":1736704,"data_stored":547880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":118875930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:52:49.947530+0000","last_change":"2026-02-17T11:52:49.947530+0000","last_active":"2026-02-17T11:52:49.947530+0000","last_peered":"2026-02-17T11:52:49.947530+0000","last_clean":"2026-02-17T11:52:49.947530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:52:49.947530+0000","last_undegraded":"2026-02-17T11:52:49.947530+0000","last_fullsized":"2026-02-17T11:52:49.947530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:52:49.947530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:52:49.947530+0000","last_clean_scrub_stamp":"2026-02-17T11:52:49.947530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":80,"reported_epoch":47,"state":"active+clean","last_fresh":"2026-02-17T11:52:51.088697+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:52:51.088697+0000","last_peered":"2026-02-17T11:52:51.088697+0000","last_clean":"2026-02-17T11:52:51.088697+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:52:51.088697+0000","last_undegraded":"2026-02-17T11:52:51.088697+0000","last_fullsized":"2026-02-17T11:52:51.088697+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31552,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":434176,"data_stored":136970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673018,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":434176,"data_stored":136970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705722,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27388,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":434176,"data_stored":136970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":434176,"data_stored":136970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:53:01.038 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:53:01.038 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:53:01.039 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:53:01.039 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:53:01.127 INFO:teuthology.orchestra.run.trial077.stdout:42949673022 2026-02-17T11:53:01.128 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:01.129 INFO:teuthology.orchestra.run.trial077.stdout:38654705725 2026-02-17T11:53:01.129 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:01.130 INFO:teuthology.orchestra.run.trial077.stdout:42949673021 2026-02-17T11:53:01.131 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:01.132 INFO:teuthology.orchestra.run.trial077.stdout:38654705726 2026-02-17T11:53:01.132 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:01.329 INFO:teuthology.orchestra.run.trial077.stdout:38654705724 2026-02-17T11:53:01.329 INFO:teuthology.orchestra.run.trial077.stdout:42949673020 2026-02-17T11:53:01.335 INFO:teuthology.orchestra.run.trial077.stdout:42949673019 2026-02-17T11:53:01.336 INFO:teuthology.orchestra.run.trial077.stdout:38654705725 2026-02-17T11:53:01.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705725 got 38654705724 for osd.2 2026-02-17T11:53:01.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673022 got 42949673020 for osd.3 2026-02-17T11:53:01.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673021 got 42949673019 for osd.1 2026-02-17T11:53:01.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705726 got 38654705725 for osd.0 2026-02-17T11:53:02.339 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:02.339 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:02.345 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:02.348 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:02.499 INFO:teuthology.orchestra.run.trial077.stdout:38654705725 2026-02-17T11:53:02.503 INFO:teuthology.orchestra.run.trial077.stdout:42949673022 2026-02-17T11:53:02.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705725 got 38654705725 for osd.2 2026-02-17T11:53:02.511 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:02.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673022 got 42949673022 for osd.3 2026-02-17T11:53:02.514 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:02.543 INFO:teuthology.orchestra.run.trial077.stdout:38654705726 2026-02-17T11:53:02.547 INFO:teuthology.orchestra.run.trial077.stdout:42949673021 2026-02-17T11:53:02.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705726 got 38654705726 for osd.0 2026-02-17T11:53:02.553 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:02.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673021 got 42949673021 for osd.1 2026-02-17T11:53:02.557 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:02.558 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:53:02.756 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:02.756 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:53:02.764 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2026-02-17T11:53:01.351489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":117880,"kb_used_data":1696,"kb_used_omap":6,"kb_used_meta":116089,"kb_avail":377369480,"statfs":{"total":386547056640,"available":386426347520,"internally_reserved":0,"allocated":1736704,"data_stored":547880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":118875930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:52:49.947530+0000","last_change":"2026-02-17T11:52:49.947530+0000","last_active":"2026-02-17T11:52:49.947530+0000","last_peered":"2026-02-17T11:52:49.947530+0000","last_clean":"2026-02-17T11:52:49.947530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:52:49.947530+0000","last_undegraded":"2026-02-17T11:52:49.947530+0000","last_fullsized":"2026-02-17T11:52:49.947530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:52:49.947530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:52:49.947530+0000","last_clean_scrub_stamp":"2026-02-17T11:52:49.947530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":80,"reported_epoch":47,"state":"active+clean","last_fresh":"2026-02-17T11:52:51.088697+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:52:51.088697+0000","last_peered":"2026-02-17T11:52:51.088697+0000","last_clean":"2026-02-17T11:52:51.088697+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:52:51.088697+0000","last_undegraded":"2026-02-17T11:52:51.088697+0000","last_fullsized":"2026-02-17T11:52:51.088697+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31552,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":434176,"data_stored":136970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673021,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":434176,"data_stored":136970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705725,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27388,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":434176,"data_stored":136970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":434176,"data_stored":136970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:53:02.765 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_11 2026-02-17T11:53:02.765 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_11 unique_pool_11 --yes-i-really-really-mean-it 2026-02-17T11:53:02.967 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_11' removed 2026-02-17T11:53:02.976 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_12 2026-02-17T11:53:02.976 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_12 1 2026-02-17T11:53:03.970 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_12' created 2026-02-17T11:53:03.982 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_12 rados --yes-i-really-mean-it || true 2026-02-17T11:53:04.971 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_12' 2026-02-17T11:53:05.985 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:53:06.143 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:06.144 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":50,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:53:04.969975+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"unique_pool_12","create_time":"2026-02-17T11:53:03.140515+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:53:06.154 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:53:06.155 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:53:06.155 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:53:06.156 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:53:06.244 INFO:teuthology.orchestra.run.trial077.stdout:42949673024 2026-02-17T11:53:06.245 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:06.246 INFO:teuthology.orchestra.run.trial077.stdout:38654705727 2026-02-17T11:53:06.246 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:06.247 INFO:teuthology.orchestra.run.trial077.stdout:38654705728 2026-02-17T11:53:06.248 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:06.248 INFO:teuthology.orchestra.run.trial077.stdout:42949673023 2026-02-17T11:53:06.249 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:06.447 INFO:teuthology.orchestra.run.trial077.stdout:42949673023 2026-02-17T11:53:06.447 INFO:teuthology.orchestra.run.trial077.stdout:38654705727 2026-02-17T11:53:06.452 INFO:teuthology.orchestra.run.trial077.stdout:38654705726 2026-02-17T11:53:06.452 INFO:teuthology.orchestra.run.trial077.stdout:42949673022 2026-02-17T11:53:06.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673024 got 42949673023 for osd.3 2026-02-17T11:53:06.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705728 got 38654705727 for osd.0 2026-02-17T11:53:06.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673023 got 42949673022 for osd.1 2026-02-17T11:53:06.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705727 got 38654705726 for osd.2 2026-02-17T11:53:07.457 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:07.458 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:07.462 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:07.462 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:07.621 INFO:teuthology.orchestra.run.trial077.stdout:42949673023 2026-02-17T11:53:07.623 INFO:teuthology.orchestra.run.trial077.stdout:38654705727 2026-02-17T11:53:07.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705728 got 38654705727 for osd.0 2026-02-17T11:53:07.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673024 got 42949673023 for osd.3 2026-02-17T11:53:07.661 INFO:teuthology.orchestra.run.trial077.stdout:38654705726 2026-02-17T11:53:07.667 INFO:teuthology.orchestra.run.trial077.stdout:42949673022 2026-02-17T11:53:07.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705727 got 38654705726 for osd.2 2026-02-17T11:53:07.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673023 got 42949673022 for osd.1 2026-02-17T11:53:08.635 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:08.636 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:08.671 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:08.678 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:08.800 INFO:teuthology.orchestra.run.trial077.stdout:42949673024 2026-02-17T11:53:08.800 INFO:teuthology.orchestra.run.trial077.stdout:38654705728 2026-02-17T11:53:08.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673024 got 42949673024 for osd.3 2026-02-17T11:53:08.811 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:08.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705728 got 38654705728 for osd.0 2026-02-17T11:53:08.811 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:08.841 INFO:teuthology.orchestra.run.trial077.stdout:38654705727 2026-02-17T11:53:08.844 INFO:teuthology.orchestra.run.trial077.stdout:42949673023 2026-02-17T11:53:08.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705727 got 38654705727 for osd.2 2026-02-17T11:53:08.850 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:08.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673023 got 42949673023 for osd.1 2026-02-17T11:53:08.853 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:08.853 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:53:09.053 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:09.053 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:53:09.061 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2026-02-17T11:53:07.352092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":117964,"kb_used_data":1784,"kb_used_omap":6,"kb_used_meta":116089,"kb_avail":377369396,"statfs":{"total":386547056640,"available":386426261504,"internally_reserved":0,"allocated":1826816,"data_stored":576690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":118875930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:53:03.967416+0000","last_change":"2026-02-17T11:53:03.967416+0000","last_active":"2026-02-17T11:53:03.967416+0000","last_peered":"2026-02-17T11:53:03.967416+0000","last_clean":"2026-02-17T11:53:03.967416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:53:03.967416+0000","last_undegraded":"2026-02-17T11:53:03.967416+0000","last_fullsized":"2026-02-17T11:53:03.967416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:53:03.967416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:53:03.967416+0000","last_clean_scrub_stamp":"2026-02-17T11:53:03.967416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-17T11:53:04.971745+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:53:04.971745+0000","last_peered":"2026-02-17T11:53:04.971745+0000","last_clean":"2026-02-17T11:53:04.971745+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:53:04.971745+0000","last_undegraded":"2026-02-17T11:53:04.971745+0000","last_fullsized":"2026-02-17T11:53:04.971745+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":462848,"data_stored":146684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673023,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":462848,"data_stored":146684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705727,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27400,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":446464,"data_stored":139980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":454656,"data_stored":143342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:53:15.063 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:53:15.064 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:53:15.064 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:53:15.065 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:53:15.153 INFO:teuthology.orchestra.run.trial077.stdout:38654705731 2026-02-17T11:53:15.154 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:15.154 INFO:teuthology.orchestra.run.trial077.stdout:42949673026 2026-02-17T11:53:15.155 INFO:teuthology.orchestra.run.trial077.stdout:42949673027 2026-02-17T11:53:15.156 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:15.156 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:15.158 INFO:teuthology.orchestra.run.trial077.stdout:38654705730 2026-02-17T11:53:15.158 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:15.355 INFO:teuthology.orchestra.run.trial077.stdout:38654705729 2026-02-17T11:53:15.357 INFO:teuthology.orchestra.run.trial077.stdout:42949673024 2026-02-17T11:53:15.361 INFO:teuthology.orchestra.run.trial077.stdout:38654705728 2026-02-17T11:53:15.362 INFO:teuthology.orchestra.run.trial077.stdout:42949673025 2026-02-17T11:53:15.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705731 got 38654705729 for osd.0 2026-02-17T11:53:15.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673026 got 42949673024 for osd.1 2026-02-17T11:53:15.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705730 got 38654705728 for osd.2 2026-02-17T11:53:15.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673027 got 42949673025 for osd.3 2026-02-17T11:53:16.365 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:16.368 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:16.373 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:16.373 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:16.526 INFO:teuthology.orchestra.run.trial077.stdout:38654705731 2026-02-17T11:53:16.530 INFO:teuthology.orchestra.run.trial077.stdout:42949673026 2026-02-17T11:53:16.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705731 got 38654705731 for osd.0 2026-02-17T11:53:16.536 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:16.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673026 got 42949673026 for osd.1 2026-02-17T11:53:16.540 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:16.570 INFO:teuthology.orchestra.run.trial077.stdout:42949673027 2026-02-17T11:53:16.572 INFO:teuthology.orchestra.run.trial077.stdout:38654705730 2026-02-17T11:53:16.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673027 got 42949673027 for osd.3 2026-02-17T11:53:16.580 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:16.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705730 got 38654705730 for osd.2 2026-02-17T11:53:16.582 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:16.582 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:53:16.778 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:16.778 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:53:16.785 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2026-02-17T11:53:15.352803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":117984,"kb_used_data":1808,"kb_used_omap":6,"kb_used_meta":116089,"kb_avail":377369376,"statfs":{"total":386547056640,"available":386426241024,"internally_reserved":0,"allocated":1851392,"data_stored":586736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":118875930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:53:03.967416+0000","last_change":"2026-02-17T11:53:03.967416+0000","last_active":"2026-02-17T11:53:03.967416+0000","last_peered":"2026-02-17T11:53:03.967416+0000","last_clean":"2026-02-17T11:53:03.967416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:53:03.967416+0000","last_undegraded":"2026-02-17T11:53:03.967416+0000","last_fullsized":"2026-02-17T11:53:03.967416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:53:03.967416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:53:03.967416+0000","last_clean_scrub_stamp":"2026-02-17T11:53:03.967416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":50,"state":"active+clean","last_fresh":"2026-02-17T11:53:04.971745+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:53:04.971745+0000","last_peered":"2026-02-17T11:53:04.971745+0000","last_clean":"2026-02-17T11:53:04.971745+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:53:04.971745+0000","last_undegraded":"2026-02-17T11:53:04.971745+0000","last_fullsized":"2026-02-17T11:53:04.971745+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673027,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":462848,"data_stored":146684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673026,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":462848,"data_stored":146684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705730,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":462848,"data_stored":146684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":462848,"data_stored":146684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:53:16.787 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_12 2026-02-17T11:53:16.788 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_12 unique_pool_12 --yes-i-really-really-mean-it 2026-02-17T11:53:16.986 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_12' removed 2026-02-17T11:53:16.996 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_13 2026-02-17T11:53:16.997 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_13 1 2026-02-17T11:53:17.990 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_13' created 2026-02-17T11:53:17.999 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_13 rados --yes-i-really-mean-it || true 2026-02-17T11:53:18.993 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_13' 2026-02-17T11:53:20.006 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:53:20.165 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:20.165 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":53,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:53:18.989639+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"unique_pool_13","create_time":"2026-02-17T11:53:17.159694+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:53:20.173 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:53:20.173 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:53:20.173 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:53:20.173 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:53:20.259 INFO:teuthology.orchestra.run.trial077.stdout:42949673028 2026-02-17T11:53:20.260 INFO:teuthology.orchestra.run.trial077.stdout:42949673029 2026-02-17T11:53:20.261 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:20.261 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:20.262 INFO:teuthology.orchestra.run.trial077.stdout:38654705732 2026-02-17T11:53:20.263 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:20.264 INFO:teuthology.orchestra.run.trial077.stdout:38654705733 2026-02-17T11:53:20.264 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:20.461 INFO:teuthology.orchestra.run.trial077.stdout:38654705731 2026-02-17T11:53:20.464 INFO:teuthology.orchestra.run.trial077.stdout:42949673027 2026-02-17T11:53:20.467 INFO:teuthology.orchestra.run.trial077.stdout:42949673026 2026-02-17T11:53:20.468 INFO:teuthology.orchestra.run.trial077.stdout:38654705732 2026-02-17T11:53:20.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705732 got 38654705731 for osd.2 2026-02-17T11:53:20.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673029 got 42949673027 for osd.3 2026-02-17T11:53:20.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705733 got 38654705732 for osd.0 2026-02-17T11:53:20.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673028 got 42949673026 for osd.1 2026-02-17T11:53:21.473 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:21.475 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:21.480 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:21.481 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:21.634 INFO:teuthology.orchestra.run.trial077.stdout:38654705731 2026-02-17T11:53:21.637 INFO:teuthology.orchestra.run.trial077.stdout:42949673027 2026-02-17T11:53:21.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705732 got 38654705731 for osd.2 2026-02-17T11:53:21.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673029 got 42949673027 for osd.3 2026-02-17T11:53:21.679 INFO:teuthology.orchestra.run.trial077.stdout:42949673026 2026-02-17T11:53:21.679 INFO:teuthology.orchestra.run.trial077.stdout:38654705732 2026-02-17T11:53:21.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673028 got 42949673026 for osd.1 2026-02-17T11:53:21.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705733 got 38654705732 for osd.0 2026-02-17T11:53:22.645 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:22.647 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:22.688 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:22.689 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:22.806 INFO:teuthology.orchestra.run.trial077.stdout:42949673029 2026-02-17T11:53:22.810 INFO:teuthology.orchestra.run.trial077.stdout:38654705732 2026-02-17T11:53:22.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673029 got 42949673029 for osd.3 2026-02-17T11:53:22.817 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:22.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705732 got 38654705732 for osd.2 2026-02-17T11:53:22.821 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:22.848 INFO:teuthology.orchestra.run.trial077.stdout:42949673028 2026-02-17T11:53:22.850 INFO:teuthology.orchestra.run.trial077.stdout:38654705733 2026-02-17T11:53:22.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673028 got 42949673028 for osd.1 2026-02-17T11:53:22.859 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:22.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705733 got 38654705733 for osd.0 2026-02-17T11:53:22.860 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:22.861 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:53:23.053 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:23.053 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:53:23.061 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2026-02-17T11:53:21.353522+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":118116,"kb_used_data":1920,"kb_used_omap":6,"kb_used_meta":116089,"kb_avail":377369244,"statfs":{"total":386547056640,"available":386426105856,"internally_reserved":0,"allocated":1966080,"data_stored":625624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":118875930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"14.0","version":"0'0","reported_seq":3,"reported_epoch":53,"state":"creating+activating","last_fresh":"2026-02-17T11:53:18.994254+0000","last_change":"2026-02-17T11:53:18.994441+0000","last_active":"2026-02-17T11:53:17.987335+0000","last_peered":"2026-02-17T11:53:17.987335+0000","last_clean":"2026-02-17T11:53:17.987335+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:53:18.994254+0000","last_undegraded":"2026-02-17T11:53:18.994254+0000","last_fullsized":"2026-02-17T11:53:18.994254+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:53:17.987335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:53:17.987335+0000","last_clean_scrub_stamp":"2026-02-17T11:53:17.987335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T11:53:19.377837+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:53:19.377837+0000","last_peered":"2026-02-17T11:53:19.377837+0000","last_clean":"2026-02-17T11:53:19.377837+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:53:19.377837+0000","last_undegraded":"2026-02-17T11:53:19.377837+0000","last_fullsized":"2026-02-17T11:53:19.377837+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31608,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":491520,"data_stored":156406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673028,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":491520,"data_stored":156406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705732,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":491520,"data_stored":156406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":491520,"data_stored":156406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:53:29.064 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:53:29.064 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:53:29.065 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:53:29.065 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:53:29.153 INFO:teuthology.orchestra.run.trial077.stdout:42949673030 2026-02-17T11:53:29.154 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:29.154 INFO:teuthology.orchestra.run.trial077.stdout:38654705735 2026-02-17T11:53:29.154 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:29.154 INFO:teuthology.orchestra.run.trial077.stdout:42949673031 2026-02-17T11:53:29.155 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:29.155 INFO:teuthology.orchestra.run.trial077.stdout:38654705736 2026-02-17T11:53:29.155 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:29.353 INFO:teuthology.orchestra.run.trial077.stdout:38654705733 2026-02-17T11:53:29.354 INFO:teuthology.orchestra.run.trial077.stdout:42949673029 2026-02-17T11:53:29.357 INFO:teuthology.orchestra.run.trial077.stdout:42949673030 2026-02-17T11:53:29.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705735 got 38654705733 for osd.2 2026-02-17T11:53:29.364 INFO:teuthology.orchestra.run.trial077.stdout:38654705734 2026-02-17T11:53:29.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673030 got 42949673029 for osd.1 2026-02-17T11:53:29.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673031 got 42949673030 for osd.3 2026-02-17T11:53:29.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705734 for osd.0 2026-02-17T11:53:30.364 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:30.365 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:30.369 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:30.375 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:30.526 INFO:teuthology.orchestra.run.trial077.stdout:42949673030 2026-02-17T11:53:30.527 INFO:teuthology.orchestra.run.trial077.stdout:38654705735 2026-02-17T11:53:30.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673030 got 42949673030 for osd.1 2026-02-17T11:53:30.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705735 got 38654705735 for osd.2 2026-02-17T11:53:30.538 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:30.538 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:30.567 INFO:teuthology.orchestra.run.trial077.stdout:38654705736 2026-02-17T11:53:30.568 INFO:teuthology.orchestra.run.trial077.stdout:42949673031 2026-02-17T11:53:30.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705736 for osd.0 2026-02-17T11:53:30.576 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:30.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673031 got 42949673031 for osd.3 2026-02-17T11:53:30.579 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:30.579 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:53:30.774 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:30.775 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:53:30.783 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2026-02-17T11:53:29.354314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":118116,"kb_used_data":1920,"kb_used_omap":6,"kb_used_meta":116089,"kb_avail":377369244,"statfs":{"total":386547056640,"available":386426105856,"internally_reserved":0,"allocated":1966080,"data_stored":625624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":118875930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"14.0","version":"0'0","reported_seq":3,"reported_epoch":53,"state":"creating+activating","last_fresh":"2026-02-17T11:53:18.994254+0000","last_change":"2026-02-17T11:53:18.994441+0000","last_active":"2026-02-17T11:53:17.987335+0000","last_peered":"2026-02-17T11:53:17.987335+0000","last_clean":"2026-02-17T11:53:17.987335+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:53:18.994254+0000","last_undegraded":"2026-02-17T11:53:18.994254+0000","last_fullsized":"2026-02-17T11:53:18.994254+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:53:17.987335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:53:17.987335+0000","last_clean_scrub_stamp":"2026-02-17T11:53:17.987335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2026-02-17T11:53:19.377837+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:53:19.377837+0000","last_peered":"2026-02-17T11:53:19.377837+0000","last_clean":"2026-02-17T11:53:19.377837+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:53:19.377837+0000","last_undegraded":"2026-02-17T11:53:19.377837+0000","last_fullsized":"2026-02-17T11:53:19.377837+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673031,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31608,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":491520,"data_stored":156406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673030,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":491520,"data_stored":156406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705735,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":491520,"data_stored":156406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":491520,"data_stored":156406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:53:30.784 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_13 2026-02-17T11:53:30.784 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_13 unique_pool_13 --yes-i-really-really-mean-it 2026-02-17T11:53:31.007 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_13' removed 2026-02-17T11:53:31.016 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_14 2026-02-17T11:53:31.017 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_14 1 2026-02-17T11:53:32.010 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_14' created 2026-02-17T11:53:32.023 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_14 rados --yes-i-really-mean-it || true 2026-02-17T11:53:33.011 INFO:teuthology.orchestra.run.trial077.stderr:enabled application 'rados' on pool 'unique_pool_14' 2026-02-17T11:53:34.023 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:53:34.179 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:34.180 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":57,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:53:34.013431+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:49:59.947887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"unique_pool_14","create_time":"2026-02-17T11:53:31.176142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:53:34.188 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:53:34.189 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:53:34.190 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:53:34.190 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:53:34.279 INFO:teuthology.orchestra.run.trial077.stdout:42949673032 2026-02-17T11:53:34.279 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:34.281 INFO:teuthology.orchestra.run.trial077.stdout:38654705737 2026-02-17T11:53:34.281 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:34.282 INFO:teuthology.orchestra.run.trial077.stdout:38654705738 2026-02-17T11:53:34.282 INFO:teuthology.orchestra.run.trial077.stdout:42949673033 2026-02-17T11:53:34.283 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:34.284 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:34.480 INFO:teuthology.orchestra.run.trial077.stdout:42949673032 2026-02-17T11:53:34.481 INFO:teuthology.orchestra.run.trial077.stdout:38654705735 2026-02-17T11:53:34.487 INFO:teuthology.orchestra.run.trial077.stdout:38654705736 2026-02-17T11:53:34.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705737 got 38654705735 for osd.2 2026-02-17T11:53:34.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673033 got 42949673032 for osd.3 2026-02-17T11:53:34.493 INFO:teuthology.orchestra.run.trial077.stdout:42949673031 2026-02-17T11:53:34.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705738 got 38654705736 for osd.0 2026-02-17T11:53:34.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673032 got 42949673031 for osd.1 2026-02-17T11:53:35.491 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:35.492 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:35.498 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:35.504 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:35.652 INFO:teuthology.orchestra.run.trial077.stdout:42949673032 2026-02-17T11:53:35.656 INFO:teuthology.orchestra.run.trial077.stdout:38654705735 2026-02-17T11:53:35.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673033 got 42949673032 for osd.3 2026-02-17T11:53:35.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705737 got 38654705735 for osd.2 2026-02-17T11:53:35.696 INFO:teuthology.orchestra.run.trial077.stdout:38654705736 2026-02-17T11:53:35.698 INFO:teuthology.orchestra.run.trial077.stdout:42949673031 2026-02-17T11:53:35.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705738 got 38654705736 for osd.0 2026-02-17T11:53:35.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673032 got 42949673031 for osd.1 2026-02-17T11:53:36.663 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:36.668 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:36.707 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:36.708 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:36.826 INFO:teuthology.orchestra.run.trial077.stdout:42949673034 2026-02-17T11:53:36.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673033 got 42949673034 for osd.3 2026-02-17T11:53:36.837 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:36.865 INFO:teuthology.orchestra.run.trial077.stdout:38654705738 2026-02-17T11:53:36.866 INFO:teuthology.orchestra.run.trial077.stdout:38654705737 2026-02-17T11:53:36.868 INFO:teuthology.orchestra.run.trial077.stdout:42949673033 2026-02-17T11:53:36.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705738 got 38654705738 for osd.0 2026-02-17T11:53:36.875 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:36.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705737 got 38654705737 for osd.2 2026-02-17T11:53:36.876 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:36.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673032 got 42949673033 for osd.1 2026-02-17T11:53:36.878 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:36.879 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:53:37.073 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:37.074 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:53:37.082 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2026-02-17T11:53:35.354935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118224,"kb_used_data":2040,"kb_used_omap":6,"kb_used_meta":116089,"kb_avail":377369136,"statfs":{"total":386547056640,"available":386425995264,"internally_reserved":0,"allocated":2088960,"data_stored":667854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":118875930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-17T11:53:33.036563+0000","last_change":"2026-02-17T11:53:33.036210+0000","last_active":"2026-02-17T11:53:33.036563+0000","last_peered":"2026-02-17T11:53:33.036563+0000","last_clean":"2026-02-17T11:53:33.036563+0000","last_became_active":"2026-02-17T11:53:33.036089+0000","last_became_peered":"2026-02-17T11:53:33.036089+0000","last_unstale":"2026-02-17T11:53:33.036563+0000","last_undegraded":"2026-02-17T11:53:33.036563+0000","last_fullsized":"2026-02-17T11:53:33.036563+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:53:32.007248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:53:32.007248+0000","last_clean_scrub_stamp":"2026-02-17T11:53:32.007248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:03:40.222133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":97,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-17T11:53:33.036395+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:53:33.036395+0000","last_peered":"2026-02-17T11:53:33.036395+0000","last_clean":"2026-02-17T11:53:33.036395+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:53:33.036395+0000","last_undegraded":"2026-02-17T11:53:33.036395+0000","last_fullsized":"2026-02-17T11:53:33.036395+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673034,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":528384,"data_stored":169470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673033,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":520192,"data_stored":166128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705737,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":520192,"data_stored":166128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":520192,"data_stored":166128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:53:43.084 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:53:43.084 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:53:43.085 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:53:43.086 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:53:43.175 INFO:teuthology.orchestra.run.trial077.stdout:42949673035 2026-02-17T11:53:43.176 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:43.177 INFO:teuthology.orchestra.run.trial077.stdout:38654705739 2026-02-17T11:53:43.177 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:43.178 INFO:teuthology.orchestra.run.trial077.stdout:38654705740 2026-02-17T11:53:43.179 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:43.180 INFO:teuthology.orchestra.run.trial077.stdout:42949673036 2026-02-17T11:53:43.180 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:43.378 INFO:teuthology.orchestra.run.trial077.stdout:42949673034 2026-02-17T11:53:43.380 INFO:teuthology.orchestra.run.trial077.stdout:42949673035 2026-02-17T11:53:43.381 INFO:teuthology.orchestra.run.trial077.stdout:38654705739 2026-02-17T11:53:43.383 INFO:teuthology.orchestra.run.trial077.stdout:38654705738 2026-02-17T11:53:43.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673035 got 42949673034 for osd.1 2026-02-17T11:53:43.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673036 got 42949673035 for osd.3 2026-02-17T11:53:43.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705740 got 38654705739 for osd.0 2026-02-17T11:53:43.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705739 got 38654705738 for osd.2 2026-02-17T11:53:44.390 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:44.391 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:44.394 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:44.395 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:53:44.551 INFO:teuthology.orchestra.run.trial077.stdout:42949673035 2026-02-17T11:53:44.552 INFO:teuthology.orchestra.run.trial077.stdout:42949673036 2026-02-17T11:53:44.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673035 got 42949673035 for osd.1 2026-02-17T11:53:44.563 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:44.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673036 got 42949673036 for osd.3 2026-02-17T11:53:44.563 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:44.592 INFO:teuthology.orchestra.run.trial077.stdout:38654705739 2026-02-17T11:53:44.599 INFO:teuthology.orchestra.run.trial077.stdout:38654705740 2026-02-17T11:53:44.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705739 got 38654705739 for osd.2 2026-02-17T11:53:44.602 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:44.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705740 got 38654705740 for osd.0 2026-02-17T11:53:44.610 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:44.610 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:53:44.806 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:44.807 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:53:44.815 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2026-02-17T11:53:43.355785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118252,"kb_used_data":2064,"kb_used_omap":6,"kb_used_meta":116089,"kb_avail":377369108,"statfs":{"total":386547056640,"available":386425966592,"internally_reserved":0,"allocated":2113536,"data_stored":677880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":118875930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-02-17T11:53:35.491838+0000","last_change":"2026-02-17T11:53:33.036210+0000","last_active":"2026-02-17T11:53:35.491838+0000","last_peered":"2026-02-17T11:53:35.491838+0000","last_clean":"2026-02-17T11:53:35.491838+0000","last_became_active":"2026-02-17T11:53:33.036089+0000","last_became_peered":"2026-02-17T11:53:33.036089+0000","last_unstale":"2026-02-17T11:53:35.491838+0000","last_undegraded":"2026-02-17T11:53:35.491838+0000","last_fullsized":"2026-02-17T11:53:35.491838+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:53:32.007248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:53:32.007248+0000","last_clean_scrub_stamp":"2026-02-17T11:53:32.007248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:10:15.543652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":99,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-02-17T11:53:34.378665+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:53:34.378665+0000","last_peered":"2026-02-17T11:53:34.378665+0000","last_clean":"2026-02-17T11:53:34.378665+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:53:34.378665+0000","last_undegraded":"2026-02-17T11:53:34.378665+0000","last_fullsized":"2026-02-17T11:53:34.378665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673036,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":528384,"data_stored":169470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673035,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":528384,"data_stored":169470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705739,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":528384,"data_stored":169470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705740,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":528384,"data_stored":169470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:53:44.816 INFO:tasks.osd_max_pg_per_osd:3. mark an osd out 2026-02-17T11:53:44.816 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:53:44.972 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:44.973 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:53:44.980 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2026-02-17T11:53:43.355785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118252,"kb_used_data":2064,"kb_used_omap":6,"kb_used_meta":116089,"kb_avail":377369108,"statfs":{"total":386547056640,"available":386425966592,"internally_reserved":0,"allocated":2113536,"data_stored":677880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":118875930},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-02-17T11:53:35.491838+0000","last_change":"2026-02-17T11:53:33.036210+0000","last_active":"2026-02-17T11:53:35.491838+0000","last_peered":"2026-02-17T11:53:35.491838+0000","last_clean":"2026-02-17T11:53:35.491838+0000","last_became_active":"2026-02-17T11:53:33.036089+0000","last_became_peered":"2026-02-17T11:53:33.036089+0000","last_unstale":"2026-02-17T11:53:35.491838+0000","last_undegraded":"2026-02-17T11:53:35.491838+0000","last_fullsized":"2026-02-17T11:53:35.491838+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:53:32.007248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:53:32.007248+0000","last_clean_scrub_stamp":"2026-02-17T11:53:32.007248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:10:15.543652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":99,"reported_epoch":57,"state":"active+clean","last_fresh":"2026-02-17T11:53:34.378665+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:53:34.378665+0000","last_peered":"2026-02-17T11:53:34.378665+0000","last_clean":"2026-02-17T11:53:34.378665+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:53:34.378665+0000","last_undegraded":"2026-02-17T11:53:34.378665+0000","last_fullsized":"2026-02-17T11:53:34.378665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673036,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":528384,"data_stored":169470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673035,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":528384,"data_stored":169470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705739,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":528384,"data_stored":169470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705740,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":528384,"data_stored":169470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:53:44.981 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 2 2026-02-17T11:53:45.144 INFO:tasks.ceph.mon.a.trial077.stderr:2026-02-17T11:53:45.142+0000 7fb8d8b7d640 -1 mon.a@0(leader).osd e57 definitely_dead 0 2026-02-17T11:53:46.027 INFO:teuthology.orchestra.run.trial077.stderr:marked out osd.2. 2026-02-17T11:53:46.038 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:53:46.195 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:46.196 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":58,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:53:46.024578+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:53:46.024578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:50:17.540450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"unique_pool_14","create_time":"2026-02-17T11:53:31.176142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":65536,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:53:46.204 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:53:46.204 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:53:46.204 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:53:46.289 INFO:teuthology.orchestra.run.trial077.stdout:38654705742 2026-02-17T11:53:46.289 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:46.290 INFO:teuthology.orchestra.run.trial077.stdout:42949673037 2026-02-17T11:53:46.290 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:46.293 INFO:teuthology.orchestra.run.trial077.stdout:42949673038 2026-02-17T11:53:46.293 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:46.452 INFO:teuthology.orchestra.run.trial077.stdout:42949673036 2026-02-17T11:53:46.452 INFO:teuthology.orchestra.run.trial077.stdout:38654705741 2026-02-17T11:53:46.457 INFO:teuthology.orchestra.run.trial077.stdout:42949673037 2026-02-17T11:53:46.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673037 got 42949673036 for osd.1 2026-02-17T11:53:46.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705742 got 38654705741 for osd.0 2026-02-17T11:53:46.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673038 got 42949673037 for osd.3 2026-02-17T11:53:47.463 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:47.464 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:47.468 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:47.627 INFO:teuthology.orchestra.run.trial077.stdout:38654705741 2026-02-17T11:53:47.628 INFO:teuthology.orchestra.run.trial077.stdout:42949673036 2026-02-17T11:53:47.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705742 got 38654705741 for osd.0 2026-02-17T11:53:47.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673037 got 42949673036 for osd.1 2026-02-17T11:53:47.667 INFO:teuthology.orchestra.run.trial077.stdout:42949673037 2026-02-17T11:53:47.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673038 got 42949673037 for osd.3 2026-02-17T11:53:48.639 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:48.640 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:48.677 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:48.800 INFO:teuthology.orchestra.run.trial077.stdout:42949673037 2026-02-17T11:53:48.803 INFO:teuthology.orchestra.run.trial077.stdout:38654705742 2026-02-17T11:53:48.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673037 got 42949673037 for osd.1 2026-02-17T11:53:48.810 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:48.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705742 got 38654705742 for osd.0 2026-02-17T11:53:48.813 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:48.841 INFO:teuthology.orchestra.run.trial077.stdout:42949673038 2026-02-17T11:53:48.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673038 got 42949673038 for osd.3 2026-02-17T11:53:48.850 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:48.850 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:53:49.043 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:49.044 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:53:49.052 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2026-02-17T11:53:47.356312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90776,"kb_used_data":1564,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283024744,"statfs":{"total":289910292480,"available":289817337856,"internally_reserved":0,"allocated":1601536,"data_stored":514572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4780,"internal_metadata":91286868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"15.0","version":"0'0","reported_seq":3,"reported_epoch":58,"state":"peering","last_fresh":"2026-02-17T11:53:46.029981+0000","last_change":"2026-02-17T11:53:46.029981+0000","last_active":"2026-02-17T11:53:32.007248+0000","last_peered":"2026-02-17T11:53:32.007248+0000","last_clean":"2026-02-17T11:53:32.007248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:53:46.029981+0000","last_undegraded":"2026-02-17T11:53:46.029981+0000","last_fullsized":"2026-02-17T11:53:46.029981+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:53:32.007248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:53:32.007248+0000","last_clean_scrub_stamp":"2026-02-17T11:53:32.007248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":101,"reported_epoch":58,"state":"active+clean","last_fresh":"2026-02-17T11:53:46.031102+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:53:46.031102+0000","last_peered":"2026-02-17T11:53:46.031102+0000","last_clean":"2026-02-17T11:53:46.031102+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:53:46.031102+0000","last_undegraded":"2026-02-17T11:53:46.031102+0000","last_fullsized":"2026-02-17T11:53:46.031102+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":536576,"data_stored":172551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673037,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":536576,"data_stored":172551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":528384,"data_stored":169470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:53:55.055 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:53:55.055 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:53:55.056 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:53:55.145 INFO:teuthology.orchestra.run.trial077.stdout:42949673040 2026-02-17T11:53:55.145 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:55.147 INFO:teuthology.orchestra.run.trial077.stdout:42949673041 2026-02-17T11:53:55.148 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:55.149 INFO:teuthology.orchestra.run.trial077.stdout:38654705745 2026-02-17T11:53:55.149 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:55.344 INFO:teuthology.orchestra.run.trial077.stdout:38654705743 2026-02-17T11:53:55.346 INFO:teuthology.orchestra.run.trial077.stdout:42949673039 2026-02-17T11:53:55.348 INFO:teuthology.orchestra.run.trial077.stdout:42949673038 2026-02-17T11:53:55.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705745 got 38654705743 for osd.0 2026-02-17T11:53:55.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673041 got 42949673039 for osd.3 2026-02-17T11:53:55.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673040 got 42949673038 for osd.1 2026-02-17T11:53:56.355 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:53:56.357 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:53:56.359 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:53:56.517 INFO:teuthology.orchestra.run.trial077.stdout:42949673041 2026-02-17T11:53:56.522 INFO:teuthology.orchestra.run.trial077.stdout:38654705745 2026-02-17T11:53:56.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673041 got 42949673041 for osd.3 2026-02-17T11:53:56.527 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:56.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705745 got 38654705745 for osd.0 2026-02-17T11:53:56.532 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:56.555 INFO:teuthology.orchestra.run.trial077.stdout:42949673040 2026-02-17T11:53:56.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673040 got 42949673040 for osd.1 2026-02-17T11:53:56.566 DEBUG:teuthology.parallel:result is None 2026-02-17T11:53:56.566 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:53:56.763 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:53:56.764 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:53:56.771 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2026-02-17T11:53:55.357051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90808,"kb_used_data":1596,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283024712,"statfs":{"total":289910292480,"available":289817305088,"internally_reserved":0,"allocated":1634304,"data_stored":526683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4780,"internal_metadata":91286868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"15.0","version":"0'0","reported_seq":5,"reported_epoch":59,"state":"activating","last_fresh":"2026-02-17T11:53:47.032091+0000","last_change":"2026-02-17T11:53:47.032186+0000","last_active":"2026-02-17T11:53:32.007248+0000","last_peered":"2026-02-17T11:53:32.007248+0000","last_clean":"2026-02-17T11:53:32.007248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:53:47.032091+0000","last_undegraded":"2026-02-17T11:53:47.032091+0000","last_fullsized":"2026-02-17T11:53:47.032091+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:53:32.007248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:53:32.007248+0000","last_clean_scrub_stamp":"2026-02-17T11:53:32.007248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":103,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-17T11:53:47.031808+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:53:47.031808+0000","last_peered":"2026-02-17T11:53:47.031808+0000","last_clean":"2026-02-17T11:53:47.031808+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:53:47.031808+0000","last_undegraded":"2026-02-17T11:53:47.031808+0000","last_fullsized":"2026-02-17T11:53:47.031808+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673041,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":0,"seq":38654705742,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:54:02.773 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:54:02.773 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:54:02.773 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:54:02.862 INFO:teuthology.orchestra.run.trial077.stdout:38654705747 2026-02-17T11:54:02.863 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:54:02.864 INFO:teuthology.orchestra.run.trial077.stdout:42949673043 2026-02-17T11:54:02.865 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:54:02.866 INFO:teuthology.orchestra.run.trial077.stdout:42949673042 2026-02-17T11:54:02.867 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:54:03.061 INFO:teuthology.orchestra.run.trial077.stdout:42949673042 2026-02-17T11:54:03.065 INFO:teuthology.orchestra.run.trial077.stdout:42949673041 2026-02-17T11:54:03.066 INFO:teuthology.orchestra.run.trial077.stdout:38654705746 2026-02-17T11:54:03.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673043 got 42949673042 for osd.3 2026-02-17T11:54:03.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705747 got 38654705746 for osd.0 2026-02-17T11:54:03.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673042 got 42949673041 for osd.1 2026-02-17T11:54:04.072 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:54:04.077 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:54:04.078 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:54:04.232 INFO:teuthology.orchestra.run.trial077.stdout:42949673043 2026-02-17T11:54:04.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673043 got 42949673043 for osd.3 2026-02-17T11:54:04.242 DEBUG:teuthology.parallel:result is None 2026-02-17T11:54:04.275 INFO:teuthology.orchestra.run.trial077.stdout:38654705747 2026-02-17T11:54:04.276 INFO:teuthology.orchestra.run.trial077.stdout:42949673042 2026-02-17T11:54:04.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705747 got 38654705747 for osd.0 2026-02-17T11:54:04.287 DEBUG:teuthology.parallel:result is None 2026-02-17T11:54:04.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673042 got 42949673042 for osd.1 2026-02-17T11:54:04.287 DEBUG:teuthology.parallel:result is None 2026-02-17T11:54:04.288 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:54:04.481 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:54:04.481 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:54:04.489 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2026-02-17T11:54:03.357783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90808,"kb_used_data":1596,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283024712,"statfs":{"total":289910292480,"available":289817305088,"internally_reserved":0,"allocated":1634304,"data_stored":526683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4780,"internal_metadata":91286868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"15.0","version":"0'0","reported_seq":5,"reported_epoch":59,"state":"activating","last_fresh":"2026-02-17T11:53:47.032091+0000","last_change":"2026-02-17T11:53:47.032186+0000","last_active":"2026-02-17T11:53:32.007248+0000","last_peered":"2026-02-17T11:53:32.007248+0000","last_clean":"2026-02-17T11:53:32.007248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:53:47.032091+0000","last_undegraded":"2026-02-17T11:53:47.032091+0000","last_fullsized":"2026-02-17T11:53:47.032091+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:53:32.007248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:53:32.007248+0000","last_clean_scrub_stamp":"2026-02-17T11:53:32.007248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":103,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-17T11:53:47.031808+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:53:47.031808+0000","last_peered":"2026-02-17T11:53:47.031808+0000","last_clean":"2026-02-17T11:53:47.031808+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:53:47.031808+0000","last_undegraded":"2026-02-17T11:53:47.031808+0000","last_fullsized":"2026-02-17T11:53:47.031808+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":0,"seq":38654705743,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705747,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:54:04.490 INFO:tasks.osd_max_pg_per_osd:4. removing pool.b 2026-02-17T11:54:04.490 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_14 2026-02-17T11:54:04.490 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_14 unique_pool_14 --yes-i-really-really-mean-it 2026-02-17T11:54:05.048 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_14' removed 2026-02-17T11:54:05.061 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:54:05.061 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:54:05.214 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:54:05.215 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:54:05.224 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2026-02-17T11:54:05.047725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90808,"kb_used_data":1596,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283024712,"statfs":{"total":289910292480,"available":289817305088,"internally_reserved":0,"allocated":1634304,"data_stored":526683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4780,"internal_metadata":91286868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":103,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-17T11:53:47.031808+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:53:47.031808+0000","last_peered":"2026-02-17T11:53:47.031808+0000","last_clean":"2026-02-17T11:53:47.031808+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:53:47.031808+0000","last_undegraded":"2026-02-17T11:53:47.031808+0000","last_fullsized":"2026-02-17T11:53:47.031808+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673044,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":0,"seq":38654705744,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:54:05.226 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:54:05.380 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:54:05.381 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:54:05.388 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2026-02-17T11:54:05.358014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90808,"kb_used_data":1596,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283024712,"statfs":{"total":289910292480,"available":289817305088,"internally_reserved":0,"allocated":1634304,"data_stored":526683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4780,"internal_metadata":91286868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":103,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-17T11:53:47.031808+0000","last_change":"2026-02-17T11:50:18.915365+0000","last_active":"2026-02-17T11:53:47.031808+0000","last_peered":"2026-02-17T11:53:47.031808+0000","last_clean":"2026-02-17T11:53:47.031808+0000","last_became_active":"2026-02-17T11:50:18.915141+0000","last_became_peered":"2026-02-17T11:50:18.915141+0000","last_unstale":"2026-02-17T11:53:47.031808+0000","last_undegraded":"2026-02-17T11:53:47.031808+0000","last_fullsized":"2026-02-17T11:53:47.031808+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:50:17.686342+0000","last_clean_scrub_stamp":"2026-02-17T11:50:17.686342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:07:31.910740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673044,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":0,"seq":38654705744,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:54:05.389 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:54:05.390 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-17T11:54:05.390 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-17T11:54:06.053 INFO:teuthology.orchestra.run.trial077.stderr:pool 'unique_pool_0' removed 2026-02-17T11:54:06.065 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T11:54:06.072 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:54:06.072 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:54:06.226 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:54:06.226 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:54:06.234 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2026-02-17T11:54:06.053168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90808,"kb_used_data":1596,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283024712,"statfs":{"total":289910292480,"available":289817305088,"internally_reserved":0,"allocated":1634304,"data_stored":526683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4780,"internal_metadata":91286868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673044,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":0,"seq":38654705744,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T11:54:06.235 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:54:06.391 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:54:06.391 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:54:06.400 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2026-02-17T11:54:06.053168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90808,"kb_used_data":1596,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283024712,"statfs":{"total":289910292480,"available":289817305088,"internally_reserved":0,"allocated":1634304,"data_stored":526683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4780,"internal_metadata":91286868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673044,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":0,"seq":38654705744,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T11:54:06.401 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:54:06.402 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:54:06.555 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:54:06.556 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:54:06.564 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2026-02-17T11:54:06.053168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90808,"kb_used_data":1596,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283024712,"statfs":{"total":289910292480,"available":289817305088,"internally_reserved":0,"allocated":1634304,"data_stored":526683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4780,"internal_metadata":91286868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673044,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":0,"seq":38654705744,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T11:54:06.565 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:54:06.720 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:54:06.721 INFO:teuthology.orchestra.run.trial077.stdout:{"epoch":61,"fsid":"4d96ab44-13c8-4fda-b382-9a8084746268","created":"2026-02-17T11:49:59.092535+0000","modified":"2026-02-17T11:54:06.050475+0000","last_up_change":"2026-02-17T11:50:08.680878+0000","last_in_change":"2026-02-17T11:53:46.024578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06177586-2b45-40c3-b057-27ca047bcee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6809","nonce":1703738410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6810","nonce":1703738410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6812","nonce":1703738410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6811","nonce":1703738410}]},"public_addr":"10.20.193.77:6809/1703738410","cluster_addr":"10.20.193.77:6810/1703738410","heartbeat_back_addr":"10.20.193.77:6812/1703738410","heartbeat_front_addr":"10.20.193.77:6811/1703738410","state":["exists","up"]},{"osd":1,"uuid":"b27a2a57-5389-4f5b-9c07-b2763002c491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6805","nonce":1797012593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6806","nonce":1797012593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6808","nonce":1797012593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6807","nonce":1797012593}]},"public_addr":"10.20.193.77:6805/1797012593","cluster_addr":"10.20.193.77:6806/1797012593","heartbeat_back_addr":"10.20.193.77:6808/1797012593","heartbeat_front_addr":"10.20.193.77:6807/1797012593","state":["exists","up"]},{"osd":2,"uuid":"0ddddeda-62c7-4530-9403-865bcc4a3d7f","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6801","nonce":3063125123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6802","nonce":3063125123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6804","nonce":3063125123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6803","nonce":3063125123}]},"public_addr":"10.20.193.77:6801/3063125123","cluster_addr":"10.20.193.77:6802/3063125123","heartbeat_back_addr":"10.20.193.77:6804/3063125123","heartbeat_front_addr":"10.20.193.77:6803/3063125123","state":["exists","up"]},{"osd":3,"uuid":"8158b67f-f2f9-4ae4-af05-ca370365fe36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6813","nonce":1132871409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6814","nonce":1132871409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6816","nonce":1132871409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.77:6815","nonce":1132871409}]},"public_addr":"10.20.193.77:6813/1132871409","cluster_addr":"10.20.193.77:6814/1132871409","heartbeat_back_addr":"10.20.193.77:6816/1132871409","heartbeat_front_addr":"10.20.193.77:6815/1132871409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.144564+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.426038+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":65536,"last_purged_snaps_scrub":"2026-02-17T11:50:06.182078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:50:06.655788+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:54:07.730 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T11:54:07.730 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:54:07.816 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T11:54:07.816 INFO:teuthology.orchestra.run.trial077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:54:07.816 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T11:54:07.821 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T11:54:07.976 INFO:teuthology.orchestra.run.trial077.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T11:54:07.985 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T11:54:07.986 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:54:08.065 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T11:54:08.065 INFO:teuthology.orchestra.run.trial077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:54:08.066 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T11:54:08.073 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T11:54:08.228 INFO:teuthology.orchestra.run.trial077.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T11:54:08.236 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T11:54:08.236 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:54:08.315 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T11:54:08.316 INFO:teuthology.orchestra.run.trial077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:54:08.316 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T11:54:08.322 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T11:54:08.479 INFO:teuthology.orchestra.run.trial077.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T11:54:08.488 INFO:tasks.ceph:Scrubbing osd.3 2026-02-17T11:54:08.489 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:54:08.568 INFO:teuthology.orchestra.run.trial077.stdout:{ 2026-02-17T11:54:08.568 INFO:teuthology.orchestra.run.trial077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:54:08.568 INFO:teuthology.orchestra.run.trial077.stdout:} 2026-02-17T11:54:08.573 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-17T11:54:08.731 INFO:teuthology.orchestra.run.trial077.stderr:instructed osd(s) 3 to deep-scrub 2026-02-17T11:54:08.739 DEBUG:teuthology.orchestra.run.trial077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:54:08.894 INFO:teuthology.orchestra.run.trial077.stdout: 2026-02-17T11:54:08.895 INFO:teuthology.orchestra.run.trial077.stderr:dumped all 2026-02-17T11:54:08.903 INFO:teuthology.orchestra.run.trial077.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2026-02-17T11:54:07.358214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90808,"kb_used_data":1596,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":283024712,"statfs":{"total":289910292480,"available":289817305088,"internally_reserved":0,"allocated":1634304,"data_stored":526683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4780,"internal_metadata":91286868},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673044,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":0,"seq":38654705744,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":544768,"data_stored":175561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T11:54:08.904 DEBUG:teuthology.orchestra.run.trial077:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T11:54:09.070 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T11:54:09.070 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T11:54:09.070 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T11:54:09.070 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:54:09.121 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T11:54:09.121 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T11:54:09.121 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:54:09.155 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T11:54:09.155 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T11:54:09.155 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:54:09.225 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T11:54:09.225 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-17T11:54:09.225 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:54:09.291 INFO:tasks.ceph.osd.3:Stopped 2026-02-17T11:54:09.291 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T11:54:09.291 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T11:54:09.291 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:54:09.360 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T11:54:09.360 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T11:54:09.360 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T11:54:09.360 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:54:09.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-17T11:54:09.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2026-02-17T11:54:09.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-17T11:54:09.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-17T11:54:09.410 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T11:54:09.411 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T11:54:09.411 DEBUG:teuthology.orchestra.run.trial077:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v '\(PG_' | egrep -v '\(PENDING_CREATING_PGS\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-17T11:54:09.478 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T11:54:09.478 DEBUG:teuthology.orchestra.run.trial077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T11:54:09.555 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T11:54:09.555 DEBUG:teuthology.orchestra.run.trial077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T11:54:09.625 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T11:54:09.625 DEBUG:teuthology.orchestra.run.trial077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T11:54:09.692 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial077.front.sepia.ceph.com 2026-02-17T11:54:09.693 DEBUG:teuthology.orchestra.run.trial077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-17T11:54:09.761 INFO:tasks.ceph:Archiving mon data... 2026-02-17T11:54:09.763 DEBUG:teuthology.misc:Transferring archived files from trial077:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51347/data/mon.a.tgz 2026-02-17T11:54:09.763 DEBUG:teuthology.orchestra.run.trial077:> mktemp 2026-02-17T11:54:09.816 INFO:teuthology.orchestra.run.trial077.stdout:/tmp/tmp.pKa0QfsCA3 2026-02-17T11:54:09.816 DEBUG:teuthology.orchestra.run.trial077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.pKa0QfsCA3 2026-02-17T11:54:09.908 DEBUG:teuthology.orchestra.run.trial077:> sudo chmod 0666 /tmp/tmp.pKa0QfsCA3 2026-02-17T11:54:09.988 DEBUG:teuthology.orchestra.remote:trial077:/tmp/tmp.pKa0QfsCA3 is 222KB 2026-02-17T11:54:10.048 DEBUG:teuthology.orchestra.run.trial077:> rm -fr /tmp/tmp.pKa0QfsCA3 2026-02-17T11:54:10.063 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T11:54:10.063 DEBUG:teuthology.orchestra.run.trial077:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T11:54:10.183 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T11:54:10.183 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T11:54:10.186 DEBUG:teuthology.misc:Transferring archived files from trial077:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51347/remote/trial077/crash 2026-02-17T11:54:10.188 DEBUG:teuthology.orchestra.run.trial077:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T11:54:10.246 INFO:tasks.ceph:Compressing logs... 2026-02-17T11:54:10.246 DEBUG:teuthology.orchestra.run.trial077:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:54:10.269 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57545.log 2026-02-17T11:54:10.269 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69661.log 2026-02-17T11:54:10.269 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55474.log 2026-02-17T11:54:10.269 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57545.log.gz 2026-02-17T11:54:10.269 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69661.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T11:54:10.270 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69661.log.gz 2026-02-17T11:54:10.270 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43506.log 2026-02-17T11:54:10.270 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55474.log.gz 2026-02-17T11:54:10.270 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64192.log 2026-02-17T11:54:10.270 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63334.log 2026-02-17T11:54:10.270 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.43506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43506.log.gz 2026-02-17T11:54:10.271 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64192.log.gz 2026-02-17T11:54:10.271 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70642.log 2026-02-17T11:54:10.271 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74688.log 2026-02-17T11:54:10.271 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63334.log.gz 2026-02-17T11:54:10.271 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64839.log 2026-02-17T11:54:10.271 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70642.log.gz 2026-02-17T11:54:10.271 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74688.log.gz 2026-02-17T11:54:10.271 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65620.log 2026-02-17T11:54:10.272 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64839.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-mon.a.log 2026-02-17T11:54:10.272 INFO:teuthology.orchestra.run.trial077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64839.log.gz 2026-02-17T11:54:10.272 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55268.log 2026-02-17T11:54:10.272 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65620.log.gz 2026-02-17T11:54:10.272 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49029.log 2026-02-17T11:54:10.272 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50623.log 2026-02-17T11:54:10.273 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55268.log.gz 2026-02-17T11:54:10.273 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49029.log.gz 2026-02-17T11:54:10.273 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60868.log 2026-02-17T11:54:10.273 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69975.log 2026-02-17T11:54:10.273 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50623.log.gz 2026-02-17T11:54:10.273 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60868.log.gz 2026-02-17T11:54:10.273 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73710.log 2026-02-17T11:54:10.274 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69975.log.gz 2026-02-17T11:54:10.274 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60274.log 2026-02-17T11:54:10.274 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62452.log 2026-02-17T11:54:10.274 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73710.log.gz 2026-02-17T11:54:10.274 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60274.log.gz 2026-02-17T11:54:10.274 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68293.log 2026-02-17T11:54:10.274 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69027.log 2026-02-17T11:54:10.274 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62452.log.gz 2026-02-17T11:54:10.275 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67784.log 2026-02-17T11:54:10.275 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68293.log.gz 2026-02-17T11:54:10.275 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69027.log.gz 2026-02-17T11:54:10.275 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49407.log 2026-02-17T11:54:10.275 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47723.log 2026-02-17T11:54:10.275 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67784.log.gz 2026-02-17T11:54:10.275 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61107.log 2026-02-17T11:54:10.276 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49407.log.gz 2026-02-17T11:54:10.276 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.47723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47723.log.gz 2026-02-17T11:54:10.276 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54431.log 2026-02-17T11:54:10.276 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61107.log.gz 2026-02-17T11:54:10.276 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49863.log 2026-02-17T11:54:10.276 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54431.log.gz 2026-02-17T11:54:10.276 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55473.log 2026-02-17T11:54:10.276 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59631.log 2026-02-17T11:54:10.276 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49863.log.gz 2026-02-17T11:54:10.277 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55473.log.gz 2026-02-17T11:54:10.277 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T11:54:10.277 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62282.log 2026-02-17T11:54:10.277 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59631.log.gz 2026-02-17T11:54:10.277 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50624.log 2026-02-17T11:54:10.277 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62282.log.gz 2026-02-17T11:54:10.277 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47602.log 2026-02-17T11:54:10.278 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66117.log 2026-02-17T11:54:10.278 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50624.log.gz 2026-02-17T11:54:10.278 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.47602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47602.log.gz 2026-02-17T11:54:10.278 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73362.log 2026-02-17T11:54:10.278 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63611.log 2026-02-17T11:54:10.278 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66117.log.gz 2026-02-17T11:54:10.279 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73362.log.gz 2026-02-17T11:54:10.279 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65153.log 2026-02-17T11:54:10.279 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55971.log 2026-02-17T11:54:10.279 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63611.log.gz 2026-02-17T11:54:10.279 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65153.log.gz 2026-02-17T11:54:10.279 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47772.log 2026-02-17T11:54:10.279 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72311.log 2026-02-17T11:54:10.279 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55971.log.gz 2026-02-17T11:54:10.280 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.47772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47772.log.gz 2026-02-17T11:54:10.280 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57768.log 2026-02-17T11:54:10.280 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72311.log.gz 2026-02-17T11:54:10.280 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52123.log 2026-02-17T11:54:10.280 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57768.log.gz 2026-02-17T11:54:10.280 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58809.log 2026-02-17T11:54:10.280 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52123.log.gz 2026-02-17T11:54:10.280 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67345.log 2026-02-17T11:54:10.281 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56099.log 2026-02-17T11:54:10.281 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58809.log.gz 2026-02-17T11:54:10.281 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67345.log.gz 2026-02-17T11:54:10.281 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56295.log 2026-02-17T11:54:10.281 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74836.log 2026-02-17T11:54:10.281 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56099.log.gz 2026-02-17T11:54:10.281 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56295.log.gz 2026-02-17T11:54:10.281 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61517.log 2026-02-17T11:54:10.282 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74836.log.gz 2026-02-17T11:54:10.282 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52463.log 2026-02-17T11:54:10.282 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61517.log.gz 2026-02-17T11:54:10.282 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71135.log 2026-02-17T11:54:10.282 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66509.log 2026-02-17T11:54:10.282 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52463.log.gz 2026-02-17T11:54:10.282 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71135.log.gz 2026-02-17T11:54:10.282 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47901.log 2026-02-17T11:54:10.283 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54429.log 2026-02-17T11:54:10.283 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66509.log.gz 2026-02-17T11:54:10.283 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.47901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47901.log.gz 2026-02-17T11:54:10.283 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57472.log 2026-02-17T11:54:10.283 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60668.log 2026-02-17T11:54:10.283 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54429.log.gz 2026-02-17T11:54:10.284 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57472.log.gz 2026-02-17T11:54:10.284 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59635.log 2026-02-17T11:54:10.284 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60668.log.gz 2026-02-17T11:54:10.284 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51468.log 2026-02-17T11:54:10.284 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54189.log 2026-02-17T11:54:10.284 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59635.log.gz 2026-02-17T11:54:10.284 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51468.log.gz 2026-02-17T11:54:10.284 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49343.log 2026-02-17T11:54:10.285 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54189.log.gz 2026-02-17T11:54:10.285 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48834.log 2026-02-17T11:54:10.285 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49343.log.gz 2026-02-17T11:54:10.285 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69466.log 2026-02-17T11:54:10.285 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48834.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-17T11:54:10.285 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48834.log.gz 2026-02-17T11:54:10.285 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68620.log 2026-02-17T11:54:10.285 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69466.log.gz 2026-02-17T11:54:10.286 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51259.log 2026-02-17T11:54:10.286 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64317.log 2026-02-17T11:54:10.286 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68620.log.gz 2026-02-17T11:54:10.286 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51259.log.gz 2026-02-17T11:54:10.286 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66503.log 2026-02-17T11:54:10.287 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65478.log 2026-02-17T11:54:10.288 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64317.log.gz 2026-02-17T11:54:10.288 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58774.log 2026-02-17T11:54:10.288 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66503.log.gz 2026-02-17T11:54:10.288 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65478.log.gz 2026-02-17T11:54:10.288 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60273.log 2026-02-17T11:54:10.288 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66624.log 2026-02-17T11:54:10.288 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58774.log.gz 2026-02-17T11:54:10.289 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60273.log.gz 2026-02-17T11:54:10.289 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74837.log 2026-02-17T11:54:10.289 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66624.log.gz 2026-02-17T11:54:10.289 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54159.log 2026-02-17T11:54:10.289 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74837.log.gz 2026-02-17T11:54:10.289 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61305.log 2026-02-17T11:54:10.289 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63116.log 2026-02-17T11:54:10.289 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54159.log.gz 2026-02-17T11:54:10.289 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61305.log.gz 2026-02-17T11:54:10.289 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70174.log 2026-02-17T11:54:10.290 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63116.log.gz 2026-02-17T11:54:10.290 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64838.log 2026-02-17T11:54:10.290 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70174.log.gz 2026-02-17T11:54:10.290 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62947.log 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64838.log.gz 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63484.log 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67341.log 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62947.log.gz 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63484.log.gz 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74930.log 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67341.log.gz 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53367.log 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74930.log.gz 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65679.log 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70712.log 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53367.log.gz 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65679.log.gz 2026-02-17T11:54:10.291 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57938.log 2026-02-17T11:54:10.292 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70712.log.gz 2026-02-17T11:54:10.292 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51649.log 2026-02-17T11:54:10.292 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65283.log 2026-02-17T11:54:10.292 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57938.log: /var/log/ceph/ceph-client.admin.51649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57938.log.gz 2026-02-17T11:54:10.293 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51649.log.gz 2026-02-17T11:54:10.293 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69465.log 2026-02-17T11:54:10.293 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65283.log.gz 2026-02-17T11:54:10.293 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60146.log 2026-02-17T11:54:10.293 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69465.log.gz 2026-02-17T11:54:10.293 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56937.log 2026-02-17T11:54:10.293 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60146.log.gz 2026-02-17T11:54:10.293 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69664.log 2026-02-17T11:54:10.293 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72480.log 2026-02-17T11:54:10.294 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56937.log.gz 2026-02-17T11:54:10.294 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69664.log.gz 2026-02-17T11:54:10.294 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74199.log 2026-02-17T11:54:10.294 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65477.log 2026-02-17T11:54:10.294 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72480.log.gz 2026-02-17T11:54:10.294 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74199.log.gz 2026-02-17T11:54:10.294 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52762.log 2026-02-17T11:54:10.296 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65477.log.gz 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52330.log 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52762.log.gz 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57940.log 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52330.log.gz 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70837.log 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57940.log.gz 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59947.log 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70837.log.gz 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53794.log 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59947.log.gz 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71331.log 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53794.log.gz 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50031.log 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71331.log.gz 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70499.log 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50031.log.gz 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49031.log 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70499.log.gz 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53962.log 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49031.log.gz 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65003.log 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72167.log/var/log/ceph/ceph-client.admin.53962.log: 2026-02-17T11:54:10.297 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53962.log.gz 2026-02-17T11:54:10.298 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65003.log.gz 2026-02-17T11:54:10.298 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64954.log 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75665.log 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72167.log.gz 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64954.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.64954.log.gz -5 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49147.log 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75665.log.gz 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73976.log 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49147.log.gz 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72310.log 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73976.log.gz 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72561.log 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72310.log.gz 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43786.log 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72561.log.gz 2026-02-17T11:54:10.299 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59114.log 2026-02-17T11:54:10.300 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.43786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43786.log.gz 2026-02-17T11:54:10.300 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55579.log 2026-02-17T11:54:10.300 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59114.log.gz 2026-02-17T11:54:10.300 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57471.log 2026-02-17T11:54:10.300 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55579.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.55579.log.gz --verbose 2026-02-17T11:54:10.300 INFO:teuthology.orchestra.run.trial077.stderr: -- /var/log/ceph/ceph-client.admin.70302.log 2026-02-17T11:54:10.300 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57471.log.gz 2026-02-17T11:54:10.300 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59996.log 2026-02-17T11:54:10.300 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70302.log.gz 2026-02-17T11:54:10.300 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65282.log 2026-02-17T11:54:10.300 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59996.log.gz 2026-02-17T11:54:10.300 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62340.log 2026-02-17T11:54:10.301 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65282.log.gz 2026-02-17T11:54:10.301 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66953.log 2026-02-17T11:54:10.301 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62340.log.gz 2026-02-17T11:54:10.301 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65888.log 2026-02-17T11:54:10.301 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66953.log.gz 2026-02-17T11:54:10.301 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57546.log 2026-02-17T11:54:10.301 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65888.log.gz 2026-02-17T11:54:10.301 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48307.log 2026-02-17T11:54:10.301 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57546.log.gz 2026-02-17T11:54:10.302 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50866.log 2026-02-17T11:54:10.302 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48307.log.gz 2026-02-17T11:54:10.302 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54158.log 2026-02-17T11:54:10.302 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50866.log.gz 2026-02-17T11:54:10.302 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69230.log 2026-02-17T11:54:10.302 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54158.log.gz 2026-02-17T11:54:10.302 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63614.log 2026-02-17T11:54:10.302 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69230.log.gz 2026-02-17T11:54:10.302 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60045.log 2026-02-17T11:54:10.302 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63614.log.gz 2026-02-17T11:54:10.302 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54988.log 2026-02-17T11:54:10.303 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71843.log 2026-02-17T11:54:10.303 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60045.log.gz 2026-02-17T11:54:10.303 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54988.log.gz 2026-02-17T11:54:10.303 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68815.log 2026-02-17T11:54:10.303 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71843.log.gz 2026-02-17T11:54:10.303 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59438.log 2026-02-17T11:54:10.304 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43880.log 2026-02-17T11:54:10.304 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68815.log.gz 2026-02-17T11:54:10.304 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59438.log.gz 2026-02-17T11:54:10.304 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67786.log 2026-02-17T11:54:10.304 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.43880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43880.log.gz 2026-02-17T11:54:10.304 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70498.log 2026-02-17T11:54:10.304 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67786.log.gz 2026-02-17T11:54:10.304 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73563.log 2026-02-17T11:54:10.304 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70498.log.gz 2026-02-17T11:54:10.304 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51262.log 2026-02-17T11:54:10.305 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66722.log 2026-02-17T11:54:10.305 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73563.log.gz 2026-02-17T11:54:10.305 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51262.log.gz 2026-02-17T11:54:10.305 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69662.log 2026-02-17T11:54:10.305 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72806.log 2026-02-17T11:54:10.305 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66722.log.gz 2026-02-17T11:54:10.305 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69662.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.69662.log.gz --verbose -- 2026-02-17T11:54:10.305 INFO:teuthology.orchestra.run.trial077.stderr: /var/log/ceph/ceph-client.admin.48832.log 2026-02-17T11:54:10.306 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72806.log.gz 2026-02-17T11:54:10.306 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70125.log 2026-02-17T11:54:10.306 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69168.log 2026-02-17T11:54:10.306 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48832.log.gz 2026-02-17T11:54:10.306 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70125.log.gz 2026-02-17T11:54:10.306 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62776.log 2026-02-17T11:54:10.307 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69168.log.gz 2026-02-17T11:54:10.307 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53596.log 2026-02-17T11:54:10.307 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62776.log.gz 2026-02-17T11:54:10.307 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71693.log 2026-02-17T11:54:10.307 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53596.log.gz 2026-02-17T11:54:10.307 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55880.log 2026-02-17T11:54:10.307 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71693.log.gz 2026-02-17T11:54:10.307 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61942.log 2026-02-17T11:54:10.307 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55880.log.gz 2026-02-17T11:54:10.307 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47674.log 2026-02-17T11:54:10.308 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61942.log.gz 2026-02-17T11:54:10.308 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58606.log 2026-02-17T11:54:10.308 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.47674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47674.log.gz 2026-02-17T11:54:10.308 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68622.log 2026-02-17T11:54:10.308 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58606.log.gz 2026-02-17T11:54:10.308 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58108.log 2026-02-17T11:54:10.308 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68622.log.gz 2026-02-17T11:54:10.308 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75077.log 2026-02-17T11:54:10.309 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58108.log.gz 2026-02-17T11:54:10.309 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56499.log 2026-02-17T11:54:10.309 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75077.log.gz 2026-02-17T11:54:10.309 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52121.log 2026-02-17T11:54:10.309 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56499.log.gz 2026-02-17T11:54:10.309 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66312.log 2026-02-17T11:54:10.309 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52121.log.gz 2026-02-17T11:54:10.310 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61303.log 2026-02-17T11:54:10.310 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66312.log.gz 2026-02-17T11:54:10.310 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67148.log 2026-02-17T11:54:10.310 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61303.log.gz 2026-02-17T11:54:10.310 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50453.log 2026-02-17T11:54:10.310 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67148.log.gz 2026-02-17T11:54:10.310 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61518.log 2026-02-17T11:54:10.310 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50453.log.gz 2026-02-17T11:54:10.310 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48097.log 2026-02-17T11:54:10.311 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67487.log 2026-02-17T11:54:10.311 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61518.log.gz 2026-02-17T11:54:10.311 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48097.log.gz 2026-02-17T11:54:10.311 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68124.log 2026-02-17T11:54:10.311 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62140.log 2026-02-17T11:54:10.311 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67487.log.gz 2026-02-17T11:54:10.311 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68124.log.gz 2026-02-17T11:54:10.311 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55089.log 2026-02-17T11:54:10.312 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51404.log 2026-02-17T11:54:10.312 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62140.log.gz 2026-02-17T11:54:10.312 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55089.log.gz 2026-02-17T11:54:10.312 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72676.log 2026-02-17T11:54:10.312 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53468.log 2026-02-17T11:54:10.312 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51404.log.gz 2026-02-17T11:54:10.312 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52956.log 2026-02-17T11:54:10.312 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72676.log.gz 2026-02-17T11:54:10.313 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53468.log.gz 2026-02-17T11:54:10.313 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66673.log 2026-02-17T11:54:10.313 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62777.log 2026-02-17T11:54:10.313 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52956.log.gz 2026-02-17T11:54:10.313 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66673.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.52528.log -- replaced with /var/log/ceph/ceph-client.admin.66673.log.gz 2026-02-17T11:54:10.313 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T11:54:10.313 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62777.log.gz 2026-02-17T11:54:10.314 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49668.log 2026-02-17T11:54:10.314 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52528.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.52528.log.gz -5 2026-02-17T11:54:10.314 INFO:teuthology.orchestra.run.trial077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43618.log 2026-02-17T11:54:10.314 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75910.log 2026-02-17T11:54:10.314 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49668.log.gz 2026-02-17T11:54:10.314 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.43618.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.43618.log.gz --verbose 2026-02-17T11:54:10.314 INFO:teuthology.orchestra.run.trial077.stderr: -- /var/log/ceph/ceph-client.admin.51600.log 2026-02-17T11:54:10.315 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47525.log 2026-02-17T11:54:10.315 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75910.log.gz 2026-02-17T11:54:10.315 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51600.log.gz 2026-02-17T11:54:10.315 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62997.log 2026-02-17T11:54:10.315 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.47525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47525.log.gz 2026-02-17T11:54:10.315 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73411.log 2026-02-17T11:54:10.316 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48556.log 2026-02-17T11:54:10.316 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62997.log.gz 2026-02-17T11:54:10.316 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73830.log 2026-02-17T11:54:10.316 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73411.log.gz 2026-02-17T11:54:10.316 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65280.log 2026-02-17T11:54:10.316 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48556.log.gz 2026-02-17T11:54:10.316 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53173.log 2026-02-17T11:54:10.316 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73830.log.gz 2026-02-17T11:54:10.316 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65280.log.gz 2026-02-17T11:54:10.316 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48240.log 2026-02-17T11:54:10.316 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65281.log 2026-02-17T11:54:10.317 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53173.log.gz 2026-02-17T11:54:10.317 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59439.log 2026-02-17T11:54:10.317 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48240.log.gz 2026-02-17T11:54:10.317 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69871.log 2026-02-17T11:54:10.317 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65281.log.gz 2026-02-17T11:54:10.317 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59439.log.gz 2026-02-17T11:54:10.317 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71972.log 2026-02-17T11:54:10.318 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52632.log 2026-02-17T11:54:10.318 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69871.log.gz 2026-02-17T11:54:10.318 INFO:teuthology.orchestra.run.trial077.stderr:gzip/var/log/ceph/ceph-client.admin.71972.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60979.log 2026-02-17T11:54:10.318 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71972.log.gz 2026-02-17T11:54:10.318 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54939.log 2026-02-17T11:54:10.318 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52632.log.gz 2026-02-17T11:54:10.318 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56807.log 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60979.log.gz 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53318.log 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54939.log.gz 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70301.log 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56807.log.gz 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51091.log 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53318.log.gz 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70301.log: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.70301.log.gz 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66313.log 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67980.log 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51091.log.gz 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51312.log 2026-02-17T11:54:10.319 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66313.log.gz 2026-02-17T11:54:10.320 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67980.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.64447.log -- replaced with /var/log/ceph/ceph-client.admin.67980.log.gz 2026-02-17T11:54:10.320 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T11:54:10.320 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51312.log.gz 2026-02-17T11:54:10.320 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47902.log 2026-02-17T11:54:10.320 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70500.log 2026-02-17T11:54:10.320 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64447.log.gz 2026-02-17T11:54:10.320 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.47902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47902.log.gz 2026-02-17T11:54:10.320 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59636.log 2026-02-17T11:54:10.321 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70500.log.gz 2026-02-17T11:54:10.321 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51928.log 2026-02-17T11:54:10.321 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57769.log 2026-02-17T11:54:10.321 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59636.log.gz 2026-02-17T11:54:10.321 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53419.log 2026-02-17T11:54:10.321 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51928.log.gz 2026-02-17T11:54:10.321 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57769.log.gz 2026-02-17T11:54:10.321 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59777.log 2026-02-17T11:54:10.321 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53419.log.gz 2026-02-17T11:54:10.321 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75812.log 2026-02-17T11:54:10.322 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73143.log 2026-02-17T11:54:10.322 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59777.log.gz 2026-02-17T11:54:10.322 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73002.log 2026-02-17T11:54:10.322 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75812.log.gz 2026-02-17T11:54:10.322 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73143.log.gz 2026-02-17T11:54:10.322 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64016.log 2026-02-17T11:54:10.322 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54430.log 2026-02-17T11:54:10.322 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73002.log.gz 2026-02-17T11:54:10.323 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62479.log 2026-02-17T11:54:10.323 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64016.log.gz 2026-02-17T11:54:10.323 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63609.log 2026-02-17T11:54:10.323 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54430.log.gz 2026-02-17T11:54:10.323 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70641.log 2026-02-17T11:54:10.323 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62479.log.gz 2026-02-17T11:54:10.324 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71973.log 2026-02-17T11:54:10.324 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63609.log.gz 2026-02-17T11:54:10.324 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53963.log 2026-02-17T11:54:10.324 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70641.log.gz 2026-02-17T11:54:10.324 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73000.log 2026-02-17T11:54:10.324 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71973.log.gz 2026-02-17T11:54:10.324 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53963.log.gz 2026-02-17T11:54:10.324 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48096.log 2026-02-17T11:54:10.324 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55466.log 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73000.log.gz 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62648.log 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48096.log.gz 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55466.log.gz 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57132.log 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62648.log.gz 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60471.log 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57132.log.gz 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56098.log 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.60471.log: /var/log/ceph/ceph-client.admin.66114.log 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60471.log.gz 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56098.log.gz 2026-02-17T11:54:10.325 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58999.log 2026-02-17T11:54:10.326 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72559.log 2026-02-17T11:54:10.326 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66114.log.gz 2026-02-17T11:54:10.326 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67783.log 2026-02-17T11:54:10.326 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58999.log.gz 2026-02-17T11:54:10.326 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59001.log 2026-02-17T11:54:10.326 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72559.log.gz 2026-02-17T11:54:10.326 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67783.log.gz 2026-02-17T11:54:10.326 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58327.log 2026-02-17T11:54:10.327 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59001.log.gz 2026-02-17T11:54:10.327 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72368.log 2026-02-17T11:54:10.327 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67982.log 2026-02-17T11:54:10.327 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58327.log.gz 2026-02-17T11:54:10.327 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65790.log 2026-02-17T11:54:10.327 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72368.log.gz 2026-02-17T11:54:10.328 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67982.log.gz 2026-02-17T11:54:10.328 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56706.log 2026-02-17T11:54:10.328 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48835.log 2026-02-17T11:54:10.328 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65790.log.gz 2026-02-17T11:54:10.328 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68816.log 2026-02-17T11:54:10.328 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56706.log.gz 2026-02-17T11:54:10.328 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48835.log.gz 2026-02-17T11:54:10.328 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52267.log 2026-02-17T11:54:10.328 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55266.log 2026-02-17T11:54:10.329 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68816.log.gz 2026-02-17T11:54:10.329 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74097.log 2026-02-17T11:54:10.329 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52267.log.gz 2026-02-17T11:54:10.329 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55266.log.gz 2026-02-17T11:54:10.329 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65678.log 2026-02-17T11:54:10.329 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67785.log 2026-02-17T11:54:10.329 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74097.log.gz 2026-02-17T11:54:10.330 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75126.log 2026-02-17T11:54:10.330 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65678.log.gz 2026-02-17T11:54:10.330 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67785.log.gz 2026-02-17T11:54:10.330 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73001.log 2026-02-17T11:54:10.330 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67981.log 2026-02-17T11:54:10.330 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75126.log.gz 2026-02-17T11:54:10.330 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63613.log 2026-02-17T11:54:10.330 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73001.log.gz 2026-02-17T11:54:10.330 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67981.log.gz 2026-02-17T11:54:10.330 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71137.log 2026-02-17T11:54:10.331 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74835.log 2026-02-17T11:54:10.331 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63613.log.gz 2026-02-17T11:54:10.331 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58918.log 2026-02-17T11:54:10.331 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71137.log.gz 2026-02-17T11:54:10.331 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74835.log.gz 2026-02-17T11:54:10.331 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48409.log 2026-02-17T11:54:10.332 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58604.log 2026-02-17T11:54:10.332 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58918.log.gz 2026-02-17T11:54:10.332 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73708.log 2026-02-17T11:54:10.332 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48409.log.gz 2026-02-17T11:54:10.332 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60665.log 2026-02-17T11:54:10.332 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58604.log.gz 2026-02-17T11:54:10.332 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73708.log.gz 2026-02-17T11:54:10.332 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63826.log 2026-02-17T11:54:10.332 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.60665.log: /var/log/ceph/ceph.tmp-client.admin.37636.log 2026-02-17T11:54:10.332 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60665.log.gz 2026-02-17T11:54:10.333 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74200.log 2026-02-17T11:54:10.333 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63826.log.gz 2026-02-17T11:54:10.333 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph.tmp-client.admin.37636.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37636.log.gz 2026-02-17T11:54:10.333 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48239.log 2026-02-17T11:54:10.333 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70304.log 2026-02-17T11:54:10.333 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74200.log.gz 2026-02-17T11:54:10.333 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66115.log 2026-02-17T11:54:10.333 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48239.log.gz 2026-02-17T11:54:10.333 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70304.log.gz 2026-02-17T11:54:10.333 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60810.log 2026-02-17T11:54:10.334 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73562.log 2026-02-17T11:54:10.334 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66115.log.gz 2026-02-17T11:54:10.334 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60472.log 2026-02-17T11:54:10.334 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60810.log.gz 2026-02-17T11:54:10.334 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49862.log 2026-02-17T11:54:10.334 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73562.log.gz 2026-02-17T11:54:10.335 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60472.log.gz 2026-02-17T11:54:10.335 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58607.log 2026-02-17T11:54:10.335 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49862.log.gz 2026-02-17T11:54:10.335 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75714.log 2026-02-17T11:54:10.335 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58607.log.gz 2026-02-17T11:54:10.335 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58477.log 2026-02-17T11:54:10.335 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75714.log.gz 2026-02-17T11:54:10.335 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61521.log 2026-02-17T11:54:10.335 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58477.log.gz 2026-02-17T11:54:10.336 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61420.log 2026-02-17T11:54:10.336 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61521.log.gz 2026-02-17T11:54:10.336 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63435.log 2026-02-17T11:54:10.336 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61420.log.gz 2026-02-17T11:54:10.336 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57770.log 2026-02-17T11:54:10.336 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58196.log 2026-02-17T11:54:10.336 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63435.log.gz 2026-02-17T11:54:10.337 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57770.log.gz 2026-02-17T11:54:10.337 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50454.log 2026-02-17T11:54:10.337 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58196.log.gz 2026-02-17T11:54:10.337 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59835.log 2026-02-17T11:54:10.337 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74998.log 2026-02-17T11:54:10.337 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50454.log.gz 2026-02-17T11:54:10.337 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59835.log.gz 2026-02-17T11:54:10.338 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48098.log 2026-02-17T11:54:10.338 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74998.log.gz 2026-02-17T11:54:10.338 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51090.log 2026-02-17T11:54:10.338 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48098.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.48098.log.gz --verbose 2026-02-17T11:54:10.338 INFO:teuthology.orchestra.run.trial077.stderr: -- /var/log/ceph/ceph-client.admin.63829.log 2026-02-17T11:54:10.338 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51090.log.gz 2026-02-17T11:54:10.338 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57303.log 2026-02-17T11:54:10.339 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63829.log.gz 2026-02-17T11:54:10.339 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72168.log 2026-02-17T11:54:10.339 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63756.log 2026-02-17T11:54:10.339 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57303.log.gz 2026-02-17T11:54:10.339 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72168.log.gz 2026-02-17T11:54:10.339 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49030.log 2026-02-17T11:54:10.339 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56297.log 2026-02-17T11:54:10.339 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63756.log.gz 2026-02-17T11:54:10.340 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49030.log.gz 2026-02-17T11:54:10.340 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71541.log 2026-02-17T11:54:10.340 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59634.log 2026-02-17T11:54:10.340 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56297.log.gz 2026-02-17T11:54:10.340 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5/var/log/ceph/ceph-client.admin.71541.log: --verbose -- /var/log/ceph/ceph-client.admin.73144.log 2026-02-17T11:54:10.340 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71541.log.gz 2026-02-17T11:54:10.340 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59634.log.gz 2026-02-17T11:54:10.340 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47900.log 2026-02-17T11:54:10.341 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52759.log 2026-02-17T11:54:10.341 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73144.log.gz 2026-02-17T11:54:10.341 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.47900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47900.log.gz 2026-02-17T11:54:10.341 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69169.log 2026-02-17T11:54:10.341 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52759.log.gz 2026-02-17T11:54:10.341 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55265.log 2026-02-17T11:54:10.342 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71971.log 2026-02-17T11:54:10.342 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69169.log.gz 2026-02-17T11:54:10.342 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55265.log.gz 2026-02-17T11:54:10.342 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75273.log 2026-02-17T11:54:10.343 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59310.log 2026-02-17T11:54:10.343 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71971.log.gz 2026-02-17T11:54:10.343 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58998.log 2026-02-17T11:54:10.343 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75273.log.gz 2026-02-17T11:54:10.343 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59310.log.gz 2026-02-17T11:54:10.343 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74994.log 2026-02-17T11:54:10.343 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58998.log.gz 2026-02-17T11:54:10.343 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68198.log 2026-02-17T11:54:10.344 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74994.log.gz 2026-02-17T11:54:10.344 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55647.log 2026-02-17T11:54:10.344 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57302.log 2026-02-17T11:54:10.344 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68198.log.gz 2026-02-17T11:54:10.344 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55647.log.gz 2026-02-17T11:54:10.344 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70912.log 2026-02-17T11:54:10.344 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65479.log 2026-02-17T11:54:10.344 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57302.log.gz 2026-02-17T11:54:10.344 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56608.log 2026-02-17T11:54:10.344 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70912.log.gz 2026-02-17T11:54:10.344 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65479.log.gz 2026-02-17T11:54:10.344 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50225.log 2026-02-17T11:54:10.345 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56608.log.gz 2026-02-17T11:54:10.345 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49238.log 2026-02-17T11:54:10.345 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64444.log 2026-02-17T11:54:10.345 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50225.log.gz 2026-02-17T11:54:10.345 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49238.log.gz 2026-02-17T11:54:10.345 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48458.log 2026-02-17T11:54:10.346 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66499.log 2026-02-17T11:54:10.346 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64444.log.gz 2026-02-17T11:54:10.346 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48458.log.gz 2026-02-17T11:54:10.346 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51926.log 2026-02-17T11:54:10.346 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66499.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.66499.log.gz --verbose -- 2026-02-17T11:54:10.346 INFO:teuthology.orchestra.run.trial077.stderr: /var/log/ceph/ceph-client.admin.74347.log 2026-02-17T11:54:10.346 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51926.log.gz 2026-02-17T11:54:10.346 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73202.log 2026-02-17T11:54:10.347 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53598.log 2026-02-17T11:54:10.347 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74347.log.gz 2026-02-17T11:54:10.347 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73202.log.gz 2026-02-17T11:54:10.347 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74587.log 2026-02-17T11:54:10.347 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60809.log 2026-02-17T11:54:10.347 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53598.log.gz 2026-02-17T11:54:10.347 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74587.log.gz 2026-02-17T11:54:10.347 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43927.log 2026-02-17T11:54:10.348 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60809.log.gz 2026-02-17T11:54:10.348 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60469.log 2026-02-17T11:54:10.348 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.43927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43927.log.gz 2026-02-17T11:54:10.348 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64836.log 2026-02-17T11:54:10.348 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60469.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60469.log.gz -5 2026-02-17T11:54:10.348 INFO:teuthology.orchestra.run.trial077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54625.log 2026-02-17T11:54:10.348 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64836.log.gz 2026-02-17T11:54:10.348 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59203.log 2026-02-17T11:54:10.349 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62562.log 2026-02-17T11:54:10.349 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54625.log.gz 2026-02-17T11:54:10.349 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59203.log.gz 2026-02-17T11:54:10.349 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52955.log 2026-02-17T11:54:10.349 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66310.log 2026-02-17T11:54:10.349 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62562.log.gz 2026-02-17T11:54:10.349 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52955.log.gz 2026-02-17T11:54:10.349 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49232.log 2026-02-17T11:54:10.350 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72166.log 2026-02-17T11:54:10.350 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66310.log.gz 2026-02-17T11:54:10.350 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49232.log.gz 2026-02-17T11:54:10.350 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73201.log 2026-02-17T11:54:10.350 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72166.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.68619.log -- replaced with /var/log/ceph/ceph-client.admin.72166.log.gz 2026-02-17T11:54:10.350 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T11:54:10.350 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73201.log.gz 2026-02-17T11:54:10.351 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68342.log 2026-02-17T11:54:10.351 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60867.log 2026-02-17T11:54:10.351 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68619.log.gz 2026-02-17T11:54:10.351 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68342.log.gz 2026-02-17T11:54:10.351 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75420.log 2026-02-17T11:54:10.351 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64835.log 2026-02-17T11:54:10.351 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60867.log.gz 2026-02-17T11:54:10.351 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75420.log.gz 2026-02-17T11:54:10.352 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61616.log 2026-02-17T11:54:10.352 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49667.log 2026-02-17T11:54:10.352 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64835.log.gz 2026-02-17T11:54:10.352 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61616.log.gz 2026-02-17T11:54:10.352 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56934.log 2026-02-17T11:54:10.352 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61815.log 2026-02-17T11:54:10.352 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49667.log.gz 2026-02-17T11:54:10.353 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56934.log.gz 2026-02-17T11:54:10.353 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47899.log 2026-02-17T11:54:10.353 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50660.log 2026-02-17T11:54:10.353 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61815.log.gz 2026-02-17T11:54:10.353 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.47899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62946.log 2026-02-17T11:54:10.353 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47899.log.gz 2026-02-17T11:54:10.353 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66950.log 2026-02-17T11:54:10.353 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50660.log.gz 2026-02-17T11:54:10.354 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62946.log.gz 2026-02-17T11:54:10.354 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58605.log 2026-02-17T11:54:10.354 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66950.log.gz 2026-02-17T11:54:10.354 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56936.log 2026-02-17T11:54:10.354 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58605.log.gz 2026-02-17T11:54:10.354 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68960.log 2026-02-17T11:54:10.354 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56936.log.gz 2026-02-17T11:54:10.354 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71134.log 2026-02-17T11:54:10.355 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68960.log.gz 2026-02-17T11:54:10.355 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53099.log 2026-02-17T11:54:10.355 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71134.log.gz 2026-02-17T11:54:10.355 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52958.log 2026-02-17T11:54:10.355 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53099.log.gz 2026-02-17T11:54:10.355 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T11:54:10.356 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52958.log.gz 2026-02-17T11:54:10.356 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62283.log 2026-02-17T11:54:10.356 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72169.log 2026-02-17T11:54:10.356 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62283.log.gz 2026-02-17T11:54:10.356 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73313.log 2026-02-17T11:54:10.356 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53100.log 2026-02-17T11:54:10.357 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72169.log.gz 2026-02-17T11:54:10.357 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73313.log.gz 2026-02-17T11:54:10.357 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70895.log 2026-02-17T11:54:10.357 INFO:teuthology.orchestra.run.trial077.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T11:54:10.357 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71136.log 2026-02-17T11:54:10.357 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53100.log.gz 2026-02-17T11:54:10.357 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50034.log 2026-02-17T11:54:10.357 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70895.log.gz 2026-02-17T11:54:10.358 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71136.log.gz 2026-02-17T11:54:10.358 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54628.log 2026-02-17T11:54:10.358 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50034.log.gz 2026-02-17T11:54:10.358 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69338.log 2026-02-17T11:54:10.358 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54628.log.gz 2026-02-17T11:54:10.358 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51799.log 2026-02-17T11:54:10.358 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69338.log.gz 2026-02-17T11:54:10.358 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65052.log 2026-02-17T11:54:10.359 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51799.log.gz 2026-02-17T11:54:10.359 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52760.log 2026-02-17T11:54:10.359 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58775.log 2026-02-17T11:54:10.359 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65052.log.gz 2026-02-17T11:54:10.359 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52760.log.gz 2026-02-17T11:54:10.359 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58376.log 2026-02-17T11:54:10.359 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74689.log 2026-02-17T11:54:10.359 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58775.log.gz 2026-02-17T11:54:10.360 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58376.log.gz 2026-02-17T11:54:10.360 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64446.log 2026-02-17T11:54:10.360 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56439.log 2026-02-17T11:54:10.360 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74689.log.gz 2026-02-17T11:54:10.360 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64446.log.gz 2026-02-17T11:54:10.360 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73709.log 2026-02-17T11:54:10.361 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49865.log 2026-02-17T11:54:10.361 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56439.log.gz 2026-02-17T11:54:10.361 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73709.log.gz 2026-02-17T11:54:10.361 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57939.log 2026-02-17T11:54:10.361 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69468.log 2026-02-17T11:54:10.361 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49865.log.gz 2026-02-17T11:54:10.361 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57939.log.gz 2026-02-17T11:54:10.361 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63755.log 2026-02-17T11:54:10.362 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72369.log 2026-02-17T11:54:10.362 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69468.log.gz 2026-02-17T11:54:10.362 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63755.log.gz 2026-02-17T11:54:10.362 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75371.log 2026-02-17T11:54:10.362 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72369.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.63925.log -- replaced with /var/log/ceph/ceph-client.admin.72369.log.gz 2026-02-17T11:54:10.362 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T11:54:10.362 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75371.log.gz 2026-02-17T11:54:10.362 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75224.log 2026-02-17T11:54:10.363 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73829.log 2026-02-17T11:54:10.363 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63925.log.gz 2026-02-17T11:54:10.363 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75224.log.gz 2026-02-17T11:54:10.363 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61944.log 2026-02-17T11:54:10.363 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73829.log.gz 2026-02-17T11:54:10.363 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49446.log 2026-02-17T11:54:10.363 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61944.log.gz 2026-02-17T11:54:10.363 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65891.log 2026-02-17T11:54:10.363 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49446.log.gz 2026-02-17T11:54:10.363 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61714.log 2026-02-17T11:54:10.364 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65891.log.gz 2026-02-17T11:54:10.364 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49539.log 2026-02-17T11:54:10.364 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61714.log.gz 2026-02-17T11:54:10.364 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61766.log 2026-02-17T11:54:10.364 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49539.log.gz 2026-02-17T11:54:10.364 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68183.log 2026-02-17T11:54:10.364 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61766.log.gz 2026-02-17T11:54:10.364 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53961.log 2026-02-17T11:54:10.365 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68183.log.gz 2026-02-17T11:54:10.365 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56758.log 2026-02-17T11:54:10.365 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64641.log 2026-02-17T11:54:10.365 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53961.log.gz 2026-02-17T11:54:10.365 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56758.log.gz 2026-02-17T11:54:10.365 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62572.log 2026-02-17T11:54:10.365 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64641.log.gz 2026-02-17T11:54:10.366 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52125.log 2026-02-17T11:54:10.366 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62572.log.gz 2026-02-17T11:54:10.366 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56294.log 2026-02-17T11:54:10.366 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52125.log.gz 2026-02-17T11:54:10.366 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50625.log 2026-02-17T11:54:10.366 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56294.log.gz 2026-02-17T11:54:10.366 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61106.log 2026-02-17T11:54:10.366 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74198.log 2026-02-17T11:54:10.366 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50625.log.gz 2026-02-17T11:54:10.367 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61106.log.gz 2026-02-17T11:54:10.367 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75469.log 2026-02-17T11:54:10.367 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54626.log 2026-02-17T11:54:10.367 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74198.log.gz 2026-02-17T11:54:10.367 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75469.log.gz 2026-02-17T11:54:10.367 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60097.log 2026-02-17T11:54:10.367 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54626.log.gz 2026-02-17T11:54:10.368 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67147.log 2026-02-17T11:54:10.368 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56935.log 2026-02-17T11:54:10.368 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60097.log.gz 2026-02-17T11:54:10.368 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67147.log.gz 2026-02-17T11:54:10.368 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74690.log 2026-02-17T11:54:10.368 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56935.log.gz 2026-02-17T11:54:10.368 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T11:54:10.368 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74690.log.gz 2026-02-17T11:54:10.368 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56101.log 2026-02-17T11:54:10.369 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58776.log 2026-02-17T11:54:10.369 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56101.log.gz 2026-02-17T11:54:10.369 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52521.log 2026-02-17T11:54:10.369 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57771.log 2026-02-17T11:54:10.369 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58776.log.gz 2026-02-17T11:54:10.370 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52521.log.gz 2026-02-17T11:54:10.370 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71970.log 2026-02-17T11:54:10.370 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48836.log 2026-02-17T11:54:10.370 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57771.log.gz 2026-02-17T11:54:10.370 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71970.log.gz 2026-02-17T11:54:10.370 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65621.log 2026-02-17T11:54:10.370 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75616.log 2026-02-17T11:54:10.370 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48836.log.gz 2026-02-17T11:54:10.371 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65621.log.gz 2026-02-17T11:54:10.371 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59440.log 2026-02-17T11:54:10.371 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64005.log 2026-02-17T11:54:10.371 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75616.log.gz 2026-02-17T11:54:10.371 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59440.log.gz 2026-02-17T11:54:10.371 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62139.log 2026-02-17T11:54:10.371 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68818.log 2026-02-17T11:54:10.372 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64005.log.gz 2026-02-17T11:54:10.372 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53996.log 2026-02-17T11:54:10.372 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62139.log.gz 2026-02-17T11:54:10.372 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68818.log.gz 2026-02-17T11:54:10.372 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67149.log 2026-02-17T11:54:10.372 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64640.log 2026-02-17T11:54:10.372 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53996.log.gz 2026-02-17T11:54:10.372 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67149.log.gz 2026-02-17T11:54:10.373 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70303.log 2026-02-17T11:54:10.373 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69663.log 2026-02-17T11:54:10.373 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64640.log.gz 2026-02-17T11:54:10.373 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70303.log.gz 2026-02-17T11:54:10.373 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54825.log 2026-02-17T11:54:10.373 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69663.log.gz 2026-02-17T11:54:10.373 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63173.log 2026-02-17T11:54:10.374 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54825.log.gz 2026-02-17T11:54:10.374 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59200.log 2026-02-17T11:54:10.374 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63173.log.gz 2026-02-17T11:54:10.374 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73859.log 2026-02-17T11:54:10.374 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66508.log 2026-02-17T11:54:10.374 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59200.log.gz 2026-02-17T11:54:10.374 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73859.log.gz 2026-02-17T11:54:10.374 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74496.log 2026-02-17T11:54:10.375 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75518.log 2026-02-17T11:54:10.375 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66508.log.gz 2026-02-17T11:54:10.375 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74496.log.gz 2026-02-17T11:54:10.375 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51261.log 2026-02-17T11:54:10.375 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55775.log 2026-02-17T11:54:10.375 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75518.log.gz 2026-02-17T11:54:10.375 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51261.log.gz 2026-02-17T11:54:10.375 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54743.log 2026-02-17T11:54:10.376 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55775.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.70497.log 2026-02-17T11:54:10.376 INFO:teuthology.orchestra.run.trial077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55775.log.gz 2026-02-17T11:54:10.376 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54743.log.gz 2026-02-17T11:54:10.376 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61945.log 2026-02-17T11:54:10.376 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54833.log 2026-02-17T11:54:10.376 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70497.log.gz 2026-02-17T11:54:10.377 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61945.log.gz 2026-02-17T11:54:10.377 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66949.log 2026-02-17T11:54:10.377 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5/var/log/ceph/ceph-client.admin.54833.log: --verbose -- /var/log/ceph/ceph-client.admin.50455.log 2026-02-17T11:54:10.377 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54833.log.gz 2026-02-17T11:54:10.377 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.66949.log: /var/log/ceph/ceph-client.admin.57343.log 2026-02-17T11:54:10.377 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66949.log.gz 2026-02-17T11:54:10.377 INFO:teuthology.orchestra.run.trial077.stderr:gzip/var/log/ceph/ceph-client.admin.50455.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55830.log 2026-02-17T11:54:10.377 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50455.log.gz 2026-02-17T11:54:10.377 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57343.log.gz 2026-02-17T11:54:10.378 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63285.log 2026-02-17T11:54:10.378 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71794.log 2026-02-17T11:54:10.378 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55830.log.gz 2026-02-17T11:54:10.378 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50767.log/var/log/ceph/ceph-client.admin.63285.log: 2026-02-17T11:54:10.378 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63285.log.gz 2026-02-17T11:54:10.378 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71794.log.gz 2026-02-17T11:54:10.378 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75763.log 2026-02-17T11:54:10.379 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67656.log 2026-02-17T11:54:10.379 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50767.log.gz 2026-02-17T11:54:10.379 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53597.log 2026-02-17T11:54:10.379 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75763.log.gz 2026-02-17T11:54:10.379 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54432.log 2026-02-17T11:54:10.379 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67656.log.gz 2026-02-17T11:54:10.379 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72574.log 2026-02-17T11:54:10.379 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53597.log.gz 2026-02-17T11:54:10.380 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73977.log 2026-02-17T11:54:10.380 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54432.log.gz 2026-02-17T11:54:10.380 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71475.log 2026-02-17T11:54:10.380 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72574.log.gz 2026-02-17T11:54:10.380 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73977.log.gz 2026-02-17T11:54:10.380 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55267.log 2026-02-17T11:54:10.380 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60666.log 2026-02-17T11:54:10.380 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71475.log.gz 2026-02-17T11:54:10.381 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48095.log 2026-02-17T11:54:10.381 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55267.log.gz 2026-02-17T11:54:10.381 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60666.log.gz 2026-02-17T11:54:10.381 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53791.log 2026-02-17T11:54:10.381 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71333.log 2026-02-17T11:54:10.381 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48095.log.gz 2026-02-17T11:54:10.381 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53791.log.gz 2026-02-17T11:54:10.381 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49397.log 2026-02-17T11:54:10.382 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72998.log 2026-02-17T11:54:10.382 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71333.log.gz 2026-02-17T11:54:10.382 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70838.log 2026-02-17T11:54:10.382 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49397.log.gz 2026-02-17T11:54:10.382 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72998.log.gz 2026-02-17T11:54:10.382 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58109.log 2026-02-17T11:54:10.382 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62138.log 2026-02-17T11:54:10.382 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70838.log.gz 2026-02-17T11:54:10.383 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58109.log.gz 2026-02-17T11:54:10.383 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49666.log 2026-02-17T11:54:10.383 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66823.log 2026-02-17T11:54:10.383 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62138.log.gz 2026-02-17T11:54:10.383 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49666.log.gz 2026-02-17T11:54:10.383 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65104.log 2026-02-17T11:54:10.383 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51467.log 2026-02-17T11:54:10.383 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66823.log.gz 2026-02-17T11:54:10.383 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57133.log 2026-02-17T11:54:10.383 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65104.log.gz 2026-02-17T11:54:10.384 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55383.log 2026-02-17T11:54:10.384 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51467.log.gz 2026-02-17T11:54:10.384 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64015.log 2026-02-17T11:54:10.384 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57133.log.gz 2026-02-17T11:54:10.384 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55383.log.gz 2026-02-17T11:54:10.384 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52462.log 2026-02-17T11:54:10.384 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51092.log 2026-02-17T11:54:10.384 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64015.log.gz 2026-02-17T11:54:10.385 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62141.log 2026-02-17T11:54:10.385 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52462.log.gz 2026-02-17T11:54:10.385 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60276.log 2026-02-17T11:54:10.385 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51092.log.gz 2026-02-17T11:54:10.385 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74466.log 2026-02-17T11:54:10.385 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62141.log.gz 2026-02-17T11:54:10.385 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60276.log.gz 2026-02-17T11:54:10.385 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64226.log 2026-02-17T11:54:10.385 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71332.log 2026-02-17T11:54:10.385 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74466.log.gz 2026-02-17T11:54:10.386 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68817.log 2026-02-17T11:54:10.386 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64226.log.gz 2026-02-17T11:54:10.386 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71332.log.gz 2026-02-17T11:54:10.386 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71742.log 2026-02-17T11:54:10.386 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60667.log 2026-02-17T11:54:10.386 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68817.log.gz 2026-02-17T11:54:10.386 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67543.log 2026-02-17T11:54:10.386 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71742.log.gz 2026-02-17T11:54:10.387 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48507.log 2026-02-17T11:54:10.387 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60667.log.gz 2026-02-17T11:54:10.387 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67543.log.gz 2026-02-17T11:54:10.387 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72803.log 2026-02-17T11:54:10.387 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5/var/log/ceph/ceph-client.admin.48507.log: --verbose -- /var/log/ceph/ceph-client.admin.71474.log 2026-02-17T11:54:10.387 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48507.log.gz 2026-02-17T11:54:10.387 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71644.log 2026-02-17T11:54:10.387 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72803.log.gz 2026-02-17T11:54:10.387 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49032.log 2026-02-17T11:54:10.387 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71474.log.gz 2026-02-17T11:54:10.388 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55138.log 2026-02-17T11:54:10.388 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71644.log.gz 2026-02-17T11:54:10.388 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75861.log 2026-02-17T11:54:10.388 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49032.log.gz 2026-02-17T11:54:10.388 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55138.log.gz 2026-02-17T11:54:10.388 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54301.log 2026-02-17T11:54:10.388 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5/var/log/ceph/ceph-client.admin.75861.log: --verbose -- /var/log/ceph/ceph-client.admin.52266.log 2026-02-17T11:54:10.388 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75861.log.gz 2026-02-17T11:54:10.388 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54301.log.gz 2026-02-17T11:54:10.388 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54157.log 2026-02-17T11:54:10.389 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49237.log 2026-02-17T11:54:10.389 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52266.log.gz 2026-02-17T11:54:10.389 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54157.log.gz 2026-02-17T11:54:10.389 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68621.log 2026-02-17T11:54:10.389 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49237.log.gz 2026-02-17T11:54:10.389 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74346.log 2026-02-17T11:54:10.389 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68621.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.72804.log -- replaced with /var/log/ceph/ceph-client.admin.68621.log.gz 2026-02-17T11:54:10.389 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T11:54:10.390 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74346.log.gz 2026-02-17T11:54:10.390 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48657.log 2026-02-17T11:54:10.390 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66116.log 2026-02-17T11:54:10.390 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72804.log.gz 2026-02-17T11:54:10.390 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48657.log.gz 2026-02-17T11:54:10.390 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57300.log 2026-02-17T11:54:10.390 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62775.log 2026-02-17T11:54:10.391 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66116.log.gz 2026-02-17T11:54:10.391 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57300.log.gz 2026-02-17T11:54:10.391 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75322.log 2026-02-17T11:54:10.391 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44080.log 2026-02-17T11:54:10.391 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62775.log.gz 2026-02-17T11:54:10.391 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75322.log.gz 2026-02-17T11:54:10.391 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66774.log 2026-02-17T11:54:10.392 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.44080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50865.log 2026-02-17T11:54:10.392 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44080.log.gz 2026-02-17T11:54:10.392 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66774.log.gz 2026-02-17T11:54:10.392 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50176.log 2026-02-17T11:54:10.392 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55037.log 2026-02-17T11:54:10.392 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50865.log.gz 2026-02-17T11:54:10.392 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50176.log.gz 2026-02-17T11:54:10.392 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73460.log 2026-02-17T11:54:10.392 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55037.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 0.0% 2026-02-17T11:54:10.393 INFO:teuthology.orchestra.run.trial077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55037.log.gz 2026-02-17T11:54:10.393 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73460.log.gz 2026-02-17T11:54:10.393 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51929.log 2026-02-17T11:54:10.393 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65879.log 2026-02-17T11:54:10.393 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51929.log.gz 2026-02-17T11:54:10.393 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63115.log 2026-02-17T11:54:10.394 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57129.log 2026-02-17T11:54:10.394 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65879.log.gz 2026-02-17T11:54:10.394 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63115.log.gz 2026-02-17T11:54:10.394 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51093.log 2026-02-17T11:54:10.394 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57129.log.gz 2026-02-17T11:54:10.394 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50963.log 2026-02-17T11:54:10.394 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51093.log.gz 2026-02-17T11:54:10.394 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62945.log 2026-02-17T11:54:10.394 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50963.log.gz 2026-02-17T11:54:10.395 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60470.log 2026-02-17T11:54:10.395 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62945.log.gz 2026-02-17T11:54:10.395 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51516.log 2026-02-17T11:54:10.395 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60470.log.gz 2026-02-17T11:54:10.395 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61302.log 2026-02-17T11:54:10.395 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62778.log 2026-02-17T11:54:10.395 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51516.log.gz 2026-02-17T11:54:10.396 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61302.log.gz 2026-02-17T11:54:10.396 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63383.log 2026-02-17T11:54:10.396 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62778.log.gz 2026-02-17T11:54:10.396 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55831.log 2026-02-17T11:54:10.396 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49864.log 2026-02-17T11:54:10.396 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63383.log.gz 2026-02-17T11:54:10.396 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55831.log.gz 2026-02-17T11:54:10.396 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67486.log 2026-02-17T11:54:10.397 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65476.log 2026-02-17T11:54:10.397 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49864.log.gz 2026-02-17T11:54:10.397 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67486.log.gz 2026-02-17T11:54:10.397 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50277.log 2026-02-17T11:54:10.397 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64194.log 2026-02-17T11:54:10.397 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65476.log.gz 2026-02-17T11:54:10.397 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50277.log.gz 2026-02-17T11:54:10.398 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52957.log 2026-02-17T11:54:10.398 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68123.log 2026-02-17T11:54:10.398 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64194.log.gz 2026-02-17T11:54:10.398 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52957.log.gz 2026-02-17T11:54:10.398 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56657.log 2026-02-17T11:54:10.398 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68492.log 2026-02-17T11:54:10.398 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68123.log.gz 2026-02-17T11:54:10.399 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56657.log.gz 2026-02-17T11:54:10.399 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51927.log 2026-02-17T11:54:10.399 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67545.log 2026-02-17T11:54:10.399 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68492.log.gz 2026-02-17T11:54:10.399 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51927.log.gz 2026-02-17T11:54:10.399 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64445.log 2026-02-17T11:54:10.399 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67545.log.gz 2026-02-17T11:54:10.399 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50856.log 2026-02-17T11:54:10.400 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70024.log 2026-02-17T11:54:10.400 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64445.log.gz 2026-02-17T11:54:10.400 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50856.log.gz 2026-02-17T11:54:10.400 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64643.log 2026-02-17T11:54:10.400 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67979.log 2026-02-17T11:54:10.400 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70024.log.gz 2026-02-17T11:54:10.400 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64643.log.gz 2026-02-17T11:54:10.400 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69023.log 2026-02-17T11:54:10.401 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67979.log.gz 2026-02-17T11:54:10.401 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54824.log 2026-02-17T11:54:10.401 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69023.log.gz 2026-02-17T11:54:10.401 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74008.log 2026-02-17T11:54:10.401 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54824.log.gz 2026-02-17T11:54:10.401 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69806.log 2026-02-17T11:54:10.401 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74008.log.gz 2026-02-17T11:54:10.401 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56100.log 2026-02-17T11:54:10.402 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69806.log.gz 2026-02-17T11:54:10.402 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56438.log 2026-02-17T11:54:10.402 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56100.log.gz 2026-02-17T11:54:10.402 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70699.log 2026-02-17T11:54:10.402 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56438.log.gz 2026-02-17T11:54:10.402 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66952.log 2026-02-17T11:54:10.402 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70699.log.gz 2026-02-17T11:54:10.402 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T11:54:10.403 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66952.log.gz 2026-02-17T11:54:10.403 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50456.log 2026-02-17T11:54:10.403 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53595.log 2026-02-17T11:54:10.403 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50456.log.gz 2026-02-17T11:54:10.403 INFO:teuthology.orchestra.run.trial077.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T11:54:10.403 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53174.log 2026-02-17T11:54:10.403 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50067.log 2026-02-17T11:54:10.403 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53595.log.gz 2026-02-17T11:54:10.404 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53174.log.gz 2026-02-17T11:54:10.404 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56296.log 2026-02-17T11:54:10.404 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69224.log 2026-02-17T11:54:10.404 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50067.log.gz 2026-02-17T11:54:10.404 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56296.log.gz 2026-02-17T11:54:10.404 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52124.log 2026-02-17T11:54:10.404 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61108.log 2026-02-17T11:54:10.405 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69224.log.gz 2026-02-17T11:54:10.405 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52124.log.gz 2026-02-17T11:54:10.405 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49669.log 2026-02-17T11:54:10.405 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68959.log 2026-02-17T11:54:10.405 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61108.log.gz 2026-02-17T11:54:10.405 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.49669.log: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T11:54:10.405 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49669.log.gz 2026-02-17T11:54:10.405 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50326.log 2026-02-17T11:54:10.405 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69467.log 2026-02-17T11:54:10.406 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68959.log.gz 2026-02-17T11:54:10.406 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50326.log.gz 2026-02-17T11:54:10.406 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52761.log 2026-02-17T11:54:10.406 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67146.log 2026-02-17T11:54:10.406 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69467.log.gz 2026-02-17T11:54:10.406 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52761.log.gz 2026-02-17T11:54:10.406 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69875.log 2026-02-17T11:54:10.407 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67146.log.gz 2026-02-17T11:54:10.407 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54627.log 2026-02-17T11:54:10.407 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67343.log 2026-02-17T11:54:10.407 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69875.log.gz 2026-02-17T11:54:10.407 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.54627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54627.log.gz 2026-02-17T11:54:10.407 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71329.log 2026-02-17T11:54:10.407 INFO:teuthology.orchestra.run.trial077.stderr:gzip/var/log/ceph/ceph-client.admin.67343.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52324.log 2026-02-17T11:54:10.408 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67343.log.gz 2026-02-17T11:54:10.408 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71329.log.gz 2026-02-17T11:54:10.408 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43833.log 2026-02-17T11:54:10.408 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.52324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57987.log 2026-02-17T11:54:10.408 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52324.log.gz 2026-02-17T11:54:10.408 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.43833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43833.log.gz 2026-02-17T11:54:10.408 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67340.log 2026-02-17T11:54:10.408 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69805.log 2026-02-17T11:54:10.409 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57987.log.gz 2026-02-17T11:54:10.409 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.67340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67340.log.gz 2026-02-17T11:54:10.409 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57641.log 2026-02-17T11:54:10.409 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.69805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64642.log 2026-02-17T11:54:10.409 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69805.log.gz 2026-02-17T11:54:10.409 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61304.log 2026-02-17T11:54:10.409 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57641.log.gz 2026-02-17T11:54:10.410 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64642.log.gz 2026-02-17T11:54:10.410 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70073.log 2026-02-17T11:54:10.410 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75567.log 2026-02-17T11:54:10.410 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61304.log.gz 2026-02-17T11:54:10.410 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.70073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70073.log.gz 2026-02-17T11:54:10.410 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74467.log 2026-02-17T11:54:10.410 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61665.log 2026-02-17T11:54:10.411 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75567.log.gz 2026-02-17T11:54:10.411 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74467.log.gz 2026-02-17T11:54:10.411 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53269.log 2026-02-17T11:54:10.411 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61943.log 2026-02-17T11:54:10.411 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61665.log.gz 2026-02-17T11:54:10.411 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53269.log.gz 2026-02-17T11:54:10.411 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55682.log 2026-02-17T11:54:10.411 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62350.log 2026-02-17T11:54:10.412 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61943.log.gz 2026-02-17T11:54:10.412 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55682.log.gz 2026-02-17T11:54:10.412 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72805.log 2026-02-17T11:54:10.412 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.62350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59205.log 2026-02-17T11:54:10.412 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62350.log.gz 2026-02-17T11:54:10.412 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.72805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72805.log.gz 2026-02-17T11:54:10.412 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53793.log 2026-02-17T11:54:10.413 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59205.log.gz 2026-02-17T11:54:10.413 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51750.log 2026-02-17T11:54:10.413 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53793.log.gz 2026-02-17T11:54:10.413 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68443.log 2026-02-17T11:54:10.413 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51750.log.gz 2026-02-17T11:54:10.413 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59836.log 2026-02-17T11:54:10.413 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68443.log.gz 2026-02-17T11:54:10.413 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48308.log 2026-02-17T11:54:10.413 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59836.log.gz 2026-02-17T11:54:10.414 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50033.log 2026-02-17T11:54:10.414 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48308.log.gz 2026-02-17T11:54:10.414 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68391.log 2026-02-17T11:54:10.414 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.50033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50033.log.gz 2026-02-17T11:54:10.414 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48605.log 2026-02-17T11:54:10.414 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.68391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68391.log.gz 2026-02-17T11:54:10.414 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60275.log 2026-02-17T11:54:10.414 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48605.log.gz 2026-02-17T11:54:10.414 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55651.log 2026-02-17T11:54:10.415 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.60275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60275.log.gz 2026-02-17T11:54:10.415 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73561.log 2026-02-17T11:54:10.415 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.55651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55651.log.gz 2026-02-17T11:54:10.415 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66311.log 2026-02-17T11:54:10.415 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.73561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73561.log.gz 2026-02-17T11:54:10.415 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59778.log 2026-02-17T11:54:10.415 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.66311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66311.log.gz 2026-02-17T11:54:10.415 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57131.log 2026-02-17T11:54:10.416 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59778.log.gz 2026-02-17T11:54:10.416 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75957.log 2026-02-17T11:54:10.416 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.57131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57131.log.gz 2026-02-17T11:54:10.416 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71549.log 2026-02-17T11:54:10.416 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51698.log 2026-02-17T11:54:10.416 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75957.log.gz 2026-02-17T11:54:10.416 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71549.log.gz 2026-02-17T11:54:10.416 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58173.log 2026-02-17T11:54:10.417 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.51698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64121.log 2026-02-17T11:54:10.417 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51698.log.gz 2026-02-17T11:54:10.417 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58173.log.gz 2026-02-17T11:54:10.417 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59437.log 2026-02-17T11:54:10.417 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.64121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64121.log.gz 2026-02-17T11:54:10.417 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56512.log 2026-02-17T11:54:10.418 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.59437.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.59437.log.gz --verbose 2026-02-17T11:54:10.418 INFO:teuthology.orchestra.run.trial077.stderr: -- /var/log/ceph/ceph-client.admin.63174.log 2026-02-17T11:54:10.418 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.56512.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.56512.log.gz -- 2026-02-17T11:54:10.418 INFO:teuthology.orchestra.run.trial077.stderr: /var/log/ceph/ceph-client.admin.75175.log 2026-02-17T11:54:10.418 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.63174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74345.log 2026-02-17T11:54:10.418 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63174.log.gz 2026-02-17T11:54:10.418 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.75175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75175.log.gz 2026-02-17T11:54:10.418 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61109.log 2026-02-17T11:54:10.419 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.74345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74345.log.gz 2026-02-17T11:54:10.419 INFO:teuthology.orchestra.run.trial077.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T11:54:10.419 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71007.log 2026-02-17T11:54:10.419 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.61109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58428.log 2026-02-17T11:54:10.419 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61109.log.gz 2026-02-17T11:54:10.419 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.71007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71007.log.gz 2026-02-17T11:54:10.419 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53792.log 2026-02-17T11:54:10.420 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48706.log 2026-02-17T11:54:10.420 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58428.log.gz 2026-02-17T11:54:10.420 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.53792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53792.log.gz 2026-02-17T11:54:10.420 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44159.log 2026-02-17T11:54:10.420 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.48706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58278.log 2026-02-17T11:54:10.420 INFO:teuthology.orchestra.run.trial077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48706.log.gz 2026-02-17T11:54:10.420 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.44159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44159.log.gz 2026-02-17T11:54:10.420 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65986.log 2026-02-17T11:54:10.421 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.58278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58278.log.gz 2026-02-17T11:54:10.421 INFO:teuthology.orchestra.run.trial077.stderr:/var/log/ceph/ceph-client.admin.65986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65986.log.gz 2026-02-17T11:54:10.574 INFO:teuthology.orchestra.run.trial077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-17T11:54:10.665 INFO:teuthology.orchestra.run.trial077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T11:54:10.666 INFO:teuthology.orchestra.run.trial077.stderr: 2026-02-17T11:54:10.666 INFO:teuthology.orchestra.run.trial077.stderr:real 0m0.405s 2026-02-17T11:54:10.666 INFO:teuthology.orchestra.run.trial077.stderr:user 0m0.978s 2026-02-17T11:54:10.666 INFO:teuthology.orchestra.run.trial077.stderr:sys 0m0.226s 2026-02-17T11:54:10.667 INFO:tasks.ceph:Archiving logs... 2026-02-17T11:54:10.667 DEBUG:teuthology.misc:Transferring archived files from trial077:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51347/remote/trial077/log 2026-02-17T11:54:10.668 DEBUG:teuthology.orchestra.run.trial077:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T11:54:11.088 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T11:54:11.111 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T11:54:11.112 DEBUG:teuthology.orchestra.run.trial077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T11:54:11.214 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T11:54:11.225 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T11:54:11.226 DEBUG:teuthology.orchestra.run.trial077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:54:11.241 INFO:teuthology.orchestra.run.trial077.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:54:11.262 INFO:teuthology.orchestra.run.trial077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:54:11.262 INFO:teuthology.orchestra.run.trial077.stdout:=============================================================================== 2026-02-17T11:54:11.262 INFO:teuthology.orchestra.run.trial077.stdout:^* ntp.netlinkify.com 2 6 377 1 -34us[ -48us] +/- 8044us 2026-02-17T11:54:11.262 INFO:teuthology.orchestra.run.trial077.stdout:^- time.gslb.gravinoc.com 2 6 377 3 +2804us[+2791us] +/- 39ms 2026-02-17T11:54:11.262 INFO:teuthology.orchestra.run.trial077.stdout:^? 172-233-189-68.ip.linode> 0 8 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:54:11.262 INFO:teuthology.orchestra.run.trial077.stdout:^- 198-23-133-146-host.colo> 3 6 377 1 +56us[ +56us] +/- 66ms 2026-02-17T11:54:11.262 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T11:54:11.276 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T11:54:11.276 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T11:54:11.290 DEBUG:teuthology.orchestra.run.trial077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T11:54:11.364 DEBUG:teuthology.orchestra.run.trial077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:54:11.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:54:11.390 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T11:54:11.409 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T11:54:11.423 INFO:teuthology.task.internal:Duration was 496.431056 seconds 2026-02-17T11:54:11.424 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T11:54:11.439 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T11:54:11.439 DEBUG:teuthology.orchestra.run.trial077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T11:54:11.478 INFO:teuthology.orchestra.run.trial077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:54:11.725 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T11:54:11.725 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial077.front.sepia.ceph.com 2026-02-17T11:54:11.725 DEBUG:teuthology.orchestra.run.trial077:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T11:54:11.783 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T11:54:11.783 DEBUG:teuthology.orchestra.run.trial077:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:54:11.891 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T11:54:11.891 DEBUG:teuthology.orchestra.run.trial077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:54:11.915 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:54:11.915 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:54:11.916 INFO:teuthology.orchestra.run.trial077.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T11:54:11.916 INFO:teuthology.orchestra.run.trial077.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:54:11.917 INFO:teuthology.orchestra.run.trial077.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T11:54:11.927 INFO:teuthology.orchestra.run.trial077.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 84.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T11:54:11.929 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T11:54:11.946 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T11:54:11.947 DEBUG:teuthology.orchestra.run.trial077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T11:54:11.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T11:54:12.010 DEBUG:teuthology.orchestra.run.trial077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:54:12.056 INFO:teuthology.orchestra.run.trial077.stdout:kernel.core_pattern = core 2026-02-17T11:54:12.068 DEBUG:teuthology.orchestra.run.trial077:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:54:12.122 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:54:12.123 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T11:54:12.138 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T11:54:12.139 DEBUG:teuthology.misc:Transferring archived files from trial077:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51347/remote/trial077 2026-02-17T11:54:12.139 DEBUG:teuthology.orchestra.run.trial077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T11:54:12.198 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T11:54:12.198 DEBUG:teuthology.orchestra.run.trial077:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T11:54:12.244 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T11:54:12.256 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T11:54:12.256 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T11:54:12.274 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T11:54:12.274 DEBUG:teuthology.orchestra.run.trial077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T11:54:12.301 INFO:teuthology.orchestra.run.trial077.stdout: 791887 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 11:54 /home/ubuntu/cephtest 2026-02-17T11:54:12.302 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T11:54:12.313 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T11:54:12.344 INFO:teuthology.run:Summary data: description: rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} duration: 496.4310564994812 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T11:54:12.345 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:54:12.439 INFO:teuthology.run:pass