2026-02-17T11:38:02.314 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T11:38:02.328 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:38:02.405 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51339 branch: wip-bharath20-testing-2026-02-13-0906-squid description: rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51339' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath20-testing-2026-02-13-0906-squid ceph: conf: global: mon client directed command retry: 5 mon client hunt interval max multiple: 2 mon election default strategy: 1 mon mgr beacon grace: 90 ms bind msgr2: false ms inject socket failures: 1000 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd pool default size: 2 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon max pg per osd: 1 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd max pg per osd hard ratio: 1 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random create_rbd_pool: false flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(TOO_FEW_PGS\) - \(PG_ - \(PENDING_CREATING_PGS\) - \(POOL_APP_NOT_ENABLED\) - \(OSD_SLOW_PING_TIME - \(MON_DOWN\) mon_bind_msgr2: false pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath20-testing-2026-02-13-0906-squid sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 seed: 4581 sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath20-testing-2026-02-13-0906-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 targets: trial078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLxXvcVDohcte+djW048JlTkZ0Jg8YjnFuZPtPYUy8lv0QWaA0iDmEwiek+8icqd+Gv8Au+6nvsN38FAtiUcROE= tasks: - install: null - ceph: null - osd_max_pg_per_osd: from_primary: true pg_num: 1 pool_size: 2 test_create_from_mon: false teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:10:36 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T11:38:02.405 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa; will attempt to use it 2026-02-17T11:38:02.406 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks 2026-02-17T11:38:02.406 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T11:38:02.407 INFO:teuthology.task.internal:Checking packages... 2026-02-17T11:38:02.408 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3c96dfb3f50b3d02598a82af7104764bfdcd3919' 2026-02-17T11:38:02.408 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T11:38:02.408 INFO:teuthology.packaging:ref: None 2026-02-17T11:38:02.408 INFO:teuthology.packaging:tag: None 2026-02-17T11:38:02.408 INFO:teuthology.packaging:branch: wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:38:02.408 INFO:teuthology.packaging:sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:38:02.408 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:38:02.555 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-675.g3c96dfb3 2026-02-17T11:38:02.557 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T11:38:02.568 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T11:38:02.568 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T11:38:02.582 INFO:teuthology.task.internal:Saving configuration 2026-02-17T11:38:02.590 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T11:38:02.601 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T11:38:02.682 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial078.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51339', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:34:36.558707', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLxXvcVDohcte+djW048JlTkZ0Jg8YjnFuZPtPYUy8lv0QWaA0iDmEwiek+8icqd+Gv8Au+6nvsN38FAtiUcROE='} 2026-02-17T11:38:02.682 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T11:38:02.693 INFO:teuthology.task.internal:roles: ubuntu@trial078.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2026-02-17T11:38:02.693 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T11:38:02.780 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7b91057a0ea0>, signals=[15]) 2026-02-17T11:38:02.780 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T11:38:02.794 INFO:teuthology.task.internal:Opening connections... 2026-02-17T11:38:02.794 DEBUG:teuthology.task.internal:connecting to ubuntu@trial078.front.sepia.ceph.com 2026-02-17T11:38:02.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:38:02.856 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T11:38:02.867 DEBUG:teuthology.orchestra.run.trial078:> uname -m 2026-02-17T11:38:02.932 INFO:teuthology.orchestra.run.trial078.stdout:x86_64 2026-02-17T11:38:02.932 DEBUG:teuthology.orchestra.run.trial078:> cat /etc/os-release 2026-02-17T11:38:02.987 INFO:teuthology.orchestra.run.trial078.stdout:NAME="CentOS Stream" 2026-02-17T11:38:02.987 INFO:teuthology.orchestra.run.trial078.stdout:VERSION="9" 2026-02-17T11:38:02.988 INFO:teuthology.orchestra.run.trial078.stdout:ID="centos" 2026-02-17T11:38:02.988 INFO:teuthology.orchestra.run.trial078.stdout:ID_LIKE="rhel fedora" 2026-02-17T11:38:02.988 INFO:teuthology.orchestra.run.trial078.stdout:VERSION_ID="9" 2026-02-17T11:38:02.988 INFO:teuthology.orchestra.run.trial078.stdout:PLATFORM_ID="platform:el9" 2026-02-17T11:38:02.988 INFO:teuthology.orchestra.run.trial078.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T11:38:02.988 INFO:teuthology.orchestra.run.trial078.stdout:ANSI_COLOR="0;31" 2026-02-17T11:38:02.988 INFO:teuthology.orchestra.run.trial078.stdout:LOGO="fedora-logo-icon" 2026-02-17T11:38:02.988 INFO:teuthology.orchestra.run.trial078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T11:38:02.988 INFO:teuthology.orchestra.run.trial078.stdout:HOME_URL="https://centos.org/" 2026-02-17T11:38:02.988 INFO:teuthology.orchestra.run.trial078.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T11:38:02.988 INFO:teuthology.orchestra.run.trial078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T11:38:02.988 INFO:teuthology.orchestra.run.trial078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T11:38:02.989 INFO:teuthology.lock.ops:Updating trial078.front.sepia.ceph.com on lock server 2026-02-17T11:38:03.080 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T11:38:03.092 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T11:38:03.102 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T11:38:03.102 DEBUG:teuthology.orchestra.run.trial078:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:38:03.118 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T11:38:03.131 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T11:38:03.131 DEBUG:teuthology.orchestra.run.trial078:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:38:03.174 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T11:38:03.280 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T11:38:03.300 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T11:38:03.301 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T11:38:03.301 DEBUG:teuthology.orchestra.run.trial078:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:38:03.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:38:03.316 DEBUG:teuthology.orchestra.run.trial078:> uname -r 2026-02-17T11:38:03.372 INFO:teuthology.orchestra.run.trial078.stdout:5.14.0-645.el9.x86_64 2026-02-17T11:38:03.372 INFO:teuthology.task.kernel:Running kernel on trial078: 5.14.0-645.el9.x86_64 2026-02-17T11:38:03.372 DEBUG:teuthology.orchestra.run.trial078:> sudo yum install -y kernel 2026-02-17T11:38:04.327 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.9 MB 00:00 2026-02-17T11:38:07.354 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-17T11:38:13.240 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 7.8 MB 00:03 2026-02-17T11:38:14.846 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-17T11:38:15.155 INFO:teuthology.orchestra.run.trial078.stdout:Extra Packages for Enterprise Linux 82 MB/s | 20 MB 00:00 2026-02-17T11:38:18.296 INFO:teuthology.orchestra.run.trial078.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-17T11:38:19.306 INFO:teuthology.orchestra.run.trial078.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T11:38:19.326 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:38:19.327 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:38:19.327 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-17T11:38:19.327 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:38:19.328 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-17T11:38:19.328 INFO:teuthology.orchestra.run.trial078.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T11:38:19.328 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-17T11:38:19.328 INFO:teuthology.orchestra.run.trial078.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T11:38:19.328 INFO:teuthology.orchestra.run.trial078.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T11:38:19.328 INFO:teuthology.orchestra.run.trial078.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T11:38:19.328 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:38:19.328 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-17T11:38:19.328 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:38:19.328 INFO:teuthology.orchestra.run.trial078.stdout:Install 4 Packages 2026-02-17T11:38:19.328 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:38:19.329 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 88 M 2026-02-17T11:38:19.329 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 135 M 2026-02-17T11:38:19.329 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-17T11:38:19.544 INFO:teuthology.orchestra.run.trial078.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 5.0 MB/s | 803 kB 00:00 2026-02-17T11:38:19.703 INFO:teuthology.orchestra.run.trial078.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 54 MB/s | 17 MB 00:00 2026-02-17T11:38:19.872 INFO:teuthology.orchestra.run.trial078.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 82 MB/s | 40 MB 00:00 2026-02-17T11:38:19.917 INFO:teuthology.orchestra.run.trial078.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 83 MB/s | 31 MB 00:00 2026-02-17T11:38:19.917 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:38:19.918 INFO:teuthology.orchestra.run.trial078.stdout:Total 150 MB/s | 88 MB 00:00 2026-02-17T11:38:20.108 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-17T11:38:20.304 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-17T11:38:20.305 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-17T11:38:20.650 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-17T11:38:20.650 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-17T11:38:21.730 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-17T11:38:22.014 INFO:teuthology.orchestra.run.trial078.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:38:22.033 INFO:teuthology.orchestra.run.trial078.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:38:23.821 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:38:23.850 INFO:teuthology.orchestra.run.trial078.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:38:26.876 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:38:26.882 INFO:teuthology.orchestra.run.trial078.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:38:29.918 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:00.242 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:00.262 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:00.433 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:00.433 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:39:00.433 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:39:00.433 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:39:00.485 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:39:00.485 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:39:00.485 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-17T11:39:00.485 INFO:teuthology.orchestra.run.trial078.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T11:39:00.485 INFO:teuthology.orchestra.run.trial078.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T11:39:00.485 INFO:teuthology.orchestra.run.trial078.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T11:39:00.485 INFO:teuthology.orchestra.run.trial078.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T11:39:00.485 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:39:00.485 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:39:00.544 DEBUG:teuthology.orchestra.run.trial078:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:39:00.570 INFO:teuthology.orchestra.run.trial078.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:39:00.571 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:39:00.571 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T11:39:00.571 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:39:00.571 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:39:00.571 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T11:39:00.571 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial078.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:39:00.571 DEBUG:teuthology.orchestra.run.trial078:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:39:00.636 INFO:teuthology.orchestra.run.trial078.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:39:00.636 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:39:00.636 DEBUG:teuthology.orchestra.run.trial078:> sudo rpm -qi grub2-tools 2026-02-17T11:39:00.706 INFO:teuthology.orchestra.run.trial078.stdout:Name : grub2-tools 2026-02-17T11:39:00.706 INFO:teuthology.orchestra.run.trial078.stdout:Epoch : 1 2026-02-17T11:39:00.707 INFO:teuthology.orchestra.run.trial078.stdout:Version : 2.06 2026-02-17T11:39:00.707 INFO:teuthology.orchestra.run.trial078.stdout:Release : 118.el9 2026-02-17T11:39:00.707 INFO:teuthology.orchestra.run.trial078.stdout:Architecture: x86_64 2026-02-17T11:39:00.707 INFO:teuthology.orchestra.run.trial078.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T11:39:00.707 INFO:teuthology.orchestra.run.trial078.stdout:Group : Unspecified 2026-02-17T11:39:00.707 INFO:teuthology.orchestra.run.trial078.stdout:Size : 8393909 2026-02-17T11:39:00.707 INFO:teuthology.orchestra.run.trial078.stdout:License : GPLv3+ 2026-02-17T11:39:00.707 INFO:teuthology.orchestra.run.trial078.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T11:39:00.707 INFO:teuthology.orchestra.run.trial078.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T11:39:00.707 INFO:teuthology.orchestra.run.trial078.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T11:39:00.707 INFO:teuthology.orchestra.run.trial078.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T11:39:00.708 INFO:teuthology.orchestra.run.trial078.stdout:Packager : builder@centos.org 2026-02-17T11:39:00.708 INFO:teuthology.orchestra.run.trial078.stdout:Vendor : CentOS 2026-02-17T11:39:00.708 INFO:teuthology.orchestra.run.trial078.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T11:39:00.708 INFO:teuthology.orchestra.run.trial078.stdout:Summary : Support tools for GRUB. 2026-02-17T11:39:00.708 INFO:teuthology.orchestra.run.trial078.stdout:Description : 2026-02-17T11:39:00.708 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:39:00.708 INFO:teuthology.orchestra.run.trial078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T11:39:00.708 INFO:teuthology.orchestra.run.trial078.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T11:39:00.708 INFO:teuthology.orchestra.run.trial078.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T11:39:00.708 INFO:teuthology.orchestra.run.trial078.stdout:hardware devices. 2026-02-17T11:39:00.708 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:39:00.708 INFO:teuthology.orchestra.run.trial078.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T11:39:00.710 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T11:39:00.710 INFO:teuthology.task.kernel:Updating grub on trial078 to boot 5.14.0-681.el9.x86_64 2026-02-17T11:39:00.710 DEBUG:teuthology.orchestra.run.trial078:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T11:39:00.774 INFO:teuthology.orchestra.run.trial078.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:39:00.776 DEBUG:teuthology.orchestra.run.trial078:> sudo command -v grubby && echo yes || echo no 2026-02-17T11:39:00.839 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/grubby 2026-02-17T11:39:00.841 INFO:teuthology.orchestra.run.trial078.stdout:yes 2026-02-17T11:39:00.841 DEBUG:teuthology.orchestra.run.trial078:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T11:39:00.907 INFO:teuthology.orchestra.run.trial078.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:39:00.908 DEBUG:teuthology.orchestra.run.trial078:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T11:39:00.979 DEBUG:teuthology.orchestra.run.trial078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T11:39:01.188 INFO:teuthology.orchestra.run.trial078.stderr:Generating grub configuration file ... 2026-02-17T11:39:01.251 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T11:39:01.257 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T11:39:01.502 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T11:39:01.508 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T11:39:01.539 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T11:39:01.546 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T11:39:01.569 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T11:39:01.575 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T11:39:01.658 INFO:teuthology.orchestra.run.trial078.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:39:01.666 INFO:teuthology.orchestra.run.trial078.stderr:done 2026-02-17T11:39:01.668 DEBUG:teuthology.orchestra.run.trial078:> test -d /sys/firmware/efi 2026-02-17T11:39:01.684 DEBUG:teuthology.orchestra.run.trial078:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T11:39:01.750 INFO:teuthology.orchestra.run.trial078.stdout:/boot/efi/EFI/BOOT 2026-02-17T11:39:01.750 INFO:teuthology.orchestra.run.trial078.stdout:/boot/efi/EFI/centos 2026-02-17T11:39:01.752 DEBUG:teuthology.orchestra.run.trial078:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T11:39:01.817 INFO:teuthology.orchestra.run.trial078.stdout:no 2026-02-17T11:39:01.817 DEBUG:teuthology.orchestra.run.trial078:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T11:39:01.882 INFO:teuthology.orchestra.run.trial078.stdout:yes 2026-02-17T11:39:01.882 DEBUG:teuthology.orchestra.run.trial078:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T11:39:01.947 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial078 2026-02-17T11:39:01.947 DEBUG:teuthology.orchestra.run.trial078:> sudo bash -c ' 2026-02-17T11:39:01.948 DEBUG:teuthology.orchestra.run.trial078:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:39:01.948 DEBUG:teuthology.orchestra.run.trial078:> ' 2026-02-17T11:39:31.991 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T11:39:31.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-17T11:39:31.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:40:32.038 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T11:40:41.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-17T11:40:41.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:40:41.183 DEBUG:teuthology.orchestra.run.trial078:> true 2026-02-17T11:40:41.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-17T11:40:41.352 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T11:40:41.352 DEBUG:teuthology.orchestra.run.trial078:> uname -r 2026-02-17T11:40:41.408 INFO:teuthology.orchestra.run.trial078.stdout:5.14.0-681.el9.x86_64 2026-02-17T11:40:41.408 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T11:40:41.409 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T11:40:41.409 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T11:40:42.409 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T11:40:42.410 DEBUG:teuthology.orchestra.run.trial078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T11:40:42.440 INFO:teuthology.orchestra.run.trial078.stdout:ttyS1 2026-02-17T11:40:42.466 DEBUG:teuthology.parallel:result is None 2026-02-17T11:40:42.466 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T11:40:42.474 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T11:40:42.475 DEBUG:teuthology.orchestra.run.trial078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T11:40:42.524 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T11:40:42.539 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T11:40:42.547 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T11:40:42.548 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T11:40:42.582 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T11:40:42.593 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T11:40:42.593 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T11:40:42.646 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:40:42.654 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:40:42.656 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T11:40:42.668 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T11:40:42.668 DEBUG:teuthology.orchestra.run.trial078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T11:40:42.719 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T11:40:42.733 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T11:40:42.733 DEBUG:teuthology.orchestra.run.trial078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T11:40:42.776 DEBUG:teuthology.orchestra.run.trial078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:40:42.938 DEBUG:teuthology.orchestra.run.trial078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:40:42.962 DEBUG:teuthology.orchestra.run.trial078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:40:43.131 DEBUG:teuthology.orchestra.run.trial078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:40:43.155 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:40:43.155 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T11:40:43.219 DEBUG:teuthology.orchestra.run.trial078:> sudo service rsyslog restart 2026-02-17T11:40:43.289 INFO:teuthology.orchestra.run.trial078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:40:43.672 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T11:40:43.688 INFO:teuthology.task.internal:Starting timer... 2026-02-17T11:40:43.688 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T11:40:43.708 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T11:40:43.729 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-17T11:40:43.729 DEBUG:teuthology.orchestra.run.trial078:> sudo service auditd rotate 2026-02-17T11:40:43.758 INFO:teuthology.orchestra.run.trial078.stdout:Rotating logs: 2026-02-17T11:40:43.759 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T11:40:43.760 DEBUG:teuthology.orchestra.run.trial078:> /usr/sbin/getenforce 2026-02-17T11:40:43.815 INFO:teuthology.orchestra.run.trial078.stdout:Permissive 2026-02-17T11:40:43.816 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial078.front.sepia.ceph.com': 'permissive'} 2026-02-17T11:40:43.816 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:40:43.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:40:43.880 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T11:40:43.880 DEBUG:teuthology.orchestra.run.trial078:> sudo /usr/sbin/setenforce permissive 2026-02-17T11:40:43.944 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T11:40:43.957 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T11:40:43.966 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T11:40:43.966 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial078.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T11:43:37.132 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial078.front.sepia.ceph.com')] 2026-02-17T11:43:37.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-17T11:43:37.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:43:37.246 DEBUG:teuthology.orchestra.run.trial078:> true 2026-02-17T11:43:37.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-17T11:43:37.321 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T11:43:37.331 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T11:43:37.332 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:43:37.332 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:43:37.389 INFO:teuthology.orchestra.run.trial078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T11:43:37.400 INFO:teuthology.orchestra.run.trial078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T11:43:37.420 INFO:teuthology.orchestra.run.trial078.stderr:sudo: ntpd: command not found 2026-02-17T11:43:37.430 INFO:teuthology.orchestra.run.trial078.stdout:506 Cannot talk to daemon 2026-02-17T11:43:37.441 INFO:teuthology.orchestra.run.trial078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T11:43:37.452 INFO:teuthology.orchestra.run.trial078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T11:43:37.500 INFO:teuthology.orchestra.run.trial078.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:43:37.518 INFO:teuthology.orchestra.run.trial078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:43:37.519 INFO:teuthology.orchestra.run.trial078.stdout:=============================================================================== 2026-02-17T11:43:37.519 INFO:teuthology.orchestra.run.trial078.stdout:^? 157.245.125.229 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:43:37.519 INFO:teuthology.orchestra.run.trial078.stdout:^? time.trtnw.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:43:37.519 INFO:teuthology.orchestra.run.trial078.stdout:^? sushi.ruselabs.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:43:37.519 INFO:teuthology.orchestra.run.trial078.stdout:^? wdc1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T11:43:37.520 INFO:teuthology.run_tasks:Running task install... 2026-02-17T11:43:37.533 DEBUG:teuthology.task.install:project ceph 2026-02-17T11:43:37.533 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}} 2026-02-17T11:43:37.534 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'} 2026-02-17T11:43:37.534 INFO:teuthology.task.install:Using flavor: default 2026-02-17T11:43:37.542 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T11:43:37.542 INFO:teuthology.task.install:extra packages: [] 2026-02-17T11:43:37.542 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T11:43:37.543 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:43:37.714 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T11:43:37.714 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T11:43:38.175 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T11:43:38.175 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:43:38.176 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T11:43:38.203 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T11:43:38.203 DEBUG:teuthology.orchestra.run.trial078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T11:43:38.268 DEBUG:teuthology.orchestra.run.trial078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T11:43:38.342 DEBUG:teuthology.orchestra.run.trial078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T11:43:38.405 INFO:teuthology.orchestra.run.trial078.stdout:check_obsoletes = 1 2026-02-17T11:43:38.407 DEBUG:teuthology.orchestra.run.trial078:> sudo yum clean all 2026-02-17T11:43:38.558 INFO:teuthology.orchestra.run.trial078.stdout:41 files removed 2026-02-17T11:43:38.573 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-radosgw 2026-02-17T11:43:38.845 INFO:teuthology.orchestra.run.trial078.stdout:ceph packages for x86_64 677 kB/s | 86 kB 00:00 2026-02-17T11:43:38.975 INFO:teuthology.orchestra.run.trial078.stdout:ceph noarch packages 115 kB/s | 12 kB 00:00 2026-02-17T11:43:39.100 INFO:teuthology.orchestra.run.trial078.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T11:43:39.957 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-17T11:43:43.662 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 27 MB 00:03 2026-02-17T11:43:46.920 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 7.8 MB 00:00 2026-02-17T11:43:47.794 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - Extras packages 135 kB/s | 20 kB 00:00 2026-02-17T11:43:48.117 INFO:teuthology.orchestra.run.trial078.stdout:Extra Packages for Enterprise Linux 78 MB/s | 20 MB 00:00 2026-02-17T11:43:51.328 INFO:teuthology.orchestra.run.trial078.stdout:lab-extras 960 kB/s | 50 kB 00:00 2026-02-17T11:43:52.550 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:43:52.551 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:43:52.551 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-17T11:43:52.551 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:43:52.552 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-17T11:43:52.552 INFO:teuthology.orchestra.run.trial078.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T11:43:52.552 INFO:teuthology.orchestra.run.trial078.stdout:Upgrading: 2026-02-17T11:43:52.552 INFO:teuthology.orchestra.run.trial078.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T11:43:52.552 INFO:teuthology.orchestra.run.trial078.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T11:43:52.552 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-17T11:43:52.552 INFO:teuthology.orchestra.run.trial078.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T11:43:52.553 INFO:teuthology.orchestra.run.trial078.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T11:43:52.553 INFO:teuthology.orchestra.run.trial078.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T11:43:52.553 INFO:teuthology.orchestra.run.trial078.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T11:43:52.553 INFO:teuthology.orchestra.run.trial078.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T11:43:52.553 INFO:teuthology.orchestra.run.trial078.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T11:43:52.553 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T11:43:52.553 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T11:43:52.553 INFO:teuthology.orchestra.run.trial078.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T11:43:52.553 INFO:teuthology.orchestra.run.trial078.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T11:43:52.553 INFO:teuthology.orchestra.run.trial078.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T11:43:52.553 INFO:teuthology.orchestra.run.trial078.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T11:43:52.553 INFO:teuthology.orchestra.run.trial078.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T11:43:52.554 INFO:teuthology.orchestra.run.trial078.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T11:43:52.554 INFO:teuthology.orchestra.run.trial078.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T11:43:52.554 INFO:teuthology.orchestra.run.trial078.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T11:43:52.554 INFO:teuthology.orchestra.run.trial078.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T11:43:52.554 INFO:teuthology.orchestra.run.trial078.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T11:43:52.554 INFO:teuthology.orchestra.run.trial078.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T11:43:52.554 INFO:teuthology.orchestra.run.trial078.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T11:43:52.554 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T11:43:52.554 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T11:43:52.555 INFO:teuthology.orchestra.run.trial078.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T11:43:52.555 INFO:teuthology.orchestra.run.trial078.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T11:43:52.555 INFO:teuthology.orchestra.run.trial078.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T11:43:52.555 INFO:teuthology.orchestra.run.trial078.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T11:43:52.555 INFO:teuthology.orchestra.run.trial078.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T11:43:52.555 INFO:teuthology.orchestra.run.trial078.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T11:43:52.555 INFO:teuthology.orchestra.run.trial078.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T11:43:52.555 INFO:teuthology.orchestra.run.trial078.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T11:43:52.555 INFO:teuthology.orchestra.run.trial078.stdout:Installing weak dependencies: 2026-02-17T11:43:52.555 INFO:teuthology.orchestra.run.trial078.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T11:43:52.555 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T11:43:52.555 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:43:52.556 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-17T11:43:52.556 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:43:52.556 INFO:teuthology.orchestra.run.trial078.stdout:Install 33 Packages 2026-02-17T11:43:52.556 INFO:teuthology.orchestra.run.trial078.stdout:Upgrade 2 Packages 2026-02-17T11:43:52.556 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:43:52.557 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 63 M 2026-02-17T11:43:52.557 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-17T11:43:54.000 INFO:teuthology.orchestra.run.trial078.stdout:(1/35): ceph-common-19.2.3-675.g3c96dfb3.el9.x8 22 MB/s | 22 MB 00:00 2026-02-17T11:43:54.013 INFO:teuthology.orchestra.run.trial078.stdout:(2/35): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 2.0 MB/s | 25 kB 00:00 2026-02-17T11:43:54.043 INFO:teuthology.orchestra.run.trial078.stdout:(3/35): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 33 MB/s | 999 kB 00:00 2026-02-17T11:43:54.067 INFO:teuthology.orchestra.run.trial078.stdout:(4/35): libradosstriper1-19.2.3-675.g3c96dfb3.e 20 MB/s | 503 kB 00:00 2026-02-17T11:43:54.210 INFO:teuthology.orchestra.run.trial078.stdout:(5/35): librgw2-19.2.3-675.g3c96dfb3.el9.x86_64 38 MB/s | 5.4 MB 00:00 2026-02-17T11:43:54.222 INFO:teuthology.orchestra.run.trial078.stdout:(6/35): python3-ceph-argparse-19.2.3-675.g3c96d 3.8 MB/s | 45 kB 00:00 2026-02-17T11:43:54.239 INFO:teuthology.orchestra.run.trial078.stdout:(7/35): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 4.5 MB/s | 5.5 MB 00:01 2026-02-17T11:43:54.240 INFO:teuthology.orchestra.run.trial078.stdout:(8/35): python3-ceph-common-19.2.3-675.g3c96dfb 7.6 MB/s | 142 kB 00:00 2026-02-17T11:43:54.252 INFO:teuthology.orchestra.run.trial078.stdout:(9/35): python3-cephfs-19.2.3-675.g3c96dfb3.el9 13 MB/s | 165 kB 00:00 2026-02-17T11:43:54.259 INFO:teuthology.orchestra.run.trial078.stdout:(10/35): python3-rados-19.2.3-675.g3c96dfb3.el9 17 MB/s | 322 kB 00:00 2026-02-17T11:43:54.271 INFO:teuthology.orchestra.run.trial078.stdout:(11/35): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 15 MB/s | 303 kB 00:00 2026-02-17T11:43:54.275 INFO:teuthology.orchestra.run.trial078.stdout:(12/35): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 6.2 MB/s | 100 kB 00:00 2026-02-17T11:43:54.386 INFO:teuthology.orchestra.run.trial078.stdout:(13/35): ceph-radosgw-19.2.3-675.g3c96dfb3.el9. 7.9 MB/s | 11 MB 00:01 2026-02-17T11:43:54.691 INFO:teuthology.orchestra.run.trial078.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 79 kB/s | 33 kB 00:00 2026-02-17T11:43:54.798 INFO:teuthology.orchestra.run.trial078.stdout:(15/35): boost-program-options-1.75.0-13.el9.x8 980 kB/s | 104 kB 00:00 2026-02-17T11:43:54.843 INFO:teuthology.orchestra.run.trial078.stdout:(16/35): libnbd-1.20.3-4.el9.x86_64.rpm 3.6 MB/s | 164 kB 00:00 2026-02-17T11:43:54.868 INFO:teuthology.orchestra.run.trial078.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.2 MB/s | 160 kB 00:00 2026-02-17T11:43:54.891 INFO:teuthology.orchestra.run.trial078.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-17T11:43:54.937 INFO:teuthology.orchestra.run.trial078.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 662 kB 00:00 2026-02-17T11:43:54.962 INFO:teuthology.orchestra.run.trial078.stdout:(20/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 11 MB/s | 292 kB 00:00 2026-02-17T11:43:54.963 INFO:teuthology.orchestra.run.trial078.stdout:(21/35): pciutils-3.7.0-7.el9.x86_64.rpm 161 kB/s | 93 kB 00:00 2026-02-17T11:43:54.986 INFO:teuthology.orchestra.run.trial078.stdout:(22/35): qatlib-25.08.0-2.el9.x86_64.rpm 9.7 MB/s | 240 kB 00:00 2026-02-17T11:43:55.009 INFO:teuthology.orchestra.run.trial078.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-17T11:43:55.026 INFO:teuthology.orchestra.run.trial078.stdout:(24/35): qatlib-service-25.08.0-2.el9.x86_64.rp 592 kB/s | 37 kB 00:00 2026-02-17T11:43:55.154 INFO:teuthology.orchestra.run.trial078.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.1 MB/s | 308 kB 00:00 2026-02-17T11:43:55.175 INFO:teuthology.orchestra.run.trial078.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.2 MB/s | 25 kB 00:00 2026-02-17T11:43:55.195 INFO:teuthology.orchestra.run.trial078.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 2.3 MB/s | 49 kB 00:00 2026-02-17T11:43:55.217 INFO:teuthology.orchestra.run.trial078.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 3.1 MB/s | 67 kB 00:00 2026-02-17T11:43:55.225 INFO:teuthology.orchestra.run.trial078.stdout:(29/35): libarrow-9.0.0-15.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2026-02-17T11:43:55.247 INFO:teuthology.orchestra.run.trial078.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 8.4 MB/s | 191 kB 00:00 2026-02-17T11:43:55.258 INFO:teuthology.orchestra.run.trial078.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 20 MB/s | 838 kB 00:00 2026-02-17T11:43:55.273 INFO:teuthology.orchestra.run.trial078.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 60 MB/s | 1.6 MB 00:00 2026-02-17T11:43:55.361 INFO:teuthology.orchestra.run.trial078.stdout:(33/35): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 36 MB/s | 3.2 MB 00:00 2026-02-17T11:43:55.439 INFO:teuthology.orchestra.run.trial078.stdout:(34/35): librados2-19.2.3-675.g3c96dfb3.el9.x86 19 MB/s | 3.4 MB 00:00 2026-02-17T11:43:56.068 INFO:teuthology.orchestra.run.trial078.stdout:(35/35): nvme-cli-2.13-1.el9.x86_64.rpm 626 kB/s | 1.1 MB 00:01 2026-02-17T11:43:56.073 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:43:56.073 INFO:teuthology.orchestra.run.trial078.stdout:Total 18 MB/s | 63 MB 00:03 2026-02-17T11:43:56.173 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-17T11:43:56.190 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-17T11:43:56.191 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-17T11:43:56.427 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-17T11:43:56.428 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-17T11:43:56.730 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-17T11:43:56.739 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T11:43:56.741 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T11:43:56.753 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T11:43:56.904 INFO:teuthology.orchestra.run.trial078.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T11:43:56.908 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:43:56.936 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:43:56.977 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:43:56.978 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:43:56.988 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:43:56.993 INFO:teuthology.orchestra.run.trial078.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T11:43:57.001 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/37 2026-02-17T11:43:57.025 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:43:57.026 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:43:57.039 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:43:57.069 INFO:teuthology.orchestra.run.trial078.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T11:43:57.073 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T11:43:57.079 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T11:43:57.082 INFO:teuthology.orchestra.run.trial078.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T11:43:57.084 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T11:43:57.089 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T11:43:57.228 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:43:57.230 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:43:57.256 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T11:43:57.258 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/37 2026-02-17T11:43:57.264 INFO:teuthology.orchestra.run.trial078.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T11:43:57.488 INFO:teuthology.orchestra.run.trial078.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T11:43:57.489 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:43:57.506 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T11:43:57.509 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/37 2026-02-17T11:43:57.513 INFO:teuthology.orchestra.run.trial078.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T11:43:57.516 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T11:43:57.516 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:43:57.536 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T11:43:57.650 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T11:43:57.652 INFO:teuthology.orchestra.run.trial078.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:43:57.939 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T11:43:57.939 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:43:57.939 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:43:57.975 INFO:teuthology.orchestra.run.trial078.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T11:43:57.976 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 31/37 2026-02-17T11:43:58.952 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:43:58.954 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:43:59.246 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T11:43:59.249 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:43:59.288 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T11:43:59.288 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T11:43:59.288 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T11:43:59.288 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:43:59.291 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:44:03.826 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:44:03.826 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /sys 2026-02-17T11:44:03.826 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /proc 2026-02-17T11:44:03.826 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /mnt 2026-02-17T11:44:03.826 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /var/tmp 2026-02-17T11:44:03.826 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /home 2026-02-17T11:44:03.827 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /root 2026-02-17T11:44:03.827 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /tmp 2026-02-17T11:44:03.827 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:04.277 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:44:04.301 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T11:44:04.301 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:04.301 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T11:44:04.301 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:44:04.301 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:44:04.302 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:04.303 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:44:04.317 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T11:44:04.317 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:44:04.374 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:44:04.374 INFO:teuthology.orchestra.run.trial078.stdout:Creating group 'qat' with GID 992. 2026-02-17T11:44:04.374 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:04.642 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/37 2026-02-17T11:44:04.643 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/37 2026-02-17T11:44:04.643 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/37 2026-02-17T11:44:04.643 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/37 2026-02-17T11:44:04.643 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T11:44:04.643 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T11:44:04.643 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T11:44:04.643 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/37 2026-02-17T11:44:04.643 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/37 2026-02-17T11:44:04.643 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T11:44:04.643 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T11:44:04.644 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/37 2026-02-17T11:44:04.644 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/37 2026-02-17T11:44:04.644 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T11:44:04.644 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T11:44:04.644 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T11:44:04.644 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T11:44:04.644 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T11:44:04.644 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T11:44:04.644 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T11:44:04.644 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T11:44:04.644 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T11:44:04.644 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T11:44:04.645 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T11:44:04.645 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T11:44:04.645 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T11:44:04.645 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T11:44:04.645 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T11:44:04.645 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T11:44:04.645 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T11:44:04.645 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T11:44:04.645 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T11:44:04.645 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T11:44:04.645 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T11:44:04.645 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T11:44:04.645 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 36/37 2026-02-17T11:44:04.702 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T11:44:04.702 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:04.702 INFO:teuthology.orchestra.run.trial078.stdout:Upgraded: 2026-02-17T11:44:04.702 INFO:teuthology.orchestra.run.trial078.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.702 INFO:teuthology.orchestra.run.trial078.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.702 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-17T11:44:04.702 INFO:teuthology.orchestra.run.trial078.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T11:44:04.702 INFO:teuthology.orchestra.run.trial078.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.702 INFO:teuthology.orchestra.run.trial078.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.702 INFO:teuthology.orchestra.run.trial078.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.702 INFO:teuthology.orchestra.run.trial078.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.702 INFO:teuthology.orchestra.run.trial078.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T11:44:04.702 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.703 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.704 INFO:teuthology.orchestra.run.trial078.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.704 INFO:teuthology.orchestra.run.trial078.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.704 INFO:teuthology.orchestra.run.trial078.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.704 INFO:teuthology.orchestra.run.trial078.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:04.704 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T11:44:04.704 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T11:44:04.704 INFO:teuthology.orchestra.run.trial078.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T11:44:04.704 INFO:teuthology.orchestra.run.trial078.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T11:44:04.704 INFO:teuthology.orchestra.run.trial078.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T11:44:04.704 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:04.704 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:04.743 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-test 2026-02-17T11:44:05.053 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:14 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:05.135 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:05.135 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:05.135 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-17T11:44:05.135 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:05.135 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-17T11:44:05.135 INFO:teuthology.orchestra.run.trial078.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T11:44:05.135 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-17T11:44:05.135 INFO:teuthology.orchestra.run.trial078.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T11:44:05.135 INFO:teuthology.orchestra.run.trial078.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T11:44:05.135 INFO:teuthology.orchestra.run.trial078.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T11:44:05.136 INFO:teuthology.orchestra.run.trial078.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T11:44:05.136 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:05.136 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-17T11:44:05.136 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:05.136 INFO:teuthology.orchestra.run.trial078.stdout:Install 5 Packages 2026-02-17T11:44:05.136 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:05.136 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 50 M 2026-02-17T11:44:05.136 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 212 M 2026-02-17T11:44:05.136 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-17T11:44:05.282 INFO:teuthology.orchestra.run.trial078.stdout:(1/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T11:44:05.688 INFO:teuthology.orchestra.run.trial078.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 476 kB/s | 233 kB 00:00 2026-02-17T11:44:05.780 INFO:teuthology.orchestra.run.trial078.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 691 kB/s | 64 kB 00:00 2026-02-17T11:44:05.799 INFO:teuthology.orchestra.run.trial078.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 587 kB/s | 303 kB 00:00 2026-02-17T11:44:06.211 INFO:teuthology.orchestra.run.trial078.stdout:(5/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T11:44:06.212 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:06.213 INFO:teuthology.orchestra.run.trial078.stdout:Total 47 MB/s | 50 MB 00:01 2026-02-17T11:44:06.239 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-17T11:44:06.248 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-17T11:44:06.248 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-17T11:44:06.433 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-17T11:44:06.433 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-17T11:44:06.645 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-17T11:44:06.651 INFO:teuthology.orchestra.run.trial078.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T11:44:06.655 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T11:44:06.663 INFO:teuthology.orchestra.run.trial078.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T11:44:06.664 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:44:08.958 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T11:44:08.976 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:44:09.195 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T11:44:09.195 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T11:44:09.195 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T11:44:09.195 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T11:44:09.195 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T11:44:09.251 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T11:44:09.251 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:09.252 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-17T11:44:09.252 INFO:teuthology.orchestra.run.trial078.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:09.252 INFO:teuthology.orchestra.run.trial078.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:09.252 INFO:teuthology.orchestra.run.trial078.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T11:44:09.252 INFO:teuthology.orchestra.run.trial078.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T11:44:09.252 INFO:teuthology.orchestra.run.trial078.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T11:44:09.252 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:09.252 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:09.285 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph 2026-02-17T11:44:09.588 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:18 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:09.674 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:09.677 INFO:teuthology.orchestra.run.trial078.stdout:====================================================================================== 2026-02-17T11:44:09.677 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-17T11:44:09.677 INFO:teuthology.orchestra.run.trial078.stdout:====================================================================================== 2026-02-17T11:44:09.677 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-17T11:44:09.677 INFO:teuthology.orchestra.run.trial078.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T11:44:09.677 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-17T11:44:09.677 INFO:teuthology.orchestra.run.trial078.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T11:44:09.677 INFO:teuthology.orchestra.run.trial078.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T11:44:09.677 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T11:44:09.678 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T11:44:09.678 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T11:44:09.678 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T11:44:09.678 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T11:44:09.678 INFO:teuthology.orchestra.run.trial078.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T11:44:09.678 INFO:teuthology.orchestra.run.trial078.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T11:44:09.678 INFO:teuthology.orchestra.run.trial078.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T11:44:09.678 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T11:44:09.678 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T11:44:09.678 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T11:44:09.678 INFO:teuthology.orchestra.run.trial078.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T11:44:09.679 INFO:teuthology.orchestra.run.trial078.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T11:44:09.679 INFO:teuthology.orchestra.run.trial078.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T11:44:09.679 INFO:teuthology.orchestra.run.trial078.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T11:44:09.679 INFO:teuthology.orchestra.run.trial078.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T11:44:09.679 INFO:teuthology.orchestra.run.trial078.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T11:44:09.679 INFO:teuthology.orchestra.run.trial078.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T11:44:09.679 INFO:teuthology.orchestra.run.trial078.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T11:44:09.679 INFO:teuthology.orchestra.run.trial078.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T11:44:09.679 INFO:teuthology.orchestra.run.trial078.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T11:44:09.679 INFO:teuthology.orchestra.run.trial078.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T11:44:09.679 INFO:teuthology.orchestra.run.trial078.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T11:44:09.679 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T11:44:09.680 INFO:teuthology.orchestra.run.trial078.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T11:44:09.680 INFO:teuthology.orchestra.run.trial078.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T11:44:09.680 INFO:teuthology.orchestra.run.trial078.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T11:44:09.680 INFO:teuthology.orchestra.run.trial078.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T11:44:09.680 INFO:teuthology.orchestra.run.trial078.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T11:44:09.680 INFO:teuthology.orchestra.run.trial078.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T11:44:09.680 INFO:teuthology.orchestra.run.trial078.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T11:44:09.680 INFO:teuthology.orchestra.run.trial078.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T11:44:09.680 INFO:teuthology.orchestra.run.trial078.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T11:44:09.680 INFO:teuthology.orchestra.run.trial078.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T11:44:09.680 INFO:teuthology.orchestra.run.trial078.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T11:44:09.680 INFO:teuthology.orchestra.run.trial078.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T11:44:09.680 INFO:teuthology.orchestra.run.trial078.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T11:44:09.681 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T11:44:09.681 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T11:44:09.681 INFO:teuthology.orchestra.run.trial078.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T11:44:09.681 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T11:44:09.681 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T11:44:09.681 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T11:44:09.681 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T11:44:09.681 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T11:44:09.681 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T11:44:09.681 INFO:teuthology.orchestra.run.trial078.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T11:44:09.681 INFO:teuthology.orchestra.run.trial078.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T11:44:09.681 INFO:teuthology.orchestra.run.trial078.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T11:44:09.681 INFO:teuthology.orchestra.run.trial078.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T11:44:09.682 INFO:teuthology.orchestra.run.trial078.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T11:44:09.682 INFO:teuthology.orchestra.run.trial078.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T11:44:09.682 INFO:teuthology.orchestra.run.trial078.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T11:44:09.682 INFO:teuthology.orchestra.run.trial078.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T11:44:09.682 INFO:teuthology.orchestra.run.trial078.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T11:44:09.682 INFO:teuthology.orchestra.run.trial078.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T11:44:09.682 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T11:44:09.682 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T11:44:09.682 INFO:teuthology.orchestra.run.trial078.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T11:44:09.682 INFO:teuthology.orchestra.run.trial078.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T11:44:09.682 INFO:teuthology.orchestra.run.trial078.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T11:44:09.682 INFO:teuthology.orchestra.run.trial078.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T11:44:09.682 INFO:teuthology.orchestra.run.trial078.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T11:44:09.683 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T11:44:09.683 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T11:44:09.683 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T11:44:09.683 INFO:teuthology.orchestra.run.trial078.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T11:44:09.683 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T11:44:09.683 INFO:teuthology.orchestra.run.trial078.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T11:44:09.683 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T11:44:09.683 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T11:44:09.683 INFO:teuthology.orchestra.run.trial078.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T11:44:09.683 INFO:teuthology.orchestra.run.trial078.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T11:44:09.683 INFO:teuthology.orchestra.run.trial078.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T11:44:09.683 INFO:teuthology.orchestra.run.trial078.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T11:44:09.683 INFO:teuthology.orchestra.run.trial078.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T11:44:09.684 INFO:teuthology.orchestra.run.trial078.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T11:44:09.684 INFO:teuthology.orchestra.run.trial078.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T11:44:09.684 INFO:teuthology.orchestra.run.trial078.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T11:44:09.684 INFO:teuthology.orchestra.run.trial078.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T11:44:09.684 INFO:teuthology.orchestra.run.trial078.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T11:44:09.684 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T11:44:09.684 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T11:44:09.684 INFO:teuthology.orchestra.run.trial078.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T11:44:09.684 INFO:teuthology.orchestra.run.trial078.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T11:44:09.684 INFO:teuthology.orchestra.run.trial078.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T11:44:09.684 INFO:teuthology.orchestra.run.trial078.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T11:44:09.684 INFO:teuthology.orchestra.run.trial078.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T11:44:09.684 INFO:teuthology.orchestra.run.trial078.stdout:Installing weak dependencies: 2026-02-17T11:44:09.685 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T11:44:09.685 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T11:44:09.685 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T11:44:09.685 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T11:44:09.685 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T11:44:09.685 INFO:teuthology.orchestra.run.trial078.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T11:44:09.685 INFO:teuthology.orchestra.run.trial078.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T11:44:09.685 INFO:teuthology.orchestra.run.trial078.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T11:44:09.685 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:09.685 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-17T11:44:09.685 INFO:teuthology.orchestra.run.trial078.stdout:====================================================================================== 2026-02-17T11:44:09.685 INFO:teuthology.orchestra.run.trial078.stdout:Install 99 Packages 2026-02-17T11:44:09.686 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:09.686 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 95 M 2026-02-17T11:44:09.686 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 520 M 2026-02-17T11:44:09.687 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-17T11:44:10.016 INFO:teuthology.orchestra.run.trial078.stdout:(1/99): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 130 kB/s | 6.5 kB 00:00 2026-02-17T11:44:10.089 INFO:teuthology.orchestra.run.trial078.stdout:(2/99): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 8.8 MB/s | 1.1 MB 00:00 2026-02-17T11:44:10.240 INFO:teuthology.orchestra.run.trial078.stdout:(3/99): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 8.8 MB/s | 2.4 MB 00:00 2026-02-17T11:44:10.254 INFO:teuthology.orchestra.run.trial078.stdout:(4/99): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_6 20 MB/s | 4.7 MB 00:00 2026-02-17T11:44:10.272 INFO:teuthology.orchestra.run.trial078.stdout:(5/99): ceph-grafana-dashboards-19.2.3-675.g3c9 968 kB/s | 31 kB 00:00 2026-02-17T11:44:10.281 INFO:teuthology.orchestra.run.trial078.stdout:(6/99): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 5.5 MB/s | 150 kB 00:00 2026-02-17T11:44:10.578 INFO:teuthology.orchestra.run.trial078.stdout:(7/99): ceph-mgr-dashboard-19.2.3-675.g3c96dfb3 12 MB/s | 3.8 MB 00:00 2026-02-17T11:44:10.627 INFO:teuthology.orchestra.run.trial078.stdout:(8/99): ceph-mgr-diskprediction-local-19.2.3-67 21 MB/s | 7.4 MB 00:00 2026-02-17T11:44:10.684 INFO:teuthology.orchestra.run.trial078.stdout:(9/99): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 208 kB/s | 22 kB 00:00 2026-02-17T11:44:10.700 INFO:teuthology.orchestra.run.trial078.stdout:(10/99): ceph-mgr-modules-core-19.2.3-675.g3c96 3.4 MB/s | 253 kB 00:00 2026-02-17T11:44:10.714 INFO:teuthology.orchestra.run.trial078.stdout:(11/99): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 1.6 MB/s | 49 kB 00:00 2026-02-17T11:44:10.724 INFO:teuthology.orchestra.run.trial078.stdout:(12/99): ceph-prometheus-alerts-19.2.3-675.g3c9 682 kB/s | 17 kB 00:00 2026-02-17T11:44:10.762 INFO:teuthology.orchestra.run.trial078.stdout:(13/99): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 25 MB/s | 17 MB 00:00 2026-02-17T11:44:10.764 INFO:teuthology.orchestra.run.trial078.stdout:(14/99): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 5.9 MB/s | 299 kB 00:00 2026-02-17T11:44:10.766 INFO:teuthology.orchestra.run.trial078.stdout:(15/99): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 18 MB/s | 769 kB 00:00 2026-02-17T11:44:10.798 INFO:teuthology.orchestra.run.trial078.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.2 MB/s | 40 kB 00:00 2026-02-17T11:44:10.815 INFO:teuthology.orchestra.run.trial078.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 1.4 MB/s | 72 kB 00:00 2026-02-17T11:44:10.838 INFO:teuthology.orchestra.run.trial078.stdout:(18/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 4.6 MB/s | 350 kB 00:00 2026-02-17T11:44:10.856 INFO:teuthology.orchestra.run.trial078.stdout:(19/99): libgfortran-11.5.0-14.el9.x86_64.rpm 13 MB/s | 794 kB 00:00 2026-02-17T11:44:10.856 INFO:teuthology.orchestra.run.trial078.stdout:(20/99): libquadmath-11.5.0-14.el9.x86_64.rpm 4.4 MB/s | 184 kB 00:00 2026-02-17T11:44:10.870 INFO:teuthology.orchestra.run.trial078.stdout:(21/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 7.8 MB/s | 253 kB 00:00 2026-02-17T11:44:10.917 INFO:teuthology.orchestra.run.trial078.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 1.7 MB/s | 106 kB 00:00 2026-02-17T11:44:10.925 INFO:teuthology.orchestra.run.trial078.stdout:(23/99): python3-cryptography-36.0.1-5.el9.x86_ 18 MB/s | 1.2 MB 00:00 2026-02-17T11:44:10.926 INFO:teuthology.orchestra.run.trial078.stdout:(24/99): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 135 kB 00:00 2026-02-17T11:44:10.955 INFO:teuthology.orchestra.run.trial078.stdout:(25/99): python3-pyparsing-2.4.7-9.el9.noarch.r 3.9 MB/s | 150 kB 00:00 2026-02-17T11:44:10.957 INFO:teuthology.orchestra.run.trial078.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 3.9 MB/s | 126 kB 00:00 2026-02-17T11:44:10.957 INFO:teuthology.orchestra.run.trial078.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 6.7 MB/s | 218 kB 00:00 2026-02-17T11:44:10.990 INFO:teuthology.orchestra.run.trial078.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 5.2 MB/s | 182 kB 00:00 2026-02-17T11:44:10.990 INFO:teuthology.orchestra.run.trial078.stdout:(29/99): flexiblas-3.0.4-9.el9.x86_64.rpm 921 kB/s | 30 kB 00:00 2026-02-17T11:44:10.999 INFO:teuthology.orchestra.run.trial078.stdout:(30/99): zip-3.0-35.el9.x86_64.rpm 6.3 MB/s | 266 kB 00:00 2026-02-17T11:44:11.017 INFO:teuthology.orchestra.run.trial078.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 555 kB/s | 15 kB 00:00 2026-02-17T11:44:11.081 INFO:teuthology.orchestra.run.trial078.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.9 MB/s | 246 kB 00:00 2026-02-17T11:44:11.082 INFO:teuthology.orchestra.run.trial078.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2026-02-17T11:44:11.113 INFO:teuthology.orchestra.run.trial078.stdout:(34/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 24 MB/s | 3.0 MB 00:00 2026-02-17T11:44:11.113 INFO:teuthology.orchestra.run.trial078.stdout:(35/99): openblas-0.3.29-1.el9.x86_64.rpm 1.3 MB/s | 42 kB 00:00 2026-02-17T11:44:11.217 INFO:teuthology.orchestra.run.trial078.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 9.7 MB/s | 1.0 MB 00:00 2026-02-17T11:44:11.315 INFO:teuthology.orchestra.run.trial078.stdout:(37/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 23 MB/s | 5.3 MB 00:00 2026-02-17T11:44:11.315 INFO:teuthology.orchestra.run.trial078.stdout:(38/99): python3-devel-3.9.25-2.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2026-02-17T11:44:11.368 INFO:teuthology.orchestra.run.trial078.stdout:(39/99): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 6.0 MB 00:00 2026-02-17T11:44:11.369 INFO:teuthology.orchestra.run.trial078.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 3.3 MB/s | 177 kB 00:00 2026-02-17T11:44:11.369 INFO:teuthology.orchestra.run.trial078.stdout:(41/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 4.4 MB/s | 249 kB 00:00 2026-02-17T11:44:11.397 INFO:teuthology.orchestra.run.trial078.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 6.1 MB/s | 172 kB 00:00 2026-02-17T11:44:11.423 INFO:teuthology.orchestra.run.trial078.stdout:(43/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 22 MB/s | 1.2 MB 00:00 2026-02-17T11:44:11.424 INFO:teuthology.orchestra.run.trial078.stdout:(44/99): python3-markupsafe-1.1.1-12.el9.x86_64 644 kB/s | 35 kB 00:00 2026-02-17T11:44:11.455 INFO:teuthology.orchestra.run.trial078.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 2.4 MB/s | 77 kB 00:00 2026-02-17T11:44:11.474 INFO:teuthology.orchestra.run.trial078.stdout:(46/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 8.5 MB/s | 442 kB 00:00 2026-02-17T11:44:11.513 INFO:teuthology.orchestra.run.trial078.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 4.6 MB/s | 267 kB 00:00 2026-02-17T11:44:11.520 INFO:teuthology.orchestra.run.trial078.stdout:(48/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 50 MB/s | 6.1 MB 00:00 2026-02-17T11:44:11.520 INFO:teuthology.orchestra.run.trial078.stdout:(49/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.4 MB/s | 159 kB 00:00 2026-02-17T11:44:11.550 INFO:teuthology.orchestra.run.trial078.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 7.3 MB/s | 279 kB 00:00 2026-02-17T11:44:11.550 INFO:teuthology.orchestra.run.trial078.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 1.8 MB/s | 54 kB 00:00 2026-02-17T11:44:11.597 INFO:teuthology.orchestra.run.trial078.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 878 kB/s | 42 kB 00:00 2026-02-17T11:44:11.624 INFO:teuthology.orchestra.run.trial078.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.5 MB/s | 189 kB 00:00 2026-02-17T11:44:11.634 INFO:teuthology.orchestra.run.trial078.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 2.4 MB/s | 90 kB 00:00 2026-02-17T11:44:11.707 INFO:teuthology.orchestra.run.trial078.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2026-02-17T11:44:11.766 INFO:teuthology.orchestra.run.trial078.stdout:(56/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 78 MB/s | 19 MB 00:00 2026-02-17T11:44:11.767 INFO:teuthology.orchestra.run.trial078.stdout:(57/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 9.0 MB/s | 551 kB 00:00 2026-02-17T11:44:11.770 INFO:teuthology.orchestra.run.trial078.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 5.5 MB/s | 19 kB 00:00 2026-02-17T11:44:11.771 INFO:teuthology.orchestra.run.trial078.stdout:(59/99): luarocks-3.9.2-5.el9.noarch.rpm 40 MB/s | 151 kB 00:00 2026-02-17T11:44:11.775 INFO:teuthology.orchestra.run.trial078.stdout:(60/99): python3-asyncssh-2.13.2-5.el9.noarch.r 114 MB/s | 548 kB 00:00 2026-02-17T11:44:11.775 INFO:teuthology.orchestra.run.trial078.stdout:(61/99): python3-autocommand-2.2.2-8.el9.noarch 7.4 MB/s | 29 kB 00:00 2026-02-17T11:44:11.778 INFO:teuthology.orchestra.run.trial078.stdout:(62/99): python3-backports-tarfile-1.2.0-1.el9. 17 MB/s | 60 kB 00:00 2026-02-17T11:44:11.779 INFO:teuthology.orchestra.run.trial078.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 12 MB/s | 43 kB 00:00 2026-02-17T11:44:11.782 INFO:teuthology.orchestra.run.trial078.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 8.9 MB/s | 32 kB 00:00 2026-02-17T11:44:11.783 INFO:teuthology.orchestra.run.trial078.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 3.8 MB/s | 14 kB 00:00 2026-02-17T11:44:11.786 INFO:teuthology.orchestra.run.trial078.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 46 MB/s | 173 kB 00:00 2026-02-17T11:44:11.787 INFO:teuthology.orchestra.run.trial078.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 80 MB/s | 358 kB 00:00 2026-02-17T11:44:11.791 INFO:teuthology.orchestra.run.trial078.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 65 MB/s | 254 kB 00:00 2026-02-17T11:44:11.797 INFO:teuthology.orchestra.run.trial078.stdout:(69/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 218 MB/s | 2.0 MB 00:00 2026-02-17T11:44:11.797 INFO:teuthology.orchestra.run.trial078.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 25 MB/s | 144 kB 00:00 2026-02-17T11:44:11.801 INFO:teuthology.orchestra.run.trial078.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 36 MB/s | 139 kB 00:00 2026-02-17T11:44:11.801 INFO:teuthology.orchestra.run.trial078.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 14 MB/s | 56 kB 00:00 2026-02-17T11:44:11.804 INFO:teuthology.orchestra.run.trial078.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 3.2 MB/s | 11 kB 00:00 2026-02-17T11:44:11.805 INFO:teuthology.orchestra.run.trial078.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 5.3 MB/s | 18 kB 00:00 2026-02-17T11:44:11.808 INFO:teuthology.orchestra.run.trial078.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 6.8 MB/s | 23 kB 00:00 2026-02-17T11:44:11.808 INFO:teuthology.orchestra.run.trial078.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 5.6 MB/s | 20 kB 00:00 2026-02-17T11:44:11.811 INFO:teuthology.orchestra.run.trial078.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 5.8 MB/s | 19 kB 00:00 2026-02-17T11:44:11.811 INFO:teuthology.orchestra.run.trial078.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 7.8 MB/s | 26 kB 00:00 2026-02-17T11:44:11.817 INFO:teuthology.orchestra.run.trial078.stdout:(79/99): python3-kubernetes-26.1.0-3.el9.noarch 173 MB/s | 1.0 MB 00:00 2026-02-17T11:44:11.818 INFO:teuthology.orchestra.run.trial078.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 7.8 MB/s | 46 kB 00:00 2026-02-17T11:44:11.821 INFO:teuthology.orchestra.run.trial078.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 21 MB/s | 79 kB 00:00 2026-02-17T11:44:11.822 INFO:teuthology.orchestra.run.trial078.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 22 MB/s | 86 kB 00:00 2026-02-17T11:44:11.823 INFO:teuthology.orchestra.run.trial078.stdout:(83/99): protobuf-compiler-3.14.0-17.el9.x86_64 4.5 MB/s | 862 kB 00:00 2026-02-17T11:44:11.825 INFO:teuthology.orchestra.run.trial078.stdout:(84/99): python3-natsort-7.1.1-5.el9.noarch.rpm 17 MB/s | 58 kB 00:00 2026-02-17T11:44:11.826 INFO:teuthology.orchestra.run.trial078.stdout:(85/99): python3-pecan-1.4.2-3.el9.noarch.rpm 59 MB/s | 272 kB 00:00 2026-02-17T11:44:11.827 INFO:teuthology.orchestra.run.trial078.stdout:(86/99): python3-portend-3.1.0-2.el9.noarch.rpm 4.4 MB/s | 16 kB 00:00 2026-02-17T11:44:11.829 INFO:teuthology.orchestra.run.trial078.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 24 MB/s | 90 kB 00:00 2026-02-17T11:44:11.830 INFO:teuthology.orchestra.run.trial078.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 8.8 MB/s | 31 kB 00:00 2026-02-17T11:44:11.831 INFO:teuthology.orchestra.run.trial078.stdout:(89/99): python3-routes-2.5.1-5.el9.noarch.rpm 48 MB/s | 188 kB 00:00 2026-02-17T11:44:11.833 INFO:teuthology.orchestra.run.trial078.stdout:(90/99): python3-rsa-4.9-2.el9.noarch.rpm 17 MB/s | 59 kB 00:00 2026-02-17T11:44:11.834 INFO:teuthology.orchestra.run.trial078.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 35 MB/s | 125 kB 00:00 2026-02-17T11:44:11.834 INFO:teuthology.orchestra.run.trial078.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 10 MB/s | 36 kB 00:00 2026-02-17T11:44:11.836 INFO:teuthology.orchestra.run.trial078.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 24 MB/s | 86 kB 00:00 2026-02-17T11:44:11.838 INFO:teuthology.orchestra.run.trial078.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 58 MB/s | 230 kB 00:00 2026-02-17T11:44:11.838 INFO:teuthology.orchestra.run.trial078.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 22 MB/s | 90 kB 00:00 2026-02-17T11:44:11.841 INFO:teuthology.orchestra.run.trial078.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 94 MB/s | 427 kB 00:00 2026-02-17T11:44:11.841 INFO:teuthology.orchestra.run.trial078.stdout:(97/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 14 MB/s | 48 kB 00:00 2026-02-17T11:44:11.842 INFO:teuthology.orchestra.run.trial078.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 6.4 MB/s | 22 kB 00:00 2026-02-17T11:44:11.845 INFO:teuthology.orchestra.run.trial078.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 4.7 MB/s | 20 kB 00:00 2026-02-17T11:44:11.850 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:11.850 INFO:teuthology.orchestra.run.trial078.stdout:Total 44 MB/s | 95 MB 00:02 2026-02-17T11:44:12.273 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-17T11:44:12.309 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-17T11:44:12.309 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-17T11:44:12.731 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-17T11:44:12.731 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-17T11:44:13.177 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-17T11:44:13.180 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T11:44:13.211 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T11:44:13.217 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T11:44:13.239 INFO:teuthology.orchestra.run.trial078.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T11:44:13.245 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T11:44:13.278 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T11:44:13.288 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T11:44:13.293 INFO:teuthology.orchestra.run.trial078.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T11:44:13.295 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T11:44:13.300 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T11:44:13.323 INFO:teuthology.orchestra.run.trial078.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T11:44:13.336 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T11:44:13.339 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T11:44:13.345 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T11:44:13.346 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T11:44:13.358 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T11:44:13.364 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T11:44:13.388 INFO:teuthology.orchestra.run.trial078.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T11:44:13.391 INFO:teuthology.orchestra.run.trial078.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T11:44:13.398 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T11:44:13.423 INFO:teuthology.orchestra.run.trial078.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T11:44:13.475 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T11:44:13.488 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T11:44:13.490 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T11:44:13.495 INFO:teuthology.orchestra.run.trial078.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T11:44:13.500 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T11:44:13.505 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T11:44:13.508 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T11:44:13.523 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T11:44:13.544 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T11:44:13.549 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T11:44:13.554 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T11:44:13.565 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T11:44:13.574 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T11:44:13.581 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T11:44:13.600 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T11:44:13.609 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T11:44:13.664 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T11:44:13.676 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T11:44:13.692 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T11:44:13.697 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T11:44:13.704 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T11:44:13.745 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T11:44:14.072 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T11:44:14.083 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T11:44:14.086 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T11:44:14.092 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T11:44:14.094 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T11:44:14.122 INFO:teuthology.orchestra.run.trial078.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T11:44:14.165 INFO:teuthology.orchestra.run.trial078.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T11:44:14.172 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T11:44:14.176 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T11:44:14.181 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T11:44:14.185 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T11:44:14.192 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T11:44:14.195 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T11:44:14.224 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T11:44:14.233 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T11:44:14.269 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T11:44:14.495 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T11:44:14.519 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T11:44:14.523 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T11:44:14.581 INFO:teuthology.orchestra.run.trial078.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T11:44:14.583 INFO:teuthology.orchestra.run.trial078.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T11:44:14.605 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T11:44:14.937 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T11:44:15.011 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T11:44:15.690 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T11:44:15.707 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T11:44:15.717 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T11:44:15.724 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T11:44:15.737 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T11:44:15.753 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T11:44:15.829 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T11:44:15.838 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T11:44:15.862 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T11:44:15.892 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T11:44:15.943 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T11:44:15.949 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T11:44:15.954 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T11:44:15.955 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T11:44:15.973 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:44:15.973 INFO:teuthology.orchestra.run.trial078.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T11:44:15.973 INFO:teuthology.orchestra.run.trial078.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T11:44:15.973 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:15.981 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:44:16.006 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T11:44:16.007 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T11:44:16.007 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:16.042 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T11:44:16.107 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T11:44:16.109 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:44:16.122 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T11:44:16.123 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:16.123 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T11:44:16.123 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:16.820 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:44:16.845 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T11:44:16.846 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:16.846 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T11:44:16.846 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:44:16.846 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T11:44:16.846 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:16.900 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:44:16.902 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T11:44:16.907 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 88/99 2026-02-17T11:44:16.927 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 89/99 2026-02-17T11:44:16.928 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:44:17.419 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T11:44:17.422 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:44:17.878 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T11:44:17.879 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:44:17.892 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T11:44:17.892 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:44:17.949 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T11:44:17.999 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 94/99 2026-02-17T11:44:18.000 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:44:18.023 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T11:44:18.023 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:18.023 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T11:44:18.023 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:44:18.023 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T11:44:18.023 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:18.034 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:44:18.251 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T11:44:18.252 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:44:18.274 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T11:44:18.274 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:18.274 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T11:44:18.274 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:44:18.274 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T11:44:18.274 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:18.375 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:44:18.396 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T11:44:18.397 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:18.397 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T11:44:18.397 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:44:18.397 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T11:44:18.397 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:18.416 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:44:19.104 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T11:44:19.104 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/99 2026-02-17T11:44:19.105 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/99 2026-02-17T11:44:19.105 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/99 2026-02-17T11:44:19.105 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/99 2026-02-17T11:44:19.105 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/99 2026-02-17T11:44:19.105 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/99 2026-02-17T11:44:19.105 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/99 2026-02-17T11:44:19.105 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/99 2026-02-17T11:44:19.105 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/99 2026-02-17T11:44:19.105 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/99 2026-02-17T11:44:19.105 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/99 2026-02-17T11:44:19.105 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/99 2026-02-17T11:44:19.106 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/99 2026-02-17T11:44:19.106 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/99 2026-02-17T11:44:19.106 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/99 2026-02-17T11:44:19.106 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T11:44:19.106 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T11:44:19.106 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T11:44:19.106 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T11:44:19.106 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T11:44:19.106 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T11:44:19.106 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T11:44:19.106 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T11:44:19.106 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T11:44:19.106 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T11:44:19.107 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T11:44:19.107 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T11:44:19.107 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T11:44:19.107 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T11:44:19.107 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T11:44:19.107 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T11:44:19.107 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T11:44:19.107 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T11:44:19.107 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T11:44:19.107 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T11:44:19.107 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T11:44:19.107 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T11:44:19.108 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T11:44:19.108 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T11:44:19.108 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T11:44:19.108 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T11:44:19.108 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T11:44:19.108 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T11:44:19.108 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T11:44:19.108 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T11:44:19.108 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T11:44:19.108 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T11:44:19.108 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T11:44:19.108 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T11:44:19.108 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T11:44:19.109 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T11:44:19.110 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T11:44:19.110 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T11:44:19.110 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T11:44:19.110 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T11:44:19.110 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T11:44:19.110 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T11:44:19.110 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T11:44:19.110 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T11:44:19.110 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T11:44:19.110 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T11:44:19.110 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T11:44:19.110 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T11:44:19.110 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T11:44:19.111 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T11:44:19.111 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T11:44:19.111 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T11:44:19.111 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T11:44:19.111 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T11:44:19.111 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T11:44:19.111 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T11:44:19.111 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T11:44:19.111 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T11:44:19.111 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T11:44:19.111 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T11:44:19.111 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T11:44:19.111 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T11:44:19.112 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T11:44:19.112 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T11:44:19.112 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T11:44:19.112 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T11:44:19.112 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T11:44:19.112 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T11:44:19.112 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T11:44:19.112 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T11:44:19.167 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T11:44:19.167 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:19.167 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-17T11:44:19.167 INFO:teuthology.orchestra.run.trial078.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T11:44:19.167 INFO:teuthology.orchestra.run.trial078.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:19.167 INFO:teuthology.orchestra.run.trial078.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:19.167 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:19.167 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:19.168 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:19.168 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:19.168 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:19.168 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:19.168 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:19.168 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:19.168 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:19.168 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:19.168 INFO:teuthology.orchestra.run.trial078.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:19.168 INFO:teuthology.orchestra.run.trial078.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:19.168 INFO:teuthology.orchestra.run.trial078.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T11:44:19.168 INFO:teuthology.orchestra.run.trial078.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T11:44:19.169 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T11:44:19.169 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T11:44:19.169 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T11:44:19.169 INFO:teuthology.orchestra.run.trial078.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T11:44:19.169 INFO:teuthology.orchestra.run.trial078.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T11:44:19.169 INFO:teuthology.orchestra.run.trial078.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T11:44:19.169 INFO:teuthology.orchestra.run.trial078.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T11:44:19.169 INFO:teuthology.orchestra.run.trial078.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T11:44:19.169 INFO:teuthology.orchestra.run.trial078.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:44:19.169 INFO:teuthology.orchestra.run.trial078.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T11:44:19.169 INFO:teuthology.orchestra.run.trial078.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T11:44:19.169 INFO:teuthology.orchestra.run.trial078.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T11:44:19.169 INFO:teuthology.orchestra.run.trial078.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T11:44:19.170 INFO:teuthology.orchestra.run.trial078.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T11:44:19.170 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T11:44:19.170 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T11:44:19.170 INFO:teuthology.orchestra.run.trial078.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T11:44:19.170 INFO:teuthology.orchestra.run.trial078.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T11:44:19.170 INFO:teuthology.orchestra.run.trial078.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T11:44:19.170 INFO:teuthology.orchestra.run.trial078.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T11:44:19.170 INFO:teuthology.orchestra.run.trial078.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T11:44:19.170 INFO:teuthology.orchestra.run.trial078.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T11:44:19.170 INFO:teuthology.orchestra.run.trial078.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T11:44:19.170 INFO:teuthology.orchestra.run.trial078.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T11:44:19.170 INFO:teuthology.orchestra.run.trial078.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T11:44:19.171 INFO:teuthology.orchestra.run.trial078.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T11:44:19.171 INFO:teuthology.orchestra.run.trial078.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T11:44:19.171 INFO:teuthology.orchestra.run.trial078.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T11:44:19.171 INFO:teuthology.orchestra.run.trial078.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T11:44:19.171 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T11:44:19.171 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T11:44:19.171 INFO:teuthology.orchestra.run.trial078.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T11:44:19.171 INFO:teuthology.orchestra.run.trial078.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T11:44:19.171 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T11:44:19.171 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T11:44:19.171 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T11:44:19.171 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T11:44:19.171 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T11:44:19.172 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T11:44:19.172 INFO:teuthology.orchestra.run.trial078.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T11:44:19.172 INFO:teuthology.orchestra.run.trial078.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T11:44:19.172 INFO:teuthology.orchestra.run.trial078.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T11:44:19.172 INFO:teuthology.orchestra.run.trial078.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T11:44:19.172 INFO:teuthology.orchestra.run.trial078.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T11:44:19.172 INFO:teuthology.orchestra.run.trial078.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T11:44:19.172 INFO:teuthology.orchestra.run.trial078.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T11:44:19.172 INFO:teuthology.orchestra.run.trial078.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T11:44:19.172 INFO:teuthology.orchestra.run.trial078.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T11:44:19.172 INFO:teuthology.orchestra.run.trial078.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T11:44:19.172 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T11:44:19.172 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T11:44:19.173 INFO:teuthology.orchestra.run.trial078.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T11:44:19.173 INFO:teuthology.orchestra.run.trial078.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T11:44:19.173 INFO:teuthology.orchestra.run.trial078.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T11:44:19.173 INFO:teuthology.orchestra.run.trial078.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T11:44:19.173 INFO:teuthology.orchestra.run.trial078.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T11:44:19.173 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T11:44:19.173 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T11:44:19.173 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T11:44:19.173 INFO:teuthology.orchestra.run.trial078.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T11:44:19.173 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T11:44:19.173 INFO:teuthology.orchestra.run.trial078.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T11:44:19.173 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T11:44:19.173 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T11:44:19.174 INFO:teuthology.orchestra.run.trial078.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T11:44:19.174 INFO:teuthology.orchestra.run.trial078.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T11:44:19.174 INFO:teuthology.orchestra.run.trial078.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T11:44:19.174 INFO:teuthology.orchestra.run.trial078.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T11:44:19.174 INFO:teuthology.orchestra.run.trial078.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T11:44:19.174 INFO:teuthology.orchestra.run.trial078.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T11:44:19.174 INFO:teuthology.orchestra.run.trial078.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T11:44:19.174 INFO:teuthology.orchestra.run.trial078.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T11:44:19.174 INFO:teuthology.orchestra.run.trial078.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T11:44:19.174 INFO:teuthology.orchestra.run.trial078.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T11:44:19.174 INFO:teuthology.orchestra.run.trial078.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T11:44:19.174 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T11:44:19.174 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T11:44:19.175 INFO:teuthology.orchestra.run.trial078.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T11:44:19.175 INFO:teuthology.orchestra.run.trial078.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T11:44:19.175 INFO:teuthology.orchestra.run.trial078.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T11:44:19.175 INFO:teuthology.orchestra.run.trial078.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T11:44:19.175 INFO:teuthology.orchestra.run.trial078.stdout: zip-3.0-35.el9.x86_64 2026-02-17T11:44:19.175 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:19.175 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:19.223 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-base 2026-02-17T11:44:19.538 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:19.604 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:19.621 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:19.622 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:19.622 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:19.644 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install cephadm 2026-02-17T11:44:19.959 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:20.022 INFO:teuthology.orchestra.run.trial078.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:20.039 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:20.040 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:20.040 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:20.062 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T11:44:20.366 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:20.447 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:20.448 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:20.448 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-17T11:44:20.448 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:20.448 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-17T11:44:20.448 INFO:teuthology.orchestra.run.trial078.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T11:44:20.449 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:20.449 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-17T11:44:20.449 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:20.449 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-17T11:44:20.449 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:20.449 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 145 k 2026-02-17T11:44:20.449 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 431 k 2026-02-17T11:44:20.449 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-17T11:44:20.534 INFO:teuthology.orchestra.run.trial078.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 1.7 MB/s | 145 kB 00:00 2026-02-17T11:44:20.535 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:20.535 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-17T11:44:20.535 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-17T11:44:20.538 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-17T11:44:20.539 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-17T11:44:20.570 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-17T11:44:20.570 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-17T11:44:20.626 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-17T11:44:20.628 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:44:20.649 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:44:20.650 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:20.650 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T11:44:20.650 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:20.964 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T11:44:20.964 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:20.964 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-17T11:44:20.964 INFO:teuthology.orchestra.run.trial078.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:20.964 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:20.964 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:20.990 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr 2026-02-17T11:44:21.298 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:21.364 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:21.381 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:21.382 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:21.382 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:21.404 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T11:44:21.722 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:21.786 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:21.804 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:21.804 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:21.804 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:21.826 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T11:44:22.132 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:22.198 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:22.215 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:22.216 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:22.216 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:22.236 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr-rook 2026-02-17T11:44:22.554 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:22.617 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:22.635 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:22.635 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:22.635 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:22.657 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T11:44:22.960 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:23.025 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:23.041 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:23.042 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:23.042 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:23.062 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-fuse 2026-02-17T11:44:23.373 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:23.454 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:23.455 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:23.455 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-17T11:44:23.455 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:23.456 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-17T11:44:23.456 INFO:teuthology.orchestra.run.trial078.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T11:44:23.456 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:23.456 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-17T11:44:23.456 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:23.456 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-17T11:44:23.456 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:23.456 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 1.2 M 2026-02-17T11:44:23.456 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 3.6 M 2026-02-17T11:44:23.456 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-17T11:44:23.616 INFO:teuthology.orchestra.run.trial078.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 7.2 MB/s | 1.2 MB 00:00 2026-02-17T11:44:23.617 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:23.618 INFO:teuthology.orchestra.run.trial078.stdout:Total 7.1 MB/s | 1.2 MB 00:00 2026-02-17T11:44:23.618 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-17T11:44:23.622 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-17T11:44:23.622 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-17T11:44:23.656 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-17T11:44:23.656 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-17T11:44:23.756 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-17T11:44:23.774 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:24.010 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:24.065 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:24.066 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:24.066 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-17T11:44:24.066 INFO:teuthology.orchestra.run.trial078.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:24.066 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:24.066 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:24.092 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-volume 2026-02-17T11:44:24.403 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:24.467 INFO:teuthology.orchestra.run.trial078.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T11:44:24.484 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:24.484 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:24.484 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:24.505 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install librados-devel 2026-02-17T11:44:24.812 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:24.893 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:24.893 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:24.894 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-17T11:44:24.894 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:24.894 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-17T11:44:24.894 INFO:teuthology.orchestra.run.trial078.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T11:44:24.894 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:24.894 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-17T11:44:24.894 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:24.894 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-17T11:44:24.894 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:24.894 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 127 k 2026-02-17T11:44:24.894 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 456 k 2026-02-17T11:44:24.895 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-17T11:44:24.980 INFO:teuthology.orchestra.run.trial078.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 1.4 MB/s | 127 kB 00:00 2026-02-17T11:44:24.981 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:24.981 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.4 MB/s | 127 kB 00:00 2026-02-17T11:44:24.981 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-17T11:44:24.983 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-17T11:44:24.983 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-17T11:44:25.015 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-17T11:44:25.016 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-17T11:44:25.070 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-17T11:44:25.087 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:25.161 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:25.218 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:25.218 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:25.218 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-17T11:44:25.219 INFO:teuthology.orchestra.run.trial078.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:25.219 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:25.219 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:25.245 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install libcephfs2 2026-02-17T11:44:25.561 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:25.625 INFO:teuthology.orchestra.run.trial078.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:25.642 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:25.643 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:25.643 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:25.664 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install libcephfs-devel 2026-02-17T11:44:25.978 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:26.059 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:26.059 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:26.059 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-17T11:44:26.059 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:26.059 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-17T11:44:26.059 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T11:44:26.059 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:26.059 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-17T11:44:26.059 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:26.059 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-17T11:44:26.060 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:26.060 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 34 k 2026-02-17T11:44:26.060 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 153 k 2026-02-17T11:44:26.060 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-17T11:44:26.123 INFO:teuthology.orchestra.run.trial078.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 534 kB/s | 34 kB 00:00 2026-02-17T11:44:26.124 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:26.124 INFO:teuthology.orchestra.run.trial078.stdout:Total 522 kB/s | 34 kB 00:00 2026-02-17T11:44:26.124 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-17T11:44:26.126 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-17T11:44:26.126 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-17T11:44:26.128 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-17T11:44:26.129 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-17T11:44:26.149 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-17T11:44:26.166 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:26.221 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:26.277 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:26.278 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:26.278 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-17T11:44:26.278 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:26.278 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:26.278 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:26.306 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install librados2 2026-02-17T11:44:26.615 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:26.679 INFO:teuthology.orchestra.run.trial078.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:26.696 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:26.697 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:26.697 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:26.718 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install librbd1 2026-02-17T11:44:27.028 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:27.092 INFO:teuthology.orchestra.run.trial078.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:27.110 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:27.110 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:27.110 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:27.132 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-rados 2026-02-17T11:44:27.438 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:27.502 INFO:teuthology.orchestra.run.trial078.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:27.520 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:27.520 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:27.521 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:27.542 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-rgw 2026-02-17T11:44:27.850 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:27.914 INFO:teuthology.orchestra.run.trial078.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:27.931 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:27.932 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:27.932 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:27.953 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-cephfs 2026-02-17T11:44:28.262 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:28.326 INFO:teuthology.orchestra.run.trial078.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:28.344 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:28.344 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:28.344 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:28.366 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install python3-rbd 2026-02-17T11:44:28.675 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:28.739 INFO:teuthology.orchestra.run.trial078.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T11:44:28.756 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:28.757 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-17T11:44:28.757 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:28.780 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install rbd-fuse 2026-02-17T11:44:29.090 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:29.172 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:29.172 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:29.172 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-17T11:44:29.172 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:29.172 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-17T11:44:29.172 INFO:teuthology.orchestra.run.trial078.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T11:44:29.173 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:29.173 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-17T11:44:29.173 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:29.173 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-17T11:44:29.173 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:29.173 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 85 k 2026-02-17T11:44:29.173 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 227 k 2026-02-17T11:44:29.173 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-17T11:44:29.247 INFO:teuthology.orchestra.run.trial078.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T11:44:29.247 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:29.248 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T11:44:29.248 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-17T11:44:29.251 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-17T11:44:29.251 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-17T11:44:29.282 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-17T11:44:29.282 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-17T11:44:29.332 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-17T11:44:29.349 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:29.428 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:29.485 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:29.485 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:29.486 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-17T11:44:29.486 INFO:teuthology.orchestra.run.trial078.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:29.486 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:29.486 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:29.513 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install rbd-mirror 2026-02-17T11:44:29.831 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:29.914 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:29.914 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:29.914 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repo Size 2026-02-17T11:44:29.914 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:29.915 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-17T11:44:29.915 INFO:teuthology.orchestra.run.trial078.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T11:44:29.915 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:29.915 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-17T11:44:29.915 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:29.915 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-17T11:44:29.915 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:29.915 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 3.1 M 2026-02-17T11:44:29.915 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 13 M 2026-02-17T11:44:29.915 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-17T11:44:30.652 INFO:teuthology.orchestra.run.trial078.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 4.2 MB/s | 3.1 MB 00:00 2026-02-17T11:44:30.653 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:30.653 INFO:teuthology.orchestra.run.trial078.stdout:Total 4.2 MB/s | 3.1 MB 00:00 2026-02-17T11:44:30.653 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-17T11:44:30.657 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-17T11:44:30.657 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-17T11:44:30.696 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-17T11:44:30.696 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-17T11:44:30.888 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-17T11:44:30.890 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:30.912 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:30.913 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T11:44:30.913 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T11:44:30.913 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:44:30.913 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T11:44:30.913 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:31.233 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:31.234 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:31.234 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-17T11:44:31.234 INFO:teuthology.orchestra.run.trial078.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:31.234 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:31.234 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:31.263 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install rbd-nbd 2026-02-17T11:44:31.576 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 11:43:51 AM UTC. 2026-02-17T11:44:31.659 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-17T11:44:31.659 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:31.659 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-17T11:44:31.659 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:31.659 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-17T11:44:31.659 INFO:teuthology.orchestra.run.trial078.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T11:44:31.659 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:31.660 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-17T11:44:31.660 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-17T11:44:31.660 INFO:teuthology.orchestra.run.trial078.stdout:Install 1 Package 2026-02-17T11:44:31.660 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:31.660 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 171 k 2026-02-17T11:44:31.660 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 490 k 2026-02-17T11:44:31.660 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-17T11:44:31.778 INFO:teuthology.orchestra.run.trial078.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2026-02-17T11:44:31.779 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:44:31.779 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.4 MB/s | 171 kB 00:00 2026-02-17T11:44:31.779 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-17T11:44:31.784 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-17T11:44:31.784 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-17T11:44:31.816 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-17T11:44:31.816 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-17T11:44:31.873 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-17T11:44:31.889 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:31.964 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:32.023 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T11:44:32.023 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:32.023 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-17T11:44:32.023 INFO:teuthology.orchestra.run.trial078.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T11:44:32.023 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:32.023 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-17T11:44:32.054 DEBUG:teuthology.parallel:result is None 2026-02-17T11:44:32.054 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:44:32.223 DEBUG:teuthology.orchestra.run.trial078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T11:44:32.245 INFO:teuthology.orchestra.run.trial078.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T11:44:32.245 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T11:44:32.246 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T11:44:32.248 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T11:44:32.248 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:32.249 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:44:32.311 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T11:44:32.312 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:32.312 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:44:32.375 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:44:32.438 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T11:44:32.439 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:32.439 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:44:32.502 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:44:32.568 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T11:44:32.569 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:32.569 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:44:32.631 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:44:32.694 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T11:44:32.804 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T11:44:32.804 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 777 /var/log/ceph 2026-02-17T11:44:32.828 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T11:44:32.828 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T11:44:32.893 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T11:44:32.893 DEBUG:teuthology.orchestra.run.trial078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T11:44:32.966 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T11:44:32.966 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon client hunt interval max multiple': 2, 'mon election default strategy': 1, 'mon mgr beacon grace': 90, 'ms bind msgr2': False, 'ms inject socket failures': 1000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300, 'osd pool default size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon max pg per osd': 1, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max pg per osd hard ratio': 1, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(TOO_FEW_PGS\\)', '\\(PG_', '\\(PENDING_CREATING_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-17T11:44:32.966 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51339', 'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'description': 'rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51339', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon client hunt interval max multiple': 2, 'mon election default strategy': 1, 'mon mgr beacon grace': 90, 'ms bind msgr2': False, 'ms inject socket failures': 1000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300, 'osd pool default size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon max pg per osd': 1, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max pg per osd hard ratio': 1, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'create_rbd_pool': False, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(TOO_FEW_PGS\\)', '\\(PG_', '\\(PENDING_CREATING_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'mon_bind_msgr2': False, 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 4581, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'targets': {'trial078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLxXvcVDohcte+djW048JlTkZ0Jg8YjnFuZPtPYUy8lv0QWaA0iDmEwiek+8icqd+Gv8Au+6nvsN38FAtiUcROE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'osd_max_pg_per_osd': {'from_primary': True, 'pg_num': 1, 'pool_size': 2, 'test_create_from_mon': False}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:10:36', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T11:44:32.966 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T11:44:33.015 DEBUG:teuthology.orchestra.run.trial078:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T11:44:33.079 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:33.080 DEBUG:teuthology.orchestra.run.trial078:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T11:44:33.136 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T11:44:33.136 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_1 2026-02-17T11:44:33.192 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T11:44:33.192 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:44:33.192 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-17T11:44:33.192 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:44:33.192 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:44:33.192 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-17 11:44:31.054903477 +0000 2026-02-17T11:44:33.192 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-17 11:43:57.964436691 +0000 2026-02-17T11:44:33.192 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-17 11:43:57.964436691 +0000 2026-02-17T11:44:33.193 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-17 11:43:57.964436691 +0000 2026-02-17T11:44:33.193 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T11:44:33.257 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-17T11:44:33.257 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-17T11:44:33.257 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000151462 s, 3.4 MB/s 2026-02-17T11:44:33.259 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T11:44:33.316 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_2 2026-02-17T11:44:33.372 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T11:44:33.373 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:44:33.373 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-17T11:44:33.373 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:44:33.373 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:44:33.373 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-17 11:44:31.055903461 +0000 2026-02-17T11:44:33.373 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-17 11:43:57.965436673 +0000 2026-02-17T11:44:33.373 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-17 11:43:57.965436673 +0000 2026-02-17T11:44:33.373 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-17 11:43:57.965436673 +0000 2026-02-17T11:44:33.374 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T11:44:33.435 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-17T11:44:33.435 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-17T11:44:33.435 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000141814 s, 3.6 MB/s 2026-02-17T11:44:33.436 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T11:44:33.493 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_3 2026-02-17T11:44:33.550 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T11:44:33.550 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:44:33.550 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-17T11:44:33.550 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:44:33.550 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:44:33.550 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-17 11:44:31.055903461 +0000 2026-02-17T11:44:33.551 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-17 11:43:57.964436691 +0000 2026-02-17T11:44:33.551 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-17 11:43:57.964436691 +0000 2026-02-17T11:44:33.551 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-17 11:43:57.964436691 +0000 2026-02-17T11:44:33.551 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T11:44:33.615 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-17T11:44:33.615 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-17T11:44:33.615 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000218186 s, 2.3 MB/s 2026-02-17T11:44:33.616 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T11:44:33.673 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_4 2026-02-17T11:44:33.730 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T11:44:33.730 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T11:44:33.730 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 1290 Links: 1 2026-02-17T11:44:33.731 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T11:44:33.731 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T11:44:33.731 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-17 11:44:31.055903461 +0000 2026-02-17T11:44:33.731 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-17 11:43:57.964436691 +0000 2026-02-17T11:44:33.731 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-17 11:43:57.964436691 +0000 2026-02-17T11:44:33.731 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-17 11:43:57.964436691 +0000 2026-02-17T11:44:33.731 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T11:44:33.793 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-17T11:44:33.793 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-17T11:44:33.793 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000152113 s, 3.4 MB/s 2026-02-17T11:44:33.794 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T11:44:33.852 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T11:44:33.852 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-17T11:44:33.852 INFO:tasks.ceph:Generating config... 2026-02-17T11:44:33.854 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-17T11:44:33.854 INFO:tasks.ceph:[global] mon client hunt interval max multiple = 2 2026-02-17T11:44:33.854 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-17T11:44:33.855 INFO:tasks.ceph:[global] mon mgr beacon grace = 90 2026-02-17T11:44:33.855 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-17T11:44:33.855 INFO:tasks.ceph:[global] ms inject socket failures = 1000 2026-02-17T11:44:33.855 INFO:tasks.ceph:[global] ms type = async 2026-02-17T11:44:33.855 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T11:44:33.855 INFO:tasks.ceph:[mgr] debug monc = 10 2026-02-17T11:44:33.855 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T11:44:33.855 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T11:44:33.855 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T11:44:33.855 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T11:44:33.856 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T11:44:33.856 INFO:tasks.ceph:[mon] osd pool default size = 2 2026-02-17T11:44:33.856 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T11:44:33.856 INFO:tasks.ceph:[osd] bluestore compression algorithm = zlib 2026-02-17T11:44:33.856 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-17T11:44:33.856 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T11:44:33.856 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T11:44:33.856 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-17T11:44:33.856 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-17T11:44:33.856 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T11:44:33.856 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T11:44:33.856 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T11:44:33.857 INFO:tasks.ceph:[osd] mon max pg per osd = 1 2026-02-17T11:44:33.857 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T11:44:33.857 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T11:44:33.857 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T11:44:33.857 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T11:44:33.857 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T11:44:33.857 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T11:44:33.857 INFO:tasks.ceph:[osd] osd max pg per osd hard ratio = 1 2026-02-17T11:44:33.857 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T11:44:33.857 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T11:44:33.857 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T11:44:33.857 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T11:44:33.858 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T11:44:33.858 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T11:44:33.858 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T11:44:33.926 INFO:teuthology.orchestra.run.trial078.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T11:44:33.928 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T11:44:34.004 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:44:34.069 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.78:6789]')] 2026-02-17T11:44:34.070 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.78:6789]', 'mon client directed command retry': 5, 'mon client hunt interval max multiple': 2, 'mon election default strategy': 1, 'mon mgr beacon grace': 90, 'ms bind msgr2': False, 'ms inject socket failures': 1000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon max pg per osd': 1, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max pg per osd hard ratio': 1, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug monc': 10}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300, 'osd pool default size': 2}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-17T11:44:34.071 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:34.071 DEBUG:teuthology.orchestra.run.trial078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:44:34.126 DEBUG:teuthology.orchestra.run.trial078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.78:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:34.198 INFO:teuthology.orchestra.run.trial078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:34.198 INFO:teuthology.orchestra.run.trial078.stdout:monmaptool: generated fsid 236d14d8-98ee-4890-8151-1dbd079b8475 2026-02-17T11:44:34.198 INFO:teuthology.orchestra.run.trial078.stdout:setting min_mon_release = quincy 2026-02-17T11:44:34.198 INFO:teuthology.orchestra.run.trial078.stdout:epoch 0 2026-02-17T11:44:34.198 INFO:teuthology.orchestra.run.trial078.stdout:fsid 236d14d8-98ee-4890-8151-1dbd079b8475 2026-02-17T11:44:34.198 INFO:teuthology.orchestra.run.trial078.stdout:last_changed 2026-02-17T11:44:34.196285+0000 2026-02-17T11:44:34.198 INFO:teuthology.orchestra.run.trial078.stdout:created 2026-02-17T11:44:34.196285+0000 2026-02-17T11:44:34.199 INFO:teuthology.orchestra.run.trial078.stdout:min_mon_release 17 (quincy) 2026-02-17T11:44:34.199 INFO:teuthology.orchestra.run.trial078.stdout:election_strategy: 1 2026-02-17T11:44:34.199 INFO:teuthology.orchestra.run.trial078.stdout:0: v1:10.20.193.78:6789/0 mon.a 2026-02-17T11:44:34.199 INFO:teuthology.orchestra.run.trial078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-17T11:44:34.200 DEBUG:teuthology.orchestra.run.trial078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T11:44:34.258 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 236d14d8-98ee-4890-8151-1dbd079b8475... 2026-02-17T11:44:34.259 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T11:44:34.340 INFO:teuthology.orchestra.run.trial078.stdout:[global] 2026-02-17T11:44:34.340 INFO:teuthology.orchestra.run.trial078.stdout: chdir = "" 2026-02-17T11:44:34.341 INFO:teuthology.orchestra.run.trial078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T11:44:34.341 INFO:teuthology.orchestra.run.trial078.stdout: auth supported = cephx 2026-02-17T11:44:34.341 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.341 INFO:teuthology.orchestra.run.trial078.stdout: filestore xattr use omap = true 2026-02-17T11:44:34.341 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.341 INFO:teuthology.orchestra.run.trial078.stdout: mon clock drift allowed = 1.000 2026-02-17T11:44:34.341 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.341 INFO:teuthology.orchestra.run.trial078.stdout: osd crush chooseleaf type = 0 2026-02-17T11:44:34.341 INFO:teuthology.orchestra.run.trial078.stdout: auth debug = true 2026-02-17T11:44:34.341 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.342 INFO:teuthology.orchestra.run.trial078.stdout: ms die on old message = true 2026-02-17T11:44:34.342 INFO:teuthology.orchestra.run.trial078.stdout: ms die on bug = true 2026-02-17T11:44:34.342 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.342 INFO:teuthology.orchestra.run.trial078.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T11:44:34.342 INFO:teuthology.orchestra.run.trial078.stdout: mon pg warn max object skew = 0 2026-02-17T11:44:34.342 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.342 INFO:teuthology.orchestra.run.trial078.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T11:44:34.342 INFO:teuthology.orchestra.run.trial078.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T11:44:34.342 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.342 INFO:teuthology.orchestra.run.trial078.stdout: osd pool default size = 2 2026-02-17T11:44:34.342 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.342 INFO:teuthology.orchestra.run.trial078.stdout: mon osd allow primary affinity = true 2026-02-17T11:44:34.343 INFO:teuthology.orchestra.run.trial078.stdout: mon osd allow pg remap = true 2026-02-17T11:44:34.343 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on legacy crush tunables = false 2026-02-17T11:44:34.343 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on crush straw calc version zero = false 2026-02-17T11:44:34.343 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on no sortbitwise = false 2026-02-17T11:44:34.343 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on osd down out interval zero = false 2026-02-17T11:44:34.343 INFO:teuthology.orchestra.run.trial078.stdout: mon warn on too few osds = false 2026-02-17T11:44:34.343 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T11:44:34.343 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T11:44:34.343 INFO:teuthology.orchestra.run.trial078.stdout: mon_allow_pool_size_one = true 2026-02-17T11:44:34.343 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.343 INFO:teuthology.orchestra.run.trial078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T11:44:34.343 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.344 INFO:teuthology.orchestra.run.trial078.stdout: osd default data pool replay window = 5 2026-02-17T11:44:34.344 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.344 INFO:teuthology.orchestra.run.trial078.stdout: mon allow pool delete = true 2026-02-17T11:44:34.344 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.344 INFO:teuthology.orchestra.run.trial078.stdout: mon cluster log file level = debug 2026-02-17T11:44:34.344 INFO:teuthology.orchestra.run.trial078.stdout: debug asserts on shutdown = true 2026-02-17T11:44:34.344 INFO:teuthology.orchestra.run.trial078.stdout: mon health detail to clog = false 2026-02-17T11:44:34.344 INFO:teuthology.orchestra.run.trial078.stdout: mon host = [v1:10.20.193.78:6789] 2026-02-17T11:44:34.344 INFO:teuthology.orchestra.run.trial078.stdout: mon client directed command retry = 5 2026-02-17T11:44:34.344 INFO:teuthology.orchestra.run.trial078.stdout: mon client hunt interval max multiple = 2 2026-02-17T11:44:34.344 INFO:teuthology.orchestra.run.trial078.stdout: mon election default strategy = 1 2026-02-17T11:44:34.344 INFO:teuthology.orchestra.run.trial078.stdout: mon mgr beacon grace = 90 2026-02-17T11:44:34.344 INFO:teuthology.orchestra.run.trial078.stdout: ms bind msgr2 = False 2026-02-17T11:44:34.345 INFO:teuthology.orchestra.run.trial078.stdout: ms inject socket failures = 1000 2026-02-17T11:44:34.345 INFO:teuthology.orchestra.run.trial078.stdout: ms type = async 2026-02-17T11:44:34.345 INFO:teuthology.orchestra.run.trial078.stdout: fsid = 236d14d8-98ee-4890-8151-1dbd079b8475 2026-02-17T11:44:34.345 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.345 INFO:teuthology.orchestra.run.trial078.stdout:[osd] 2026-02-17T11:44:34.345 INFO:teuthology.orchestra.run.trial078.stdout: osd journal size = 100 2026-02-17T11:44:34.345 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.345 INFO:teuthology.orchestra.run.trial078.stdout: osd scrub load threshold = 5.0 2026-02-17T11:44:34.345 INFO:teuthology.orchestra.run.trial078.stdout: osd scrub max interval = 600 2026-02-17T11:44:34.345 INFO:teuthology.orchestra.run.trial078.stdout: osd mclock profile = high_recovery_ops 2026-02-17T11:44:34.345 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.345 INFO:teuthology.orchestra.run.trial078.stdout: osd recover clone overlap = true 2026-02-17T11:44:34.346 INFO:teuthology.orchestra.run.trial078.stdout: osd recovery max chunk = 1048576 2026-02-17T11:44:34.346 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.346 INFO:teuthology.orchestra.run.trial078.stdout: osd debug shutdown = true 2026-02-17T11:44:34.346 INFO:teuthology.orchestra.run.trial078.stdout: osd debug op order = true 2026-02-17T11:44:34.346 INFO:teuthology.orchestra.run.trial078.stdout: osd debug verify stray on activate = true 2026-02-17T11:44:34.346 INFO:teuthology.orchestra.run.trial078.stdout: osd debug trim objects = true 2026-02-17T11:44:34.346 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.346 INFO:teuthology.orchestra.run.trial078.stdout: osd open classes on start = true 2026-02-17T11:44:34.346 INFO:teuthology.orchestra.run.trial078.stdout: osd debug pg log writeout = true 2026-02-17T11:44:34.346 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.346 INFO:teuthology.orchestra.run.trial078.stdout: osd deep scrub update digest min age = 30 2026-02-17T11:44:34.346 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.347 INFO:teuthology.orchestra.run.trial078.stdout: osd map max advance = 10 2026-02-17T11:44:34.347 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.347 INFO:teuthology.orchestra.run.trial078.stdout: journal zero on create = true 2026-02-17T11:44:34.347 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.347 INFO:teuthology.orchestra.run.trial078.stdout: filestore ondisk finisher threads = 3 2026-02-17T11:44:34.347 INFO:teuthology.orchestra.run.trial078.stdout: filestore apply finisher threads = 3 2026-02-17T11:44:34.347 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.347 INFO:teuthology.orchestra.run.trial078.stdout: bdev debug aio = true 2026-02-17T11:44:34.347 INFO:teuthology.orchestra.run.trial078.stdout: osd debug misdirected ops = true 2026-02-17T11:44:34.347 INFO:teuthology.orchestra.run.trial078.stdout: bluestore block size = 96636764160 2026-02-17T11:44:34.347 INFO:teuthology.orchestra.run.trial078.stdout: bluestore compression algorithm = zlib 2026-02-17T11:44:34.347 INFO:teuthology.orchestra.run.trial078.stdout: bluestore compression mode = aggressive 2026-02-17T11:44:34.347 INFO:teuthology.orchestra.run.trial078.stdout: bluestore fsck on mount = True 2026-02-17T11:44:34.348 INFO:teuthology.orchestra.run.trial078.stdout: bluestore zero block detection = True 2026-02-17T11:44:34.348 INFO:teuthology.orchestra.run.trial078.stdout: debug bluefs = 20 2026-02-17T11:44:34.348 INFO:teuthology.orchestra.run.trial078.stdout: debug bluestore = 20 2026-02-17T11:44:34.348 INFO:teuthology.orchestra.run.trial078.stdout: debug ms = 1 2026-02-17T11:44:34.348 INFO:teuthology.orchestra.run.trial078.stdout: debug osd = 20 2026-02-17T11:44:34.348 INFO:teuthology.orchestra.run.trial078.stdout: debug rocksdb = 10 2026-02-17T11:44:34.348 INFO:teuthology.orchestra.run.trial078.stdout: mon max pg per osd = 1 2026-02-17T11:44:34.348 INFO:teuthology.orchestra.run.trial078.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T11:44:34.348 INFO:teuthology.orchestra.run.trial078.stdout: mon osd full ratio = 0.9 2026-02-17T11:44:34.348 INFO:teuthology.orchestra.run.trial078.stdout: mon osd nearfull ratio = 0.8 2026-02-17T11:44:34.348 INFO:teuthology.orchestra.run.trial078.stdout: osd debug verify cached snaps = True 2026-02-17T11:44:34.348 INFO:teuthology.orchestra.run.trial078.stdout: osd debug verify missing on start = True 2026-02-17T11:44:34.348 INFO:teuthology.orchestra.run.trial078.stdout: osd failsafe full ratio = 0.95 2026-02-17T11:44:34.349 INFO:teuthology.orchestra.run.trial078.stdout: osd max pg per osd hard ratio = 1 2026-02-17T11:44:34.349 INFO:teuthology.orchestra.run.trial078.stdout: osd mclock override recovery settings = True 2026-02-17T11:44:34.349 INFO:teuthology.orchestra.run.trial078.stdout: osd objectstore = bluestore 2026-02-17T11:44:34.349 INFO:teuthology.orchestra.run.trial078.stdout: osd op queue = debug_random 2026-02-17T11:44:34.349 INFO:teuthology.orchestra.run.trial078.stdout: osd op queue cut off = debug_random 2026-02-17T11:44:34.349 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.349 INFO:teuthology.orchestra.run.trial078.stdout:[mgr] 2026-02-17T11:44:34.349 INFO:teuthology.orchestra.run.trial078.stdout: debug ms = 1 2026-02-17T11:44:34.349 INFO:teuthology.orchestra.run.trial078.stdout: debug mgr = 20 2026-02-17T11:44:34.349 INFO:teuthology.orchestra.run.trial078.stdout: debug mon = 20 2026-02-17T11:44:34.349 INFO:teuthology.orchestra.run.trial078.stdout: debug auth = 20 2026-02-17T11:44:34.349 INFO:teuthology.orchestra.run.trial078.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:44:34.349 INFO:teuthology.orchestra.run.trial078.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:44:34.350 INFO:teuthology.orchestra.run.trial078.stdout: mgr/telemetry/nag = false 2026-02-17T11:44:34.350 INFO:teuthology.orchestra.run.trial078.stdout: debug monc = 10 2026-02-17T11:44:34.350 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.350 INFO:teuthology.orchestra.run.trial078.stdout:[mon] 2026-02-17T11:44:34.350 INFO:teuthology.orchestra.run.trial078.stdout: debug ms = 1 2026-02-17T11:44:34.350 INFO:teuthology.orchestra.run.trial078.stdout: debug mon = 20 2026-02-17T11:44:34.350 INFO:teuthology.orchestra.run.trial078.stdout: debug paxos = 20 2026-02-17T11:44:34.350 INFO:teuthology.orchestra.run.trial078.stdout: debug auth = 20 2026-02-17T11:44:34.350 INFO:teuthology.orchestra.run.trial078.stdout: mon data avail warn = 5 2026-02-17T11:44:34.350 INFO:teuthology.orchestra.run.trial078.stdout: mon mgr mkfs grace = 240 2026-02-17T11:44:34.350 INFO:teuthology.orchestra.run.trial078.stdout: mon reweight min pgs per osd = 4 2026-02-17T11:44:34.350 INFO:teuthology.orchestra.run.trial078.stdout: mon osd reporter subtree level = osd 2026-02-17T11:44:34.351 INFO:teuthology.orchestra.run.trial078.stdout: mon osd prime pg temp = true 2026-02-17T11:44:34.351 INFO:teuthology.orchestra.run.trial078.stdout: mon reweight min bytes per osd = 10 2026-02-17T11:44:34.351 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.351 INFO:teuthology.orchestra.run.trial078.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T11:44:34.351 INFO:teuthology.orchestra.run.trial078.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T11:44:34.351 INFO:teuthology.orchestra.run.trial078.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T11:44:34.351 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.351 INFO:teuthology.orchestra.run.trial078.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T11:44:34.351 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T11:44:34.351 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T11:44:34.352 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.352 INFO:teuthology.orchestra.run.trial078.stdout: # 1m isn't quite enough 2026-02-17T11:44:34.352 INFO:teuthology.orchestra.run.trial078.stdout: mon_down_mkfs_grace = 2m 2026-02-17T11:44:34.352 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.352 INFO:teuthology.orchestra.run.trial078.stdout: mon_warn_on_filestore_osds = false 2026-02-17T11:44:34.352 INFO:teuthology.orchestra.run.trial078.stdout: mon scrub interval = 300 2026-02-17T11:44:34.353 INFO:teuthology.orchestra.run.trial078.stdout: osd pool default size = 2 2026-02-17T11:44:34.353 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:34.353 INFO:teuthology.orchestra.run.trial078.stdout:[client] 2026-02-17T11:44:34.353 INFO:teuthology.orchestra.run.trial078.stdout: rgw cache enabled = true 2026-02-17T11:44:34.353 INFO:teuthology.orchestra.run.trial078.stdout: rgw enable ops log = true 2026-02-17T11:44:34.353 INFO:teuthology.orchestra.run.trial078.stdout: rgw enable usage log = true 2026-02-17T11:44:34.353 INFO:teuthology.orchestra.run.trial078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T11:44:34.353 INFO:teuthology.orchestra.run.trial078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T11:44:34.353 INFO:teuthology.orchestra.run.trial078.stdout:[mon.a] 2026-02-17T11:44:34.355 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T11:44:34.355 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T11:44:34.437 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T11:44:34.437 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:34.438 DEBUG:teuthology.orchestra.run.trial078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T11:44:34.494 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:34.494 DEBUG:teuthology.orchestra.run.trial078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T11:44:34.548 INFO:tasks.ceph:Sending monmap to node ubuntu@trial078.front.sepia.ceph.com 2026-02-17T11:44:34.549 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:34.549 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T11:44:34.549 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T11:44:34.621 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:34.621 DEBUG:teuthology.orchestra.run.trial078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:34.678 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T11:44:34.679 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T11:44:34.679 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:44:34.762 INFO:teuthology.orchestra.run.trial078.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T11:44:34.764 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T11:44:34.764 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T11:44:34.764 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T11:44:34.765 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-17T11:44:34.765 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T11:44:34.828 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T11:44:34.828 INFO:tasks.ceph:role: osd.0 2026-02-17T11:44:34.828 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial078.front.sepia.ceph.com 2026-02-17T11:44:34.828 DEBUG:teuthology.orchestra.run.trial078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T11:44:34.893 INFO:teuthology.orchestra.run.trial078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:44:34.893 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:44:34.893 INFO:teuthology.orchestra.run.trial078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:44:34.893 INFO:teuthology.orchestra.run.trial078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:44:34.893 INFO:teuthology.orchestra.run.trial078.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:44:34.893 INFO:teuthology.orchestra.run.trial078.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:44:34.893 INFO:teuthology.orchestra.run.trial078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:44:34.893 INFO:teuthology.orchestra.run.trial078.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:44:34.893 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:44:34.893 INFO:teuthology.orchestra.run.trial078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:44:35.483 INFO:teuthology.orchestra.run.trial078.stdout:Discarding blocks...Done. 2026-02-17T11:44:35.486 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial078.front.sepia.ceph.com -o noatime 2026-02-17T11:44:35.486 DEBUG:teuthology.orchestra.run.trial078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T11:44:35.554 DEBUG:teuthology.orchestra.run.trial078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T11:44:35.622 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T11:44:35.685 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T11:44:35.685 INFO:tasks.ceph:role: osd.1 2026-02-17T11:44:35.685 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial078.front.sepia.ceph.com 2026-02-17T11:44:35.685 DEBUG:teuthology.orchestra.run.trial078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T11:44:35.750 INFO:teuthology.orchestra.run.trial078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:44:35.750 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:44:35.750 INFO:teuthology.orchestra.run.trial078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:44:35.750 INFO:teuthology.orchestra.run.trial078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:44:35.750 INFO:teuthology.orchestra.run.trial078.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:44:35.750 INFO:teuthology.orchestra.run.trial078.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:44:35.750 INFO:teuthology.orchestra.run.trial078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:44:35.750 INFO:teuthology.orchestra.run.trial078.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:44:35.750 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:44:35.751 INFO:teuthology.orchestra.run.trial078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:44:36.311 INFO:teuthology.orchestra.run.trial078.stdout:Discarding blocks...Done. 2026-02-17T11:44:36.313 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial078.front.sepia.ceph.com -o noatime 2026-02-17T11:44:36.313 DEBUG:teuthology.orchestra.run.trial078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T11:44:36.382 DEBUG:teuthology.orchestra.run.trial078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T11:44:36.450 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T11:44:36.514 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T11:44:36.514 INFO:tasks.ceph:role: osd.2 2026-02-17T11:44:36.514 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial078.front.sepia.ceph.com 2026-02-17T11:44:36.514 DEBUG:teuthology.orchestra.run.trial078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T11:44:36.580 INFO:teuthology.orchestra.run.trial078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:44:36.580 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:44:36.581 INFO:teuthology.orchestra.run.trial078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:44:36.581 INFO:teuthology.orchestra.run.trial078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:44:36.581 INFO:teuthology.orchestra.run.trial078.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:44:36.581 INFO:teuthology.orchestra.run.trial078.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:44:36.581 INFO:teuthology.orchestra.run.trial078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:44:36.581 INFO:teuthology.orchestra.run.trial078.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:44:36.581 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:44:36.581 INFO:teuthology.orchestra.run.trial078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:44:37.144 INFO:teuthology.orchestra.run.trial078.stdout:Discarding blocks...Done. 2026-02-17T11:44:37.146 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial078.front.sepia.ceph.com -o noatime 2026-02-17T11:44:37.146 DEBUG:teuthology.orchestra.run.trial078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T11:44:37.213 DEBUG:teuthology.orchestra.run.trial078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T11:44:37.282 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-17T11:44:37.345 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-17T11:44:37.346 INFO:tasks.ceph:role: osd.3 2026-02-17T11:44:37.346 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial078.front.sepia.ceph.com 2026-02-17T11:44:37.346 DEBUG:teuthology.orchestra.run.trial078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T11:44:37.412 INFO:teuthology.orchestra.run.trial078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T11:44:37.412 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T11:44:37.412 INFO:teuthology.orchestra.run.trial078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T11:44:37.412 INFO:teuthology.orchestra.run.trial078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T11:44:37.412 INFO:teuthology.orchestra.run.trial078.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T11:44:37.413 INFO:teuthology.orchestra.run.trial078.stdout: = sunit=0 swidth=0 blks 2026-02-17T11:44:37.413 INFO:teuthology.orchestra.run.trial078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T11:44:37.413 INFO:teuthology.orchestra.run.trial078.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T11:44:37.413 INFO:teuthology.orchestra.run.trial078.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T11:44:37.413 INFO:teuthology.orchestra.run.trial078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T11:44:37.972 INFO:teuthology.orchestra.run.trial078.stdout:Discarding blocks...Done. 2026-02-17T11:44:37.974 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial078.front.sepia.ceph.com -o noatime 2026-02-17T11:44:37.974 DEBUG:teuthology.orchestra.run.trial078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-17T11:44:38.047 DEBUG:teuthology.orchestra.run.trial078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-17T11:44:38.113 DEBUG:teuthology.orchestra.run.trial078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:38.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:38.189+0000 7fc48fe21780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T11:44:38.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:38.190+0000 7fc48fe21780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T11:44:38.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:38.190+0000 7fc48fe21780 -1 bdev(0x5614eb11f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T11:44:38.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:38.190+0000 7fc48fe21780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T11:44:41.102 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T11:44:41.166 DEBUG:teuthology.orchestra.run.trial078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:41.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:41.242+0000 7f71ef221780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T11:44:41.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:41.242+0000 7f71ef221780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T11:44:41.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:41.242+0000 7f71ef221780 -1 bdev(0x560fcee8b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T11:44:41.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:41.242+0000 7f71ef221780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T11:44:44.150 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T11:44:44.215 DEBUG:teuthology.orchestra.run.trial078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:44.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:44.289+0000 7f56b1b27780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T11:44:44.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:44.289+0000 7f56b1b27780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T11:44:44.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:44.289+0000 7f56b1b27780 -1 bdev(0x560a682ed800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T11:44:44.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:44.289+0000 7f56b1b27780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T11:44:47.201 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T11:44:47.268 DEBUG:teuthology.orchestra.run.trial078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:47.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:47.342+0000 7fc478c82780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-17T11:44:47.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:47.343+0000 7fc478c82780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-17T11:44:47.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:47.343+0000 7fc478c82780 -1 bdev(0x55e9b4965800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-17T11:44:47.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-17T11:44:47.343+0000 7fc478c82780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-17T11:44:50.737 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-17T11:44:50.802 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T11:44:50.802 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:50.802 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T11:44:50.866 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:50.866 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T11:44:50.929 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:50.929 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T11:44:50.993 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:50.993 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T11:44:51.057 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:51.057 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-17T11:44:51.121 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T11:44:51.121 DEBUG:teuthology.orchestra.run.trial078:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T11:44:51.184 INFO:teuthology.orchestra.run.trial078.stdout:[mgr.x] 2026-02-17T11:44:51.184 INFO:teuthology.orchestra.run.trial078.stdout: key = AQCiVJRp5BFVLRAAlA/dWbjKfphwlCQ8Eg0onA== 2026-02-17T11:44:51.184 INFO:teuthology.orchestra.run.trial078.stdout:[osd.0] 2026-02-17T11:44:51.184 INFO:teuthology.orchestra.run.trial078.stdout: key = AQCmVJRpdCVdCxAAWkhMzOj7l7WFSd9ZTGXysA== 2026-02-17T11:44:51.184 INFO:teuthology.orchestra.run.trial078.stdout:[osd.1] 2026-02-17T11:44:51.184 INFO:teuthology.orchestra.run.trial078.stdout: key = AQCpVJRpXWeBDhAAvafPLGf2A9vWJrfS3nYwDA== 2026-02-17T11:44:51.184 INFO:teuthology.orchestra.run.trial078.stdout:[osd.2] 2026-02-17T11:44:51.185 INFO:teuthology.orchestra.run.trial078.stdout: key = AQCsVJRpPOVQERAA3GjIMPyepRhbQ4Cbzu7/Dg== 2026-02-17T11:44:51.185 INFO:teuthology.orchestra.run.trial078.stdout:[osd.3] 2026-02-17T11:44:51.185 INFO:teuthology.orchestra.run.trial078.stdout: key = AQCvVJRpcl5/FBAAysrlc7XOSCcU4Q67A7rurw== 2026-02-17T11:44:51.186 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T11:44:51.266 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:44:51.345 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:44:51.425 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:44:51.504 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T11:44:51.583 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T11:44:51.583 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T11:44:51.649 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T11:44:51.731 DEBUG:teuthology.orchestra.run.trial078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T11:44:51.794 DEBUG:teuthology.orchestra.run.trial078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T11:44:51.850 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T11:44:51.851 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T11:44:51.851 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T11:44:51.893 INFO:tasks.ceph.mon.a:Started 2026-02-17T11:44:51.893 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph config set mgr mgr_pool false --force 2026-02-17T11:44:51.997 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T11:44:51.997 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T11:44:51.997 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T11:44:52.000 INFO:tasks.ceph.mgr.x:Started 2026-02-17T11:44:52.000 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T11:44:52.000 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T11:44:52.098 INFO:teuthology.orchestra.run.trial078.stderr:adjusted tunables profile to default 2026-02-17T11:44:52.105 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T11:44:52.106 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T11:44:52.106 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:52.106 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T11:44:52.131 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:52.131 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T11:44:52.196 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:52.197 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T11:44:52.261 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-17T11:44:52.261 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-17T11:44:52.325 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph osd new bb321727-43bc-4ca3-9b42-040be5f268f4 0 2026-02-17T11:44:52.405 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.403+0000 7f98d7dc7140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T11:44:52.470 INFO:teuthology.orchestra.run.trial078.stdout:0 2026-02-17T11:44:52.479 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph osd new 2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c 1 2026-02-17T11:44:52.528 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.526+0000 7f98d7dc7140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T11:44:52.556 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.554+0000 7f98d7dc7140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T11:44:52.590 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.588+0000 7f98d7dc7140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T11:44:52.614 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.612+0000 7f98d7dc7140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T11:44:52.620 INFO:teuthology.orchestra.run.trial078.stdout:1 2026-02-17T11:44:52.628 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph osd new a6b0b09b-97e0-41cd-818d-b6f45aef9175 2 2026-02-17T11:44:52.642 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.639+0000 7f98d7dc7140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T11:44:52.698 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.696+0000 7f98d7dc7140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T11:44:52.743 INFO:teuthology.orchestra.run.trial078.stdout:2 2026-02-17T11:44:52.752 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph osd new 68b5ed55-d078-4536-a06a-86fa9340cfe3 3 2026-02-17T11:44:52.760 INFO:tasks.ceph.mgr.x.trial078.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T11:44:52.760 INFO:tasks.ceph.mgr.x.trial078.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T11:44:52.760 INFO:tasks.ceph.mgr.x.trial078.stderr: from numpy import show_config as show_numpy_config 2026-02-17T11:44:52.763 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.760+0000 7f98d7dc7140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T11:44:52.789 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.787+0000 7f98d7dc7140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T11:44:52.845 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.842+0000 7f98d7dc7140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T11:44:52.853 INFO:teuthology.orchestra.run.trial078.stdout:3 2026-02-17T11:44:52.862 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T11:44:52.863 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T11:44:52.889 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.886+0000 7f98d7dc7140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T11:44:52.891 INFO:tasks.ceph.osd.0:Started 2026-02-17T11:44:52.891 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T11:44:52.891 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T11:44:52.893 INFO:tasks.ceph.osd.1:Started 2026-02-17T11:44:52.894 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T11:44:52.894 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T11:44:52.896 INFO:tasks.ceph.osd.2:Started 2026-02-17T11:44:52.896 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-17T11:44:52.896 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-17T11:44:52.898 INFO:tasks.ceph.osd.3:Started 2026-02-17T11:44:52.899 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:44:52.915 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.912+0000 7f98d7dc7140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T11:44:52.941 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.938+0000 7f98d7dc7140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T11:44:52.968 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.966+0000 7f98d7dc7140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T11:44:52.991 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:52.989+0000 7f98d7dc7140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T11:44:53.182 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:53.180+0000 7f98d7dc7140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T11:44:53.237 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:53.235+0000 7f98d7dc7140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T11:44:53.260 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:53.257+0000 7f98d7dc7140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T11:44:53.283 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:53.281+0000 7f98d7dc7140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T11:44:53.336 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:53.334+0000 7f98d7dc7140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:44:53.357 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:53.355+0000 7f98d7dc7140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T11:44:53.409 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:53.407+0000 7f98d7dc7140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T11:44:53.810 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:53.808+0000 7f98d7dc7140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T11:44:53.833 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:53.831+0000 7f98d7dc7140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T11:44:54.174 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:54.172+0000 7f98d7dc7140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T11:44:54.328 INFO:tasks.ceph.osd.2.trial078.stderr:2026-02-17T11:44:54.326+0000 7f85b0939780 -1 Falling back to public interface 2026-02-17T11:44:54.336 INFO:tasks.ceph.osd.1.trial078.stderr:2026-02-17T11:44:54.334+0000 7f98d3217780 -1 Falling back to public interface 2026-02-17T11:44:54.814 INFO:tasks.ceph.osd.3.trial078.stderr:2026-02-17T11:44:54.812+0000 7f4f5580f780 -1 Falling back to public interface 2026-02-17T11:44:54.820 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-17T11:44:54.818+0000 7f8e3c53b780 -1 Falling back to public interface 2026-02-17T11:44:55.179 INFO:tasks.ceph.mgr.x.trial078.stderr:2026-02-17T11:44:55.177+0000 7f97f49fe640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-17T11:44:56.054 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:44:56.054 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":6,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:44:52.851566+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:44:56.062 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T11:44:56.063 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T11:44:56.465 DEBUG:teuthology.orchestra.run.trial078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:44:56.614 INFO:teuthology.misc.health.trial078.stdout: 2026-02-17T11:44:56.614 INFO:teuthology.misc.health.trial078.stdout:{"epoch":6,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:44:52.851566+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:44:56.622 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-17T11:44:58.366 INFO:tasks.ceph.osd.2.trial078.stderr:2026-02-17T11:44:58.364+0000 7f85b0939780 -1 osd.2 0 log_to_monitors true 2026-02-17T11:44:58.407 INFO:tasks.ceph.osd.1.trial078.stderr:2026-02-17T11:44:58.405+0000 7f98d3217780 -1 osd.1 0 log_to_monitors true 2026-02-17T11:44:58.834 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-17T11:44:58.832+0000 7f8e3c53b780 -1 osd.0 0 log_to_monitors true 2026-02-17T11:44:59.066 INFO:tasks.ceph.osd.3.trial078.stderr:2026-02-17T11:44:59.064+0000 7f4f5580f780 -1 osd.3 0 log_to_monitors true 2026-02-17T11:45:00.377 INFO:tasks.ceph.osd.2.trial078.stderr:2026-02-17T11:45:00.375+0000 7f85ac8c6640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T11:45:00.379 INFO:tasks.ceph.osd.2.trial078.stderr:2026-02-17T11:45:00.378+0000 7f85a46e8640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:45:00.421 INFO:tasks.ceph.osd.3.trial078.stderr:2026-02-17T11:45:00.419+0000 7f4f51149640 -1 osd.3 0 waiting for initial osdmap 2026-02-17T11:45:00.423 INFO:tasks.ceph.osd.3.trial078.stderr:2026-02-17T11:45:00.421+0000 7f4f4cf73640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:45:01.444 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-17T11:45:01.442+0000 7f8e384c8640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T11:45:01.446 INFO:tasks.ceph.osd.0.trial078.stderr:2026-02-17T11:45:01.444+0000 7f8e302ea640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:45:03.025 DEBUG:teuthology.orchestra.run.trial078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T11:45:03.455 INFO:tasks.ceph.osd.1.trial078.stderr:2026-02-17T11:45:03.453+0000 7f98cebdc640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T11:45:03.457 INFO:tasks.ceph.osd.1.trial078.stderr:2026-02-17T11:45:03.456+0000 7f98c69fe640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T11:45:06.177 INFO:teuthology.misc.health.trial078.stdout: 2026-02-17T11:45:06.177 INFO:teuthology.misc.health.trial078.stdout:{"epoch":13,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:45:05.456332+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:45:06.184 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-17T11:45:06.185 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T11:45:06.185 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T11:45:06.185 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T11:45:06.185 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T11:45:06.186 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T11:45:06.364 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:06.370 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":4,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6800","nonce":824325898}]},"active_addr":"10.20.193.78:6800/824325898","active_change":"2026-02-17T11:44:54.174192+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.78:0","nonce":1248755904}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.78:0","nonce":2629208321}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.78:0","nonce":141226721}]}]} 2026-02-17T11:45:06.375 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T11:45:06.376 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T11:45:06.376 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:45:06.534 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:06.534 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":13,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:45:05.456332+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:45:06.542 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T11:45:06.543 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:45:06.701 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:06.701 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":13,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:45:05.456332+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:45:06.711 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:45:06.712 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:45:06.712 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:45:06.713 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:45:06.798 INFO:teuthology.orchestra.run.trial078.stdout:47244640259 2026-02-17T11:45:06.799 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:06.800 INFO:teuthology.orchestra.run.trial078.stdout:51539607555 2026-02-17T11:45:06.800 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:06.801 INFO:teuthology.orchestra.run.trial078.stdout:42949672962 2026-02-17T11:45:06.802 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:06.803 INFO:teuthology.orchestra.run.trial078.stdout:38654705668 2026-02-17T11:45:06.804 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:07.001 INFO:teuthology.orchestra.run.trial078.stdout:42949672961 2026-02-17T11:45:07.001 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-17T11:45:07.003 INFO:teuthology.orchestra.run.trial078.stdout:51539607554 2026-02-17T11:45:07.008 INFO:teuthology.orchestra.run.trial078.stdout:38654705666 2026-02-17T11:45:07.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672962 got 42949672961 for osd.3 2026-02-17T11:45:07.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2026-02-17T11:45:07.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.1 2026-02-17T11:45:07.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705666 for osd.2 2026-02-17T11:45:08.011 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:08.012 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:08.013 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:08.020 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:08.175 INFO:teuthology.orchestra.run.trial078.stdout:42949672961 2026-02-17T11:45:08.176 INFO:teuthology.orchestra.run.trial078.stdout:47244640258 2026-02-17T11:45:08.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672962 got 42949672961 for osd.3 2026-02-17T11:45:08.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2026-02-17T11:45:08.218 INFO:teuthology.orchestra.run.trial078.stdout:38654705666 2026-02-17T11:45:08.218 INFO:teuthology.orchestra.run.trial078.stdout:51539607554 2026-02-17T11:45:08.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705666 for osd.2 2026-02-17T11:45:08.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.1 2026-02-17T11:45:09.186 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:09.187 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:09.228 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:09.230 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:09.350 INFO:teuthology.orchestra.run.trial078.stdout:47244640259 2026-02-17T11:45:09.352 INFO:teuthology.orchestra.run.trial078.stdout:42949672963 2026-02-17T11:45:09.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.0 2026-02-17T11:45:09.361 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:09.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672962 got 42949672963 for osd.3 2026-02-17T11:45:09.363 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:09.388 INFO:teuthology.orchestra.run.trial078.stdout:51539607555 2026-02-17T11:45:09.393 INFO:teuthology.orchestra.run.trial078.stdout:38654705668 2026-02-17T11:45:09.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607555 for osd.1 2026-02-17T11:45:09.397 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:09.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.2 2026-02-17T11:45:09.403 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:09.403 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:45:09.403 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:45:09.593 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:09.594 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:45:09.601 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-17T11:45:08.177657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108292,"kb_used_data":432,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377379068,"statfs":{"total":386547056640,"available":386436165632,"internally_reserved":0,"allocated":442368,"data_stored":99950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607555,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27068,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344772,"statfs":{"total":96636764160,"available":96609046528,"internally_reserved":0,"allocated":106496,"data_stored":23827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27068,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344772,"statfs":{"total":96636764160,"available":96609046528,"internally_reserved":0,"allocated":106496,"data_stored":23827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27076,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344764,"statfs":{"total":96636764160,"available":96609038336,"internally_reserved":0,"allocated":114688,"data_stored":26148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27080,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":114688,"data_stored":26148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T11:45:09.602 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:45:09.761 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:09.761 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:45:09.769 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-17T11:45:08.177657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108292,"kb_used_data":432,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377379068,"statfs":{"total":386547056640,"available":386436165632,"internally_reserved":0,"allocated":442368,"data_stored":99950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607555,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27068,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344772,"statfs":{"total":96636764160,"available":96609046528,"internally_reserved":0,"allocated":106496,"data_stored":23827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27068,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344772,"statfs":{"total":96636764160,"available":96609046528,"internally_reserved":0,"allocated":106496,"data_stored":23827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27076,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344764,"statfs":{"total":96636764160,"available":96609038336,"internally_reserved":0,"allocated":114688,"data_stored":26148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27080,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344760,"statfs":{"total":96636764160,"available":96609034240,"internally_reserved":0,"allocated":114688,"data_stored":26148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T11:45:09.769 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:45:09.770 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T11:45:09.770 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T11:45:09.770 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T11:45:09.943 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:09.944 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T11:45:09.952 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T11:45:09.953 INFO:teuthology.run_tasks:Running task osd_max_pg_per_osd... 2026-02-17T11:45:09.966 INFO:tasks.osd_max_pg_per_osd:1. creating pool.a 2026-02-17T11:45:09.966 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-17T11:45:09.966 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 1 2026-02-17T11:45:10.471 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_0' created 2026-02-17T11:45:10.481 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-17T11:45:11.474 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-17T11:45:12.487 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:45:12.644 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:12.644 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":17,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:45:12.473837+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:45:12.653 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:45:12.653 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:45:12.654 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:45:12.654 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:45:12.741 INFO:teuthology.orchestra.run.trial078.stdout:51539607557 2026-02-17T11:45:12.742 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:12.743 INFO:teuthology.orchestra.run.trial078.stdout:42949672965 2026-02-17T11:45:12.743 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:12.744 INFO:teuthology.orchestra.run.trial078.stdout:38654705671 2026-02-17T11:45:12.744 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:12.745 INFO:teuthology.orchestra.run.trial078.stdout:47244640261 2026-02-17T11:45:12.746 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:12.944 INFO:teuthology.orchestra.run.trial078.stdout:42949672963 2026-02-17T11:45:12.946 INFO:teuthology.orchestra.run.trial078.stdout:38654705670 2026-02-17T11:45:12.951 INFO:teuthology.orchestra.run.trial078.stdout:47244640260 2026-02-17T11:45:12.952 INFO:teuthology.orchestra.run.trial078.stdout:51539607556 2026-02-17T11:45:12.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672963 for osd.3 2026-02-17T11:45:12.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.2 2026-02-17T11:45:12.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.0 2026-02-17T11:45:12.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607556 for osd.1 2026-02-17T11:45:13.954 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:13.956 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:13.962 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:13.964 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:14.117 INFO:teuthology.orchestra.run.trial078.stdout:42949672963 2026-02-17T11:45:14.122 INFO:teuthology.orchestra.run.trial078.stdout:38654705670 2026-02-17T11:45:14.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672963 for osd.3 2026-02-17T11:45:14.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.2 2026-02-17T11:45:14.158 INFO:teuthology.orchestra.run.trial078.stdout:51539607556 2026-02-17T11:45:14.165 INFO:teuthology.orchestra.run.trial078.stdout:47244640260 2026-02-17T11:45:14.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607556 for osd.1 2026-02-17T11:45:14.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.0 2026-02-17T11:45:15.128 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:15.134 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:15.169 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:15.176 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:15.294 INFO:teuthology.orchestra.run.trial078.stdout:42949672965 2026-02-17T11:45:15.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.3 2026-02-17T11:45:15.304 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:15.332 INFO:teuthology.orchestra.run.trial078.stdout:38654705671 2026-02-17T11:45:15.334 INFO:teuthology.orchestra.run.trial078.stdout:51539607557 2026-02-17T11:45:15.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2026-02-17T11:45:15.341 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:15.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607557 for osd.1 2026-02-17T11:45:15.343 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:18.373 INFO:teuthology.orchestra.run.trial078.stdout:47244640262 2026-02-17T11:45:18.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640262 for osd.0 2026-02-17T11:45:18.382 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:18.382 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:45:18.537 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:18.538 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:45:18.546 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2026-02-17T11:45:18.178758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":108472,"kb_used_data":600,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378888,"statfs":{"total":386547056640,"available":386435981312,"internally_reserved":0,"allocated":614400,"data_stored":157664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T11:45:13.480156+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:45:13.480156+0000","last_peered":"2026-02-17T11:45:13.480156+0000","last_clean":"2026-02-17T11:45:13.480156+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:45:13.480156+0000","last_undegraded":"2026-02-17T11:45:13.480156+0000","last_fullsized":"2026-02-17T11:45:13.480156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607558,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":155648,"data_stored":40160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":147456,"data_stored":37184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27120,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":155648,"data_stored":40160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27120,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":155648,"data_stored":40160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:45:24.547 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:45:24.548 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:45:24.549 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:45:24.549 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:45:24.636 INFO:teuthology.orchestra.run.trial078.stdout:47244640265 2026-02-17T11:45:24.637 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:24.638 INFO:teuthology.orchestra.run.trial078.stdout:42949672968 2026-02-17T11:45:24.639 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:24.640 INFO:teuthology.orchestra.run.trial078.stdout:51539607560 2026-02-17T11:45:24.640 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:24.641 INFO:teuthology.orchestra.run.trial078.stdout:38654705674 2026-02-17T11:45:24.642 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:24.839 INFO:teuthology.orchestra.run.trial078.stdout:42949672967 2026-02-17T11:45:24.840 INFO:teuthology.orchestra.run.trial078.stdout:47244640264 2026-02-17T11:45:24.841 INFO:teuthology.orchestra.run.trial078.stdout:38654705673 2026-02-17T11:45:24.847 INFO:teuthology.orchestra.run.trial078.stdout:51539607559 2026-02-17T11:45:24.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672967 for osd.3 2026-02-17T11:45:24.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640265 got 47244640264 for osd.0 2026-02-17T11:45:24.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705673 for osd.2 2026-02-17T11:45:24.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607560 got 51539607559 for osd.1 2026-02-17T11:45:25.850 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:25.851 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:25.852 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:25.858 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:26.013 INFO:teuthology.orchestra.run.trial078.stdout:38654705673 2026-02-17T11:45:26.016 INFO:teuthology.orchestra.run.trial078.stdout:42949672967 2026-02-17T11:45:26.021 INFO:teuthology.orchestra.run.trial078.stdout:47244640264 2026-02-17T11:45:26.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705673 for osd.2 2026-02-17T11:45:26.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672967 for osd.3 2026-02-17T11:45:26.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640265 got 47244640264 for osd.0 2026-02-17T11:45:26.057 INFO:teuthology.orchestra.run.trial078.stdout:51539607559 2026-02-17T11:45:26.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607560 got 51539607559 for osd.1 2026-02-17T11:45:27.024 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:27.026 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:27.031 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:27.068 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:27.188 INFO:teuthology.orchestra.run.trial078.stdout:38654705674 2026-02-17T11:45:27.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705674 for osd.2 2026-02-17T11:45:27.199 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:27.225 INFO:teuthology.orchestra.run.trial078.stdout:51539607561 2026-02-17T11:45:27.229 INFO:teuthology.orchestra.run.trial078.stdout:47244640265 2026-02-17T11:45:27.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607560 got 51539607561 for osd.1 2026-02-17T11:45:27.235 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:27.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640265 got 47244640265 for osd.0 2026-02-17T11:45:27.239 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:30.184 INFO:teuthology.orchestra.run.trial078.stdout:42949672969 2026-02-17T11:45:30.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672969 for osd.3 2026-02-17T11:45:30.193 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:30.194 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:45:30.350 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:30.350 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:45:30.359 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2026-02-17T11:45:30.180118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":108472,"kb_used_data":608,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378888,"statfs":{"total":386547056640,"available":386435981312,"internally_reserved":0,"allocated":622592,"data_stored":160640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-17T11:45:13.480156+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:45:13.480156+0000","last_peered":"2026-02-17T11:45:13.480156+0000","last_clean":"2026-02-17T11:45:13.480156+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:45:13.480156+0000","last_undegraded":"2026-02-17T11:45:13.480156+0000","last_fullsized":"2026-02-17T11:45:13.480156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607561,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":155648,"data_stored":40160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640266,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":155648,"data_stored":40160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27120,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":155648,"data_stored":40160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705675,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27120,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":155648,"data_stored":40160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:45:30.360 INFO:tasks.osd_max_pg_per_osd:2. creating pool.b 2026-02-17T11:45:30.360 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2026-02-17T11:45:30.360 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 1 2026-02-17T11:45:31.494 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_1' created 2026-02-17T11:45:31.505 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2026-02-17T11:45:32.495 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_1' 2026-02-17T11:45:33.507 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:45:33.662 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:33.662 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":20,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:45:32.493540+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"unique_pool_1","create_time":"2026-02-17T11:45:30.520513+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:45:33.672 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:45:33.673 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:45:33.673 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:45:33.674 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:45:33.760 INFO:teuthology.orchestra.run.trial078.stdout:38654705677 2026-02-17T11:45:33.761 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:33.762 INFO:teuthology.orchestra.run.trial078.stdout:47244640268 2026-02-17T11:45:33.762 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:33.764 INFO:teuthology.orchestra.run.trial078.stdout:51539607563 2026-02-17T11:45:33.764 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:33.765 INFO:teuthology.orchestra.run.trial078.stdout:42949672971 2026-02-17T11:45:33.765 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:33.960 INFO:teuthology.orchestra.run.trial078.stdout:51539607562 2026-02-17T11:45:33.963 INFO:teuthology.orchestra.run.trial078.stdout:47244640266 2026-02-17T11:45:33.965 INFO:teuthology.orchestra.run.trial078.stdout:38654705676 2026-02-17T11:45:33.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607563 got 51539607562 for osd.1 2026-02-17T11:45:33.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640268 got 47244640266 for osd.0 2026-02-17T11:45:33.975 INFO:teuthology.orchestra.run.trial078.stdout:42949672969 2026-02-17T11:45:33.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705677 got 38654705676 for osd.2 2026-02-17T11:45:33.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672971 got 42949672969 for osd.3 2026-02-17T11:45:34.971 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:34.973 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:34.976 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:34.986 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:35.131 INFO:teuthology.orchestra.run.trial078.stdout:47244640268 2026-02-17T11:45:35.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640268 got 47244640268 for osd.0 2026-02-17T11:45:35.142 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:35.177 INFO:teuthology.orchestra.run.trial078.stdout:38654705677 2026-02-17T11:45:35.177 INFO:teuthology.orchestra.run.trial078.stdout:42949672971 2026-02-17T11:45:35.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705677 got 38654705677 for osd.2 2026-02-17T11:45:35.188 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:35.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672971 got 42949672971 for osd.3 2026-02-17T11:45:35.189 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:38.131 INFO:teuthology.orchestra.run.trial078.stdout:51539607564 2026-02-17T11:45:38.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607563 got 51539607564 for osd.1 2026-02-17T11:45:38.140 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:38.141 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:45:38.296 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:38.296 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:45:38.304 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2026-02-17T11:45:38.181127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":108540,"kb_used_data":672,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378820,"statfs":{"total":386547056640,"available":386435911680,"internally_reserved":0,"allocated":688128,"data_stored":187476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":20,"state":"creating+activating","last_fresh":"2026-02-17T11:45:32.496585+0000","last_change":"2026-02-17T11:45:32.496653+0000","last_active":"2026-02-17T11:45:31.491502+0000","last_peered":"2026-02-17T11:45:31.491502+0000","last_clean":"2026-02-17T11:45:31.491502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:45:32.496585+0000","last_undegraded":"2026-02-17T11:45:32.496585+0000","last_fullsized":"2026-02-17T11:45:32.496585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:31.491502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:31.491502+0000","last_clean_scrub_stamp":"2026-02-17T11:45:31.491502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:33.342769+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:45:33.342769+0000","last_peered":"2026-02-17T11:45:33.342769+0000","last_clean":"2026-02-17T11:45:33.342769+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:45:33.342769+0000","last_undegraded":"2026-02-17T11:45:33.342769+0000","last_fullsized":"2026-02-17T11:45:33.342769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607564,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":172032,"data_stored":46869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640268,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":172032,"data_stored":46869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672972,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":172032,"data_stored":46869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27132,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":172032,"data_stored":46869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:45:44.307 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:45:44.307 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:45:44.308 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:45:44.308 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:45:44.397 INFO:teuthology.orchestra.run.trial078.stdout:38654705680 2026-02-17T11:45:44.397 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:44.398 INFO:teuthology.orchestra.run.trial078.stdout:42949672974 2026-02-17T11:45:44.399 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:44.400 INFO:teuthology.orchestra.run.trial078.stdout:47244640271 2026-02-17T11:45:44.400 INFO:teuthology.orchestra.run.trial078.stdout:51539607566 2026-02-17T11:45:44.401 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:44.402 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:44.602 INFO:teuthology.orchestra.run.trial078.stdout:42949672973 2026-02-17T11:45:44.604 INFO:teuthology.orchestra.run.trial078.stdout:38654705679 2026-02-17T11:45:44.605 INFO:teuthology.orchestra.run.trial078.stdout:47244640270 2026-02-17T11:45:44.606 INFO:teuthology.orchestra.run.trial078.stdout:51539607565 2026-02-17T11:45:44.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672974 got 42949672973 for osd.3 2026-02-17T11:45:44.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705680 got 38654705679 for osd.2 2026-02-17T11:45:44.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640271 got 47244640270 for osd.0 2026-02-17T11:45:44.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607566 got 51539607565 for osd.1 2026-02-17T11:45:45.613 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:45.614 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:45.617 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:45.617 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:45.776 INFO:teuthology.orchestra.run.trial078.stdout:38654705679 2026-02-17T11:45:45.778 INFO:teuthology.orchestra.run.trial078.stdout:42949672973 2026-02-17T11:45:45.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705680 got 38654705679 for osd.2 2026-02-17T11:45:45.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672974 got 42949672973 for osd.3 2026-02-17T11:45:45.818 INFO:teuthology.orchestra.run.trial078.stdout:47244640270 2026-02-17T11:45:45.821 INFO:teuthology.orchestra.run.trial078.stdout:51539607565 2026-02-17T11:45:45.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640271 got 47244640270 for osd.0 2026-02-17T11:45:45.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607566 got 51539607565 for osd.1 2026-02-17T11:45:46.787 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:46.790 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:46.829 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:46.831 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:46.952 INFO:teuthology.orchestra.run.trial078.stdout:38654705680 2026-02-17T11:45:46.954 INFO:teuthology.orchestra.run.trial078.stdout:42949672974 2026-02-17T11:45:46.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705680 got 38654705680 for osd.2 2026-02-17T11:45:46.962 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:46.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672974 got 42949672974 for osd.3 2026-02-17T11:45:46.965 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:46.996 INFO:teuthology.orchestra.run.trial078.stdout:51539607567 2026-02-17T11:45:47.003 INFO:teuthology.orchestra.run.trial078.stdout:47244640271 2026-02-17T11:45:47.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607566 got 51539607567 for osd.1 2026-02-17T11:45:47.006 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:47.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640271 got 47244640271 for osd.0 2026-02-17T11:45:47.014 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:47.014 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:45:47.208 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:47.209 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:45:47.217 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2026-02-17T11:45:46.181883+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":108540,"kb_used_data":672,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378820,"statfs":{"total":386547056640,"available":386435911680,"internally_reserved":0,"allocated":688128,"data_stored":187476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":20,"state":"creating+activating","last_fresh":"2026-02-17T11:45:32.496585+0000","last_change":"2026-02-17T11:45:32.496653+0000","last_active":"2026-02-17T11:45:31.491502+0000","last_peered":"2026-02-17T11:45:31.491502+0000","last_clean":"2026-02-17T11:45:31.491502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:45:32.496585+0000","last_undegraded":"2026-02-17T11:45:32.496585+0000","last_fullsized":"2026-02-17T11:45:32.496585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:31.491502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:31.491502+0000","last_clean_scrub_stamp":"2026-02-17T11:45:31.491502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T11:45:33.342769+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:45:33.342769+0000","last_peered":"2026-02-17T11:45:33.342769+0000","last_clean":"2026-02-17T11:45:33.342769+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:45:33.342769+0000","last_undegraded":"2026-02-17T11:45:33.342769+0000","last_fullsized":"2026-02-17T11:45:33.342769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607567,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":172032,"data_stored":46869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":172032,"data_stored":46869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672974,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":172032,"data_stored":46869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705680,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27132,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":172032,"data_stored":46869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:45:47.218 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2026-02-17T11:45:47.219 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2026-02-17T11:45:47.506 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_1' removed 2026-02-17T11:45:47.517 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_2 2026-02-17T11:45:47.517 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_2 1 2026-02-17T11:45:48.510 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_2' created 2026-02-17T11:45:48.521 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2026-02-17T11:45:49.511 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_2' 2026-02-17T11:45:50.521 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:45:50.678 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:50.678 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":23,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:45:49.509703+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"unique_pool_2","create_time":"2026-02-17T11:45:47.677904+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:45:50.687 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:45:50.687 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:45:50.687 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:45:50.687 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:45:50.773 INFO:teuthology.orchestra.run.trial078.stdout:47244640273 2026-02-17T11:45:50.774 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:50.775 INFO:teuthology.orchestra.run.trial078.stdout:42949672976 2026-02-17T11:45:50.775 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:50.776 INFO:teuthology.orchestra.run.trial078.stdout:51539607569 2026-02-17T11:45:50.776 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:50.777 INFO:teuthology.orchestra.run.trial078.stdout:38654705682 2026-02-17T11:45:50.778 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:50.974 INFO:teuthology.orchestra.run.trial078.stdout:38654705681 2026-02-17T11:45:50.977 INFO:teuthology.orchestra.run.trial078.stdout:51539607567 2026-02-17T11:45:50.978 INFO:teuthology.orchestra.run.trial078.stdout:47244640272 2026-02-17T11:45:50.981 INFO:teuthology.orchestra.run.trial078.stdout:42949672975 2026-02-17T11:45:50.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705682 got 38654705681 for osd.2 2026-02-17T11:45:50.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607569 got 51539607567 for osd.1 2026-02-17T11:45:50.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640273 got 47244640272 for osd.0 2026-02-17T11:45:50.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672975 for osd.3 2026-02-17T11:45:51.985 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:51.988 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:51.989 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:51.991 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:52.148 INFO:teuthology.orchestra.run.trial078.stdout:38654705681 2026-02-17T11:45:52.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705682 got 38654705681 for osd.2 2026-02-17T11:45:52.190 INFO:teuthology.orchestra.run.trial078.stdout:51539607567 2026-02-17T11:45:52.193 INFO:teuthology.orchestra.run.trial078.stdout:42949672975 2026-02-17T11:45:52.195 INFO:teuthology.orchestra.run.trial078.stdout:47244640272 2026-02-17T11:45:52.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607569 got 51539607567 for osd.1 2026-02-17T11:45:52.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672975 for osd.3 2026-02-17T11:45:52.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640273 got 47244640272 for osd.0 2026-02-17T11:45:53.159 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:45:53.202 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:45:53.204 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:45:53.206 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:45:53.361 INFO:teuthology.orchestra.run.trial078.stdout:42949672976 2026-02-17T11:45:53.369 INFO:teuthology.orchestra.run.trial078.stdout:51539607569 2026-02-17T11:45:53.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672976 got 42949672976 for osd.3 2026-02-17T11:45:53.371 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:53.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607569 got 51539607569 for osd.1 2026-02-17T11:45:53.380 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:53.405 INFO:teuthology.orchestra.run.trial078.stdout:47244640273 2026-02-17T11:45:53.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640273 got 47244640273 for osd.0 2026-02-17T11:45:53.415 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:56.318 INFO:teuthology.orchestra.run.trial078.stdout:38654705683 2026-02-17T11:45:56.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705682 got 38654705683 for osd.2 2026-02-17T11:45:56.327 DEBUG:teuthology.parallel:result is None 2026-02-17T11:45:56.327 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:45:56.483 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:45:56.483 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:45:56.490 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2026-02-17T11:45:56.183203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":108644,"kb_used_data":784,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378716,"statfs":{"total":386547056640,"available":386435805184,"internally_reserved":0,"allocated":802816,"data_stored":226316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:45:48.508091+0000","last_change":"2026-02-17T11:45:48.508091+0000","last_active":"2026-02-17T11:45:48.508091+0000","last_peered":"2026-02-17T11:45:48.508091+0000","last_clean":"2026-02-17T11:45:48.508091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:45:48.508091+0000","last_undegraded":"2026-02-17T11:45:48.508091+0000","last_fullsized":"2026-02-17T11:45:48.508091+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:48.508091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:48.508091+0000","last_clean_scrub_stamp":"2026-02-17T11:45:48.508091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T11:45:49.511158+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:45:49.511158+0000","last_peered":"2026-02-17T11:45:49.511158+0000","last_clean":"2026-02-17T11:45:49.511158+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:45:49.511158+0000","last_undegraded":"2026-02-17T11:45:49.511158+0000","last_fullsized":"2026-02-17T11:45:49.511158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607570,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":200704,"data_stored":56579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640274,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":200704,"data_stored":56579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27160,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":200704,"data_stored":56579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27164,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":200704,"data_stored":56579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:46:02.492 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:46:02.493 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:46:02.493 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:46:02.494 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:46:02.581 INFO:teuthology.orchestra.run.trial078.stdout:51539607572 2026-02-17T11:46:02.581 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:46:02.583 INFO:teuthology.orchestra.run.trial078.stdout:38654705686 2026-02-17T11:46:02.583 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:02.584 INFO:teuthology.orchestra.run.trial078.stdout:47244640276 2026-02-17T11:46:02.585 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:02.586 INFO:teuthology.orchestra.run.trial078.stdout:42949672980 2026-02-17T11:46:02.586 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:02.783 INFO:teuthology.orchestra.run.trial078.stdout:38654705685 2026-02-17T11:46:02.784 INFO:teuthology.orchestra.run.trial078.stdout:51539607571 2026-02-17T11:46:02.789 INFO:teuthology.orchestra.run.trial078.stdout:42949672978 2026-02-17T11:46:02.789 INFO:teuthology.orchestra.run.trial078.stdout:47244640275 2026-02-17T11:46:02.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705686 got 38654705685 for osd.2 2026-02-17T11:46:02.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607572 got 51539607571 for osd.1 2026-02-17T11:46:02.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672980 got 42949672978 for osd.3 2026-02-17T11:46:02.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640276 got 47244640275 for osd.0 2026-02-17T11:46:03.794 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:03.795 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:46:03.801 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:03.801 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:03.956 INFO:teuthology.orchestra.run.trial078.stdout:51539607571 2026-02-17T11:46:03.959 INFO:teuthology.orchestra.run.trial078.stdout:38654705685 2026-02-17T11:46:03.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607572 got 51539607571 for osd.1 2026-02-17T11:46:03.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705686 got 38654705685 for osd.2 2026-02-17T11:46:03.997 INFO:teuthology.orchestra.run.trial078.stdout:42949672978 2026-02-17T11:46:04.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672980 got 42949672978 for osd.3 2026-02-17T11:46:04.967 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:46:04.969 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:05.008 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:05.130 INFO:teuthology.orchestra.run.trial078.stdout:38654705686 2026-02-17T11:46:05.131 INFO:teuthology.orchestra.run.trial078.stdout:51539607572 2026-02-17T11:46:05.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705686 got 38654705686 for osd.2 2026-02-17T11:46:05.140 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:05.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607572 got 51539607572 for osd.1 2026-02-17T11:46:05.142 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:05.169 INFO:teuthology.orchestra.run.trial078.stdout:42949672980 2026-02-17T11:46:05.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672980 got 42949672980 for osd.3 2026-02-17T11:46:05.179 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:09.998 INFO:teuthology.orchestra.run.trial078.stdout:47244640277 2026-02-17T11:46:10.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640276 got 47244640277 for osd.0 2026-02-17T11:46:10.008 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:10.009 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:46:10.168 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:46:10.169 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:46:10.176 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2026-02-17T11:46:08.184430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":108644,"kb_used_data":784,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378716,"statfs":{"total":386547056640,"available":386435805184,"internally_reserved":0,"allocated":802816,"data_stored":226316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:45:48.508091+0000","last_change":"2026-02-17T11:45:48.508091+0000","last_active":"2026-02-17T11:45:48.508091+0000","last_peered":"2026-02-17T11:45:48.508091+0000","last_clean":"2026-02-17T11:45:48.508091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:45:48.508091+0000","last_undegraded":"2026-02-17T11:45:48.508091+0000","last_fullsized":"2026-02-17T11:45:48.508091+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:48.508091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:48.508091+0000","last_clean_scrub_stamp":"2026-02-17T11:45:48.508091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-17T11:45:49.511158+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:45:49.511158+0000","last_peered":"2026-02-17T11:45:49.511158+0000","last_clean":"2026-02-17T11:45:49.511158+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:45:49.511158+0000","last_undegraded":"2026-02-17T11:45:49.511158+0000","last_fullsized":"2026-02-17T11:45:49.511158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607573,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":200704,"data_stored":56579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640277,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":200704,"data_stored":56579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27160,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":200704,"data_stored":56579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705687,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27164,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":200704,"data_stored":56579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:46:10.177 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_2 2026-02-17T11:46:10.177 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2026-02-17T11:46:11.052 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_2' removed 2026-02-17T11:46:11.063 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_3 2026-02-17T11:46:11.063 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_3 1 2026-02-17T11:46:12.055 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_3' created 2026-02-17T11:46:12.066 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2026-02-17T11:46:16.057 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_3' 2026-02-17T11:46:17.071 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:46:17.229 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:46:17.230 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":27,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:46:16.055948+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"unique_pool_3","create_time":"2026-02-17T11:46:11.223139+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:46:17.238 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:46:17.239 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:46:17.239 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:46:17.239 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:46:17.328 INFO:teuthology.orchestra.run.trial078.stdout:47244640280 2026-02-17T11:46:17.328 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:17.330 INFO:teuthology.orchestra.run.trial078.stdout:42949672983 2026-02-17T11:46:17.331 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:17.332 INFO:teuthology.orchestra.run.trial078.stdout:51539607576 2026-02-17T11:46:17.333 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:46:17.335 INFO:teuthology.orchestra.run.trial078.stdout:38654705690 2026-02-17T11:46:17.335 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:17.527 INFO:teuthology.orchestra.run.trial078.stdout:47244640279 2026-02-17T11:46:17.530 INFO:teuthology.orchestra.run.trial078.stdout:51539607575 2026-02-17T11:46:17.532 INFO:teuthology.orchestra.run.trial078.stdout:38654705688 2026-02-17T11:46:17.534 INFO:teuthology.orchestra.run.trial078.stdout:42949672982 2026-02-17T11:46:17.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640280 got 47244640279 for osd.0 2026-02-17T11:46:17.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607576 got 51539607575 for osd.1 2026-02-17T11:46:17.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705690 got 38654705688 for osd.2 2026-02-17T11:46:17.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672983 got 42949672982 for osd.3 2026-02-17T11:46:18.538 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:18.542 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:46:18.542 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:18.545 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:18.702 INFO:teuthology.orchestra.run.trial078.stdout:47244640279 2026-02-17T11:46:18.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640280 got 47244640279 for osd.0 2026-02-17T11:46:18.743 INFO:teuthology.orchestra.run.trial078.stdout:38654705688 2026-02-17T11:46:18.746 INFO:teuthology.orchestra.run.trial078.stdout:42949672982 2026-02-17T11:46:18.749 INFO:teuthology.orchestra.run.trial078.stdout:51539607575 2026-02-17T11:46:18.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705690 got 38654705688 for osd.2 2026-02-17T11:46:18.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672983 got 42949672982 for osd.3 2026-02-17T11:46:18.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607576 got 51539607575 for osd.1 2026-02-17T11:46:19.713 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:19.754 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:19.757 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:19.760 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:46:19.874 INFO:teuthology.orchestra.run.trial078.stdout:47244640280 2026-02-17T11:46:19.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640280 got 47244640280 for osd.0 2026-02-17T11:46:19.884 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:19.918 INFO:teuthology.orchestra.run.trial078.stdout:38654705690 2026-02-17T11:46:19.919 INFO:teuthology.orchestra.run.trial078.stdout:42949672984 2026-02-17T11:46:19.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705690 got 38654705690 for osd.2 2026-02-17T11:46:19.928 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:19.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672983 got 42949672984 for osd.3 2026-02-17T11:46:19.929 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:19.958 INFO:teuthology.orchestra.run.trial078.stdout:51539607576 2026-02-17T11:46:19.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607576 got 51539607576 for osd.1 2026-02-17T11:46:19.968 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:19.968 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:46:20.165 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:46:20.165 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:46:20.174 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2026-02-17T11:46:18.185451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":108784,"kb_used_data":928,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378576,"statfs":{"total":386547056640,"available":386435661824,"internally_reserved":0,"allocated":950272,"data_stored":277140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.0","version":"0'0","reported_seq":5,"reported_epoch":27,"state":"creating+activating","last_fresh":"2026-02-17T11:46:16.571521+0000","last_change":"2026-02-17T11:46:13.059506+0000","last_active":"2026-02-17T11:46:12.051546+0000","last_peered":"2026-02-17T11:46:12.051546+0000","last_clean":"2026-02-17T11:46:12.051546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:46:16.571521+0000","last_undegraded":"2026-02-17T11:46:16.571521+0000","last_fullsized":"2026-02-17T11:46:16.571521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:46:12.051546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:46:12.051546+0000","last_clean_scrub_stamp":"2026-02-17T11:46:12.051546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-17T11:46:16.639749+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:46:16.639749+0000","last_peered":"2026-02-17T11:46:16.639749+0000","last_clean":"2026-02-17T11:46:16.639749+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:46:16.639749+0000","last_undegraded":"2026-02-17T11:46:16.639749+0000","last_fullsized":"2026-02-17T11:46:16.639749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607576,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":237568,"data_stored":69285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640280,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":237568,"data_stored":69285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":237568,"data_stored":69285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705690,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27196,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":237568,"data_stored":69285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:46:26.175 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:46:26.176 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:46:26.177 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:46:26.177 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:46:26.263 INFO:teuthology.orchestra.run.trial078.stdout:38654705692 2026-02-17T11:46:26.264 INFO:teuthology.orchestra.run.trial078.stdout:42949672986 2026-02-17T11:46:26.265 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:26.266 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:26.267 INFO:teuthology.orchestra.run.trial078.stdout:47244640283 2026-02-17T11:46:26.267 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:26.467 INFO:teuthology.orchestra.run.trial078.stdout:38654705691 2026-02-17T11:46:26.468 INFO:teuthology.orchestra.run.trial078.stdout:47244640282 2026-02-17T11:46:26.471 INFO:teuthology.orchestra.run.trial078.stdout:42949672985 2026-02-17T11:46:26.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.2 2026-02-17T11:46:26.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640283 got 47244640282 for osd.0 2026-02-17T11:46:26.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672986 got 42949672985 for osd.3 2026-02-17T11:46:27.479 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:27.480 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:27.481 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:27.639 INFO:teuthology.orchestra.run.trial078.stdout:47244640282 2026-02-17T11:46:27.645 INFO:teuthology.orchestra.run.trial078.stdout:38654705691 2026-02-17T11:46:27.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640283 got 47244640282 for osd.0 2026-02-17T11:46:27.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.2 2026-02-17T11:46:27.683 INFO:teuthology.orchestra.run.trial078.stdout:42949672985 2026-02-17T11:46:27.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672986 got 42949672985 for osd.3 2026-02-17T11:46:28.649 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:28.656 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:28.693 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:28.807 INFO:teuthology.orchestra.run.trial078.stdout:47244640283 2026-02-17T11:46:28.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640283 got 47244640283 for osd.0 2026-02-17T11:46:28.817 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:28.852 INFO:teuthology.orchestra.run.trial078.stdout:42949672987 2026-02-17T11:46:28.854 INFO:teuthology.orchestra.run.trial078.stdout:38654705693 2026-02-17T11:46:28.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672986 got 42949672987 for osd.3 2026-02-17T11:46:28.861 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:28.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705693 for osd.2 2026-02-17T11:46:28.864 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:29.264 INFO:teuthology.orchestra.run.trial078.stdout:51539607579 2026-02-17T11:46:29.264 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:46:29.419 INFO:teuthology.orchestra.run.trial078.stdout:51539607578 2026-02-17T11:46:29.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607579 got 51539607578 for osd.1 2026-02-17T11:46:30.429 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:46:30.589 INFO:teuthology.orchestra.run.trial078.stdout:51539607579 2026-02-17T11:46:30.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607579 got 51539607579 for osd.1 2026-02-17T11:46:30.597 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:30.597 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:46:30.752 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:46:30.752 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:46:30.760 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2026-02-17T11:46:30.186652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":108784,"kb_used_data":928,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378576,"statfs":{"total":386547056640,"available":386435661824,"internally_reserved":0,"allocated":950272,"data_stored":277140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.0","version":"0'0","reported_seq":5,"reported_epoch":27,"state":"creating+activating","last_fresh":"2026-02-17T11:46:16.571521+0000","last_change":"2026-02-17T11:46:13.059506+0000","last_active":"2026-02-17T11:46:12.051546+0000","last_peered":"2026-02-17T11:46:12.051546+0000","last_clean":"2026-02-17T11:46:12.051546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:46:16.571521+0000","last_undegraded":"2026-02-17T11:46:16.571521+0000","last_fullsized":"2026-02-17T11:46:16.571521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:46:12.051546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:46:12.051546+0000","last_clean_scrub_stamp":"2026-02-17T11:46:12.051546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-17T11:46:16.639749+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:46:16.639749+0000","last_peered":"2026-02-17T11:46:16.639749+0000","last_clean":"2026-02-17T11:46:16.639749+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:46:16.639749+0000","last_undegraded":"2026-02-17T11:46:16.639749+0000","last_fullsized":"2026-02-17T11:46:16.639749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":237568,"data_stored":69285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640284,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":237568,"data_stored":69285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672987,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":237568,"data_stored":69285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27196,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":237568,"data_stored":69285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:46:30.761 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_3 2026-02-17T11:46:30.761 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2026-02-17T11:46:31.245 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_3' removed 2026-02-17T11:46:31.254 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_4 2026-02-17T11:46:31.254 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_4 1 2026-02-17T11:46:32.248 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_4' created 2026-02-17T11:46:32.258 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2026-02-17T11:46:33.251 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_4' 2026-02-17T11:46:34.263 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:46:34.420 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:46:34.420 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":31,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:46:34.250945+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"unique_pool_4","create_time":"2026-02-17T11:46:31.412779+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:46:34.429 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:46:34.429 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:46:34.429 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:46:34.429 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:46:34.516 INFO:teuthology.orchestra.run.trial078.stdout:38654705695 2026-02-17T11:46:34.516 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:34.516 INFO:teuthology.orchestra.run.trial078.stdout:51539607581 2026-02-17T11:46:34.516 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:46:34.717 INFO:teuthology.orchestra.run.trial078.stdout:51539607580 2026-02-17T11:46:34.717 INFO:teuthology.orchestra.run.trial078.stdout:38654705694 2026-02-17T11:46:34.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607581 got 51539607580 for osd.1 2026-02-17T11:46:34.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.2 2026-02-17T11:46:35.727 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:46:35.728 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:35.886 INFO:teuthology.orchestra.run.trial078.stdout:38654705694 2026-02-17T11:46:35.887 INFO:teuthology.orchestra.run.trial078.stdout:51539607580 2026-02-17T11:46:35.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.2 2026-02-17T11:46:35.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607581 got 51539607580 for osd.1 2026-02-17T11:46:36.896 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:36.896 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:46:37.055 INFO:teuthology.orchestra.run.trial078.stdout:51539607582 2026-02-17T11:46:37.058 INFO:teuthology.orchestra.run.trial078.stdout:38654705695 2026-02-17T11:46:37.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607581 got 51539607582 for osd.1 2026-02-17T11:46:37.063 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:37.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705695 for osd.2 2026-02-17T11:46:37.067 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:37.517 INFO:teuthology.orchestra.run.trial078.stdout:42949672990 2026-02-17T11:46:37.518 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:37.519 INFO:teuthology.orchestra.run.trial078.stdout:47244640286 2026-02-17T11:46:37.520 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:37.716 INFO:teuthology.orchestra.run.trial078.stdout:47244640285 2026-02-17T11:46:37.720 INFO:teuthology.orchestra.run.trial078.stdout:42949672988 2026-02-17T11:46:37.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640286 got 47244640285 for osd.0 2026-02-17T11:46:37.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672990 got 42949672988 for osd.3 2026-02-17T11:46:38.725 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:38.730 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:38.887 INFO:teuthology.orchestra.run.trial078.stdout:42949672990 2026-02-17T11:46:38.890 INFO:teuthology.orchestra.run.trial078.stdout:47244640286 2026-02-17T11:46:38.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672990 got 42949672990 for osd.3 2026-02-17T11:46:38.897 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:38.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640286 got 47244640286 for osd.0 2026-02-17T11:46:38.900 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:38.900 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:46:39.094 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:46:39.094 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:46:39.102 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2026-02-17T11:46:38.187726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":108944,"kb_used_data":1072,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378416,"statfs":{"total":386547056640,"available":386435497984,"internally_reserved":0,"allocated":1097728,"data_stored":328016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"5.0","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2026-02-17T11:46:34.253040+0000","last_change":"2026-02-17T11:46:34.253040+0000","last_active":"2026-02-17T11:46:32.246073+0000","last_peered":"2026-02-17T11:46:32.246073+0000","last_clean":"2026-02-17T11:46:32.246073+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:46:34.253040+0000","last_undegraded":"2026-02-17T11:46:34.253040+0000","last_fullsized":"2026-02-17T11:46:34.253040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:46:32.246073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:46:32.246073+0000","last_clean_scrub_stamp":"2026-02-17T11:46:32.246073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-17T11:46:34.274393+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:46:34.274393+0000","last_peered":"2026-02-17T11:46:34.274393+0000","last_clean":"2026-02-17T11:46:34.274393+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:46:34.274393+0000","last_undegraded":"2026-02-17T11:46:34.274393+0000","last_fullsized":"2026-02-17T11:46:34.274393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607582,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":274432,"data_stored":82004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640286,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":274432,"data_stored":82004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":274432,"data_stored":82004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":274432,"data_stored":82004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:46:45.104 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:46:45.105 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:46:45.105 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:46:45.105 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:46:45.192 INFO:teuthology.orchestra.run.trial078.stdout:42949672992 2026-02-17T11:46:45.193 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:45.193 INFO:teuthology.orchestra.run.trial078.stdout:51539607584 2026-02-17T11:46:45.194 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:46:45.194 INFO:teuthology.orchestra.run.trial078.stdout:47244640289 2026-02-17T11:46:45.194 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:45.195 INFO:teuthology.orchestra.run.trial078.stdout:38654705698 2026-02-17T11:46:45.195 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:45.393 INFO:teuthology.orchestra.run.trial078.stdout:42949672991 2026-02-17T11:46:45.396 INFO:teuthology.orchestra.run.trial078.stdout:47244640288 2026-02-17T11:46:45.398 INFO:teuthology.orchestra.run.trial078.stdout:38654705697 2026-02-17T11:46:45.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672991 for osd.3 2026-02-17T11:46:45.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640289 got 47244640288 for osd.0 2026-02-17T11:46:45.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705697 for osd.2 2026-02-17T11:46:46.404 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:46.407 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:46.408 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:46.565 INFO:teuthology.orchestra.run.trial078.stdout:42949672992 2026-02-17T11:46:46.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672992 for osd.3 2026-02-17T11:46:46.575 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:46.609 INFO:teuthology.orchestra.run.trial078.stdout:38654705698 2026-02-17T11:46:46.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705698 for osd.2 2026-02-17T11:46:46.618 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:49.606 INFO:teuthology.orchestra.run.trial078.stdout:47244640289 2026-02-17T11:46:49.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640289 got 47244640289 for osd.0 2026-02-17T11:46:49.615 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:51.394 INFO:teuthology.orchestra.run.trial078.stdout:51539607585 2026-02-17T11:46:51.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607584 got 51539607585 for osd.1 2026-02-17T11:46:51.402 DEBUG:teuthology.parallel:result is None 2026-02-17T11:46:51.402 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:46:54.563 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:46:54.563 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:46:54.572 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2026-02-17T11:46:54.189795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":108944,"kb_used_data":1072,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378416,"statfs":{"total":386547056640,"available":386435497984,"internally_reserved":0,"allocated":1097728,"data_stored":328016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"5.0","version":"0'0","reported_seq":3,"reported_epoch":31,"state":"creating+activating","last_fresh":"2026-02-17T11:46:34.253040+0000","last_change":"2026-02-17T11:46:34.253040+0000","last_active":"2026-02-17T11:46:32.246073+0000","last_peered":"2026-02-17T11:46:32.246073+0000","last_clean":"2026-02-17T11:46:32.246073+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:46:34.253040+0000","last_undegraded":"2026-02-17T11:46:34.253040+0000","last_fullsized":"2026-02-17T11:46:34.253040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:46:32.246073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:46:32.246073+0000","last_clean_scrub_stamp":"2026-02-17T11:46:32.246073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-17T11:46:34.274393+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:46:34.274393+0000","last_peered":"2026-02-17T11:46:34.274393+0000","last_clean":"2026-02-17T11:46:34.274393+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:46:34.274393+0000","last_undegraded":"2026-02-17T11:46:34.274393+0000","last_fullsized":"2026-02-17T11:46:34.274393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607586,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":274432,"data_stored":82004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640291,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":274432,"data_stored":82004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":274432,"data_stored":82004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705700,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":274432,"data_stored":82004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:46:54.573 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_4 2026-02-17T11:46:54.573 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2026-02-17T11:46:55.272 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_4' removed 2026-02-17T11:46:55.282 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_5 2026-02-17T11:46:55.283 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_5 1 2026-02-17T11:46:56.275 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_5' created 2026-02-17T11:46:56.287 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_5 rados --yes-i-really-mean-it || true 2026-02-17T11:46:57.278 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_5' 2026-02-17T11:46:58.289 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:46:58.448 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:46:58.448 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":34,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:46:57.275088+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"unique_pool_5","create_time":"2026-02-17T11:46:55.441757+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:46:58.458 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:46:58.459 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:46:58.460 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:46:58.461 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:46:58.549 INFO:teuthology.orchestra.run.trial078.stdout:47244640293 2026-02-17T11:46:58.550 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:58.550 INFO:teuthology.orchestra.run.trial078.stdout:42949672996 2026-02-17T11:46:58.550 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:46:58.551 INFO:teuthology.orchestra.run.trial078.stdout:38654705702 2026-02-17T11:46:58.551 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:46:58.747 INFO:teuthology.orchestra.run.trial078.stdout:47244640291 2026-02-17T11:46:58.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640293 got 47244640291 for osd.0 2026-02-17T11:46:59.756 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:46:59.915 INFO:teuthology.orchestra.run.trial078.stdout:47244640291 2026-02-17T11:46:59.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640293 got 47244640291 for osd.0 2026-02-17T11:47:00.924 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:01.082 INFO:teuthology.orchestra.run.trial078.stdout:47244640293 2026-02-17T11:47:01.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640293 got 47244640293 for osd.0 2026-02-17T11:47:01.091 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:01.553 INFO:teuthology.orchestra.run.trial078.stdout:51539607589 2026-02-17T11:47:01.553 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:01.714 INFO:teuthology.orchestra.run.trial078.stdout:51539607587 2026-02-17T11:47:01.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607589 got 51539607587 for osd.1 2026-02-17T11:47:01.750 INFO:teuthology.orchestra.run.trial078.stdout:42949672996 2026-02-17T11:47:01.753 INFO:teuthology.orchestra.run.trial078.stdout:38654705702 2026-02-17T11:47:01.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672996 got 42949672996 for osd.3 2026-02-17T11:47:01.761 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:01.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705702 got 38654705702 for osd.2 2026-02-17T11:47:01.764 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:02.725 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:02.883 INFO:teuthology.orchestra.run.trial078.stdout:51539607589 2026-02-17T11:47:02.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607589 got 51539607589 for osd.1 2026-02-17T11:47:02.893 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:02.893 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:47:03.048 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:47:03.048 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:47:03.056 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2026-02-17T11:47:02.190705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":109028,"kb_used_data":1160,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378332,"statfs":{"total":386547056640,"available":386435411968,"internally_reserved":0,"allocated":1187840,"data_stored":356814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:46:56.272329+0000","last_change":"2026-02-17T11:46:56.272329+0000","last_active":"2026-02-17T11:46:56.272329+0000","last_peered":"2026-02-17T11:46:56.272329+0000","last_clean":"2026-02-17T11:46:56.272329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:46:56.272329+0000","last_undegraded":"2026-02-17T11:46:56.272329+0000","last_fullsized":"2026-02-17T11:46:56.272329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:46:56.272329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:46:56.272329+0000","last_clean_scrub_stamp":"2026-02-17T11:46:56.272329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:46:57.278688+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:46:57.278688+0000","last_peered":"2026-02-17T11:46:57.278688+0000","last_clean":"2026-02-17T11:46:57.278688+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:46:57.278688+0000","last_undegraded":"2026-02-17T11:46:57.278688+0000","last_fullsized":"2026-02-17T11:46:57.278688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607589,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":303104,"data_stored":91714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640293,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":294912,"data_stored":88373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672996,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":286720,"data_stored":85013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705703,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":303104,"data_stored":91714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:47:09.058 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:47:09.059 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:47:09.060 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:47:09.060 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:47:09.147 INFO:teuthology.orchestra.run.trial078.stdout:47244640296 2026-02-17T11:47:09.148 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:09.150 INFO:teuthology.orchestra.run.trial078.stdout:51539607591 2026-02-17T11:47:09.150 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:09.151 INFO:teuthology.orchestra.run.trial078.stdout:38654705705 2026-02-17T11:47:09.152 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:09.349 INFO:teuthology.orchestra.run.trial078.stdout:47244640294 2026-02-17T11:47:09.351 INFO:teuthology.orchestra.run.trial078.stdout:38654705704 2026-02-17T11:47:09.353 INFO:teuthology.orchestra.run.trial078.stdout:51539607590 2026-02-17T11:47:09.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640296 got 47244640294 for osd.0 2026-02-17T11:47:09.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705705 got 38654705704 for osd.2 2026-02-17T11:47:09.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607591 got 51539607590 for osd.1 2026-02-17T11:47:10.360 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:10.362 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:10.364 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:10.523 INFO:teuthology.orchestra.run.trial078.stdout:51539607591 2026-02-17T11:47:10.525 INFO:teuthology.orchestra.run.trial078.stdout:47244640296 2026-02-17T11:47:10.527 INFO:teuthology.orchestra.run.trial078.stdout:38654705705 2026-02-17T11:47:10.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607591 got 51539607591 for osd.1 2026-02-17T11:47:10.533 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:10.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640296 got 47244640296 for osd.0 2026-02-17T11:47:10.535 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:10.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705705 got 38654705705 for osd.2 2026-02-17T11:47:10.537 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:12.152 INFO:teuthology.orchestra.run.trial078.stdout:42949672999 2026-02-17T11:47:12.152 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:12.311 INFO:teuthology.orchestra.run.trial078.stdout:42949672999 2026-02-17T11:47:12.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672999 got 42949672999 for osd.3 2026-02-17T11:47:12.320 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:12.320 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:47:12.478 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:47:12.479 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:47:12.487 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2026-02-17T11:47:12.191830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":109048,"kb_used_data":1184,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378312,"statfs":{"total":386547056640,"available":386435391488,"internally_reserved":0,"allocated":1212416,"data_stored":366856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:46:56.272329+0000","last_change":"2026-02-17T11:46:56.272329+0000","last_active":"2026-02-17T11:46:56.272329+0000","last_peered":"2026-02-17T11:46:56.272329+0000","last_clean":"2026-02-17T11:46:56.272329+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:46:56.272329+0000","last_undegraded":"2026-02-17T11:46:56.272329+0000","last_fullsized":"2026-02-17T11:46:56.272329+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:46:56.272329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:46:56.272329+0000","last_clean_scrub_stamp":"2026-02-17T11:46:56.272329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T11:46:57.278688+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:46:57.278688+0000","last_peered":"2026-02-17T11:46:57.278688+0000","last_clean":"2026-02-17T11:46:57.278688+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:46:57.278688+0000","last_undegraded":"2026-02-17T11:46:57.278688+0000","last_fullsized":"2026-02-17T11:46:57.278688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607592,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":303104,"data_stored":91714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640296,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":303104,"data_stored":91714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949672999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27260,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":303104,"data_stored":91714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705706,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":303104,"data_stored":91714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:47:12.488 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_5 2026-02-17T11:47:12.488 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_5 unique_pool_5 --yes-i-really-really-mean-it 2026-02-17T11:47:13.292 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_5' removed 2026-02-17T11:47:13.305 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_6 2026-02-17T11:47:13.305 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_6 1 2026-02-17T11:47:14.296 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_6' created 2026-02-17T11:47:14.306 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_6 rados --yes-i-really-mean-it || true 2026-02-17T11:47:15.298 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_6' 2026-02-17T11:47:16.310 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:47:16.465 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:47:16.466 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":37,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:47:15.296096+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"unique_pool_6","create_time":"2026-02-17T11:47:13.467012+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:47:16.474 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:47:16.474 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:47:16.474 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:47:16.474 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:47:16.559 INFO:teuthology.orchestra.run.trial078.stdout:38654705708 2026-02-17T11:47:16.559 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:16.560 INFO:teuthology.orchestra.run.trial078.stdout:51539607594 2026-02-17T11:47:16.560 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:16.560 INFO:teuthology.orchestra.run.trial078.stdout:42949673001 2026-02-17T11:47:16.560 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:16.561 INFO:teuthology.orchestra.run.trial078.stdout:47244640298 2026-02-17T11:47:16.562 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:16.722 INFO:teuthology.orchestra.run.trial078.stdout:38654705706 2026-02-17T11:47:16.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705708 got 38654705706 for osd.2 2026-02-17T11:47:16.764 INFO:teuthology.orchestra.run.trial078.stdout:51539607593 2026-02-17T11:47:16.766 INFO:teuthology.orchestra.run.trial078.stdout:42949673000 2026-02-17T11:47:16.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607594 got 51539607593 for osd.1 2026-02-17T11:47:16.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673001 got 42949673000 for osd.3 2026-02-17T11:47:16.803 INFO:teuthology.orchestra.run.trial078.stdout:47244640297 2026-02-17T11:47:16.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640298 got 47244640297 for osd.0 2026-02-17T11:47:17.733 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:17.774 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:17.777 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:17.812 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:17.889 INFO:teuthology.orchestra.run.trial078.stdout:38654705706 2026-02-17T11:47:17.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705708 got 38654705706 for osd.2 2026-02-17T11:47:17.935 INFO:teuthology.orchestra.run.trial078.stdout:42949673000 2026-02-17T11:47:17.936 INFO:teuthology.orchestra.run.trial078.stdout:51539607593 2026-02-17T11:47:17.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673001 got 42949673000 for osd.3 2026-02-17T11:47:17.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607594 got 51539607593 for osd.1 2026-02-17T11:47:17.974 INFO:teuthology.orchestra.run.trial078.stdout:47244640297 2026-02-17T11:47:17.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640298 got 47244640297 for osd.0 2026-02-17T11:47:18.902 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:18.947 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:18.947 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:18.984 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:19.063 INFO:teuthology.orchestra.run.trial078.stdout:38654705708 2026-02-17T11:47:19.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705708 got 38654705708 for osd.2 2026-02-17T11:47:19.075 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:19.109 INFO:teuthology.orchestra.run.trial078.stdout:42949673002 2026-02-17T11:47:19.109 INFO:teuthology.orchestra.run.trial078.stdout:51539607594 2026-02-17T11:47:19.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673001 got 42949673002 for osd.3 2026-02-17T11:47:19.119 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:19.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607594 got 51539607594 for osd.1 2026-02-17T11:47:19.120 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:19.147 INFO:teuthology.orchestra.run.trial078.stdout:47244640298 2026-02-17T11:47:19.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640298 got 47244640298 for osd.0 2026-02-17T11:47:19.157 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:19.157 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:47:19.348 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:47:19.349 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:47:19.356 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2026-02-17T11:47:18.192587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":109124,"kb_used_data":1264,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378236,"statfs":{"total":386547056640,"available":386435313664,"internally_reserved":0,"allocated":1294336,"data_stored":392313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:47:14.294289+0000","last_change":"2026-02-17T11:47:14.294289+0000","last_active":"2026-02-17T11:47:14.294289+0000","last_peered":"2026-02-17T11:47:14.294289+0000","last_clean":"2026-02-17T11:47:14.294289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:47:14.294289+0000","last_undegraded":"2026-02-17T11:47:14.294289+0000","last_fullsized":"2026-02-17T11:47:14.294289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:47:14.294289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:47:14.294289+0000","last_clean_scrub_stamp":"2026-02-17T11:47:14.294289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-17T11:47:15.298615+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:47:15.298615+0000","last_peered":"2026-02-17T11:47:15.298615+0000","last_clean":"2026-02-17T11:47:15.298615+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:47:15.298615+0000","last_undegraded":"2026-02-17T11:47:15.298615+0000","last_fullsized":"2026-02-17T11:47:15.298615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607594,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":331776,"data_stored":101424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640298,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":315392,"data_stored":94723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27280,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":323584,"data_stored":98083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27280,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":323584,"data_stored":98083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:47:25.359 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:47:25.359 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:47:25.360 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:47:25.360 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:47:25.448 INFO:teuthology.orchestra.run.trial078.stdout:51539607597 2026-02-17T11:47:25.448 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:25.450 INFO:teuthology.orchestra.run.trial078.stdout:47244640301 2026-02-17T11:47:25.450 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:25.451 INFO:teuthology.orchestra.run.trial078.stdout:38654705710 2026-02-17T11:47:25.451 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:25.452 INFO:teuthology.orchestra.run.trial078.stdout:42949673004 2026-02-17T11:47:25.453 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:25.647 INFO:teuthology.orchestra.run.trial078.stdout:51539607595 2026-02-17T11:47:25.652 INFO:teuthology.orchestra.run.trial078.stdout:38654705709 2026-02-17T11:47:25.653 INFO:teuthology.orchestra.run.trial078.stdout:42949673003 2026-02-17T11:47:25.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607597 got 51539607595 for osd.1 2026-02-17T11:47:25.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705710 got 38654705709 for osd.2 2026-02-17T11:47:25.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673004 got 42949673003 for osd.3 2026-02-17T11:47:26.657 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:26.663 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:26.664 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:26.857 INFO:teuthology.orchestra.run.trial078.stdout:38654705710 2026-02-17T11:47:26.860 INFO:teuthology.orchestra.run.trial078.stdout:42949673004 2026-02-17T11:47:26.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705710 got 38654705710 for osd.2 2026-02-17T11:47:26.866 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:26.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673004 got 42949673004 for osd.3 2026-02-17T11:47:26.870 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:28.653 INFO:teuthology.orchestra.run.trial078.stdout:47244640301 2026-02-17T11:47:28.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640301 got 47244640301 for osd.0 2026-02-17T11:47:28.662 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:29.815 INFO:teuthology.orchestra.run.trial078.stdout:51539607597 2026-02-17T11:47:29.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607597 got 51539607597 for osd.1 2026-02-17T11:47:29.824 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:29.824 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:47:29.976 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:47:29.976 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:47:29.984 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2026-02-17T11:47:28.193832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":109160,"kb_used_data":1296,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378200,"statfs":{"total":386547056640,"available":386435276800,"internally_reserved":0,"allocated":1327104,"data_stored":405696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:47:14.294289+0000","last_change":"2026-02-17T11:47:14.294289+0000","last_active":"2026-02-17T11:47:14.294289+0000","last_peered":"2026-02-17T11:47:14.294289+0000","last_clean":"2026-02-17T11:47:14.294289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:47:14.294289+0000","last_undegraded":"2026-02-17T11:47:14.294289+0000","last_fullsized":"2026-02-17T11:47:14.294289+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:47:14.294289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:47:14.294289+0000","last_clean_scrub_stamp":"2026-02-17T11:47:14.294289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-17T11:47:15.298615+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:47:15.298615+0000","last_peered":"2026-02-17T11:47:15.298615+0000","last_clean":"2026-02-17T11:47:15.298615+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:47:15.298615+0000","last_undegraded":"2026-02-17T11:47:15.298615+0000","last_fullsized":"2026-02-17T11:47:15.298615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607597,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":331776,"data_stored":101424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640301,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":331776,"data_stored":101424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":101424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705711,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27288,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":331776,"data_stored":101424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:47:29.984 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_6 2026-02-17T11:47:29.984 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_6 unique_pool_6 --yes-i-really-really-mean-it 2026-02-17T11:47:30.364 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_6' removed 2026-02-17T11:47:30.376 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_7 2026-02-17T11:47:30.377 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_7 1 2026-02-17T11:47:31.367 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_7' created 2026-02-17T11:47:31.378 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_7 rados --yes-i-really-mean-it || true 2026-02-17T11:47:32.370 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_7' 2026-02-17T11:47:33.382 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:47:33.542 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:47:33.543 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":40,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:47:32.367659+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"unique_pool_7","create_time":"2026-02-17T11:47:30.539344+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:47:33.552 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:47:33.552 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:47:33.553 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:47:33.553 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:47:33.640 INFO:teuthology.orchestra.run.trial078.stdout:51539607599 2026-02-17T11:47:33.640 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:33.641 INFO:teuthology.orchestra.run.trial078.stdout:42949673007 2026-02-17T11:47:33.642 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:33.643 INFO:teuthology.orchestra.run.trial078.stdout:38654705713 2026-02-17T11:47:33.643 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:33.644 INFO:teuthology.orchestra.run.trial078.stdout:47244640304 2026-02-17T11:47:33.645 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:33.841 INFO:teuthology.orchestra.run.trial078.stdout:38654705712 2026-02-17T11:47:33.844 INFO:teuthology.orchestra.run.trial078.stdout:51539607598 2026-02-17T11:47:33.845 INFO:teuthology.orchestra.run.trial078.stdout:42949673005 2026-02-17T11:47:33.848 INFO:teuthology.orchestra.run.trial078.stdout:47244640302 2026-02-17T11:47:33.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705713 got 38654705712 for osd.2 2026-02-17T11:47:33.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607599 got 51539607598 for osd.1 2026-02-17T11:47:33.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673007 got 42949673005 for osd.3 2026-02-17T11:47:33.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640304 got 47244640302 for osd.0 2026-02-17T11:47:34.852 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:34.856 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:34.856 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:34.859 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:35.016 INFO:teuthology.orchestra.run.trial078.stdout:38654705713 2026-02-17T11:47:35.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705713 got 38654705713 for osd.2 2026-02-17T11:47:35.027 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:35.059 INFO:teuthology.orchestra.run.trial078.stdout:51539607599 2026-02-17T11:47:35.062 INFO:teuthology.orchestra.run.trial078.stdout:42949673007 2026-02-17T11:47:35.066 INFO:teuthology.orchestra.run.trial078.stdout:47244640304 2026-02-17T11:47:35.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607599 got 51539607599 for osd.1 2026-02-17T11:47:35.069 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:35.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673007 got 42949673007 for osd.3 2026-02-17T11:47:35.072 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:35.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640304 got 47244640304 for osd.0 2026-02-17T11:47:35.076 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:35.076 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:47:35.272 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:47:35.273 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:47:35.280 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2026-02-17T11:47:34.194663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":109252,"kb_used_data":1392,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378108,"statfs":{"total":386547056640,"available":386435182592,"internally_reserved":0,"allocated":1425408,"data_stored":437870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"8.0","version":"0'0","reported_seq":3,"reported_epoch":40,"state":"creating+activating","last_fresh":"2026-02-17T11:47:32.371976+0000","last_change":"2026-02-17T11:47:32.371976+0000","last_active":"2026-02-17T11:47:31.364310+0000","last_peered":"2026-02-17T11:47:31.364310+0000","last_clean":"2026-02-17T11:47:31.364310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:47:32.371976+0000","last_undegraded":"2026-02-17T11:47:32.371976+0000","last_fullsized":"2026-02-17T11:47:32.371976+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:47:31.364310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:47:31.364310+0000","last_clean_scrub_stamp":"2026-02-17T11:47:31.364310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-17T11:47:33.175644+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:47:33.175644+0000","last_peered":"2026-02-17T11:47:33.175644+0000","last_clean":"2026-02-17T11:47:33.175644+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:47:33.175644+0000","last_undegraded":"2026-02-17T11:47:33.175644+0000","last_fullsized":"2026-02-17T11:47:33.175644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607599,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":352256,"data_stored":107793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640304,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":352256,"data_stored":107793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673007,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":111142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705713,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":360448,"data_stored":111142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:47:41.283 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:47:41.283 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:47:41.284 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:47:41.284 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:47:41.372 INFO:teuthology.orchestra.run.trial078.stdout:51539607602 2026-02-17T11:47:41.372 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:41.373 INFO:teuthology.orchestra.run.trial078.stdout:47244640306 2026-02-17T11:47:41.373 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:41.374 INFO:teuthology.orchestra.run.trial078.stdout:38654705715 2026-02-17T11:47:41.374 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:41.532 INFO:teuthology.orchestra.run.trial078.stdout:51539607600 2026-02-17T11:47:41.536 INFO:teuthology.orchestra.run.trial078.stdout:47244640305 2026-02-17T11:47:41.536 INFO:teuthology.orchestra.run.trial078.stdout:38654705714 2026-02-17T11:47:41.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607602 got 51539607600 for osd.1 2026-02-17T11:47:41.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640306 got 47244640305 for osd.0 2026-02-17T11:47:41.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705715 got 38654705714 for osd.2 2026-02-17T11:47:42.544 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:42.547 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:42.548 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:42.709 INFO:teuthology.orchestra.run.trial078.stdout:51539607602 2026-02-17T11:47:42.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607602 got 51539607602 for osd.1 2026-02-17T11:47:42.720 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:42.751 INFO:teuthology.orchestra.run.trial078.stdout:47244640306 2026-02-17T11:47:42.752 INFO:teuthology.orchestra.run.trial078.stdout:38654705716 2026-02-17T11:47:42.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640306 got 47244640306 for osd.0 2026-02-17T11:47:42.760 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:42.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705715 got 38654705716 for osd.2 2026-02-17T11:47:42.762 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:44.375 INFO:teuthology.orchestra.run.trial078.stdout:42949673010 2026-02-17T11:47:44.376 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:44.530 INFO:teuthology.orchestra.run.trial078.stdout:42949673009 2026-02-17T11:47:44.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673010 got 42949673009 for osd.3 2026-02-17T11:47:45.540 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:45.695 INFO:teuthology.orchestra.run.trial078.stdout:42949673009 2026-02-17T11:47:45.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673010 got 42949673009 for osd.3 2026-02-17T11:47:46.705 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:46.865 INFO:teuthology.orchestra.run.trial078.stdout:42949673010 2026-02-17T11:47:46.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673010 got 42949673010 for osd.3 2026-02-17T11:47:46.873 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:46.873 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:47:47.029 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:47:47.029 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:47:47.037 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2026-02-17T11:47:46.196183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":109276,"kb_used_data":1408,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377378084,"statfs":{"total":386547056640,"available":386435158016,"internally_reserved":0,"allocated":1441792,"data_stored":444568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"8.0","version":"0'0","reported_seq":3,"reported_epoch":40,"state":"creating+activating","last_fresh":"2026-02-17T11:47:32.371976+0000","last_change":"2026-02-17T11:47:32.371976+0000","last_active":"2026-02-17T11:47:31.364310+0000","last_peered":"2026-02-17T11:47:31.364310+0000","last_clean":"2026-02-17T11:47:31.364310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:47:32.371976+0000","last_undegraded":"2026-02-17T11:47:32.371976+0000","last_fullsized":"2026-02-17T11:47:32.371976+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:47:31.364310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:47:31.364310+0000","last_clean_scrub_stamp":"2026-02-17T11:47:31.364310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-17T11:47:33.175644+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:47:33.175644+0000","last_peered":"2026-02-17T11:47:33.175644+0000","last_clean":"2026-02-17T11:47:33.175644+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:47:33.175644+0000","last_undegraded":"2026-02-17T11:47:33.175644+0000","last_fullsized":"2026-02-17T11:47:33.175644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607603,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":111142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640307,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":111142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673010,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":360448,"data_stored":111142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":360448,"data_stored":111142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:47:47.038 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_7 2026-02-17T11:47:47.038 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_7 unique_pool_7 --yes-i-really-really-mean-it 2026-02-17T11:47:47.386 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_7' removed 2026-02-17T11:47:47.397 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_8 2026-02-17T11:47:47.397 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_8 1 2026-02-17T11:47:48.392 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_8' created 2026-02-17T11:47:48.403 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_8 rados --yes-i-really-mean-it || true 2026-02-17T11:47:49.395 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_8' 2026-02-17T11:47:50.407 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:47:50.563 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:47:50.564 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":43,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:47:49.391742+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"unique_pool_8","create_time":"2026-02-17T11:47:47.555186+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:47:50.572 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:47:50.573 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:47:50.574 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:47:50.574 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:47:50.660 INFO:teuthology.orchestra.run.trial078.stdout:42949673012 2026-02-17T11:47:50.661 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:50.662 INFO:teuthology.orchestra.run.trial078.stdout:47244640309 2026-02-17T11:47:50.662 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:50.663 INFO:teuthology.orchestra.run.trial078.stdout:38654705718 2026-02-17T11:47:50.664 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:50.665 INFO:teuthology.orchestra.run.trial078.stdout:51539607605 2026-02-17T11:47:50.665 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:50.864 INFO:teuthology.orchestra.run.trial078.stdout:51539607603 2026-02-17T11:47:50.865 INFO:teuthology.orchestra.run.trial078.stdout:47244640308 2026-02-17T11:47:50.867 INFO:teuthology.orchestra.run.trial078.stdout:42949673011 2026-02-17T11:47:50.869 INFO:teuthology.orchestra.run.trial078.stdout:38654705717 2026-02-17T11:47:50.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607605 got 51539607603 for osd.1 2026-02-17T11:47:50.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640309 got 47244640308 for osd.0 2026-02-17T11:47:50.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673012 got 42949673011 for osd.3 2026-02-17T11:47:50.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705718 got 38654705717 for osd.2 2026-02-17T11:47:51.875 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:51.876 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:51.880 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:51.880 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:52.036 INFO:teuthology.orchestra.run.trial078.stdout:51539607603 2026-02-17T11:47:52.037 INFO:teuthology.orchestra.run.trial078.stdout:47244640308 2026-02-17T11:47:52.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607605 got 51539607603 for osd.1 2026-02-17T11:47:52.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640309 got 47244640308 for osd.0 2026-02-17T11:47:52.076 INFO:teuthology.orchestra.run.trial078.stdout:42949673011 2026-02-17T11:47:52.082 INFO:teuthology.orchestra.run.trial078.stdout:38654705717 2026-02-17T11:47:52.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673012 got 42949673011 for osd.3 2026-02-17T11:47:52.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705718 got 38654705717 for osd.2 2026-02-17T11:47:53.048 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:53.049 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:53.087 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:53.093 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:53.210 INFO:teuthology.orchestra.run.trial078.stdout:47244640309 2026-02-17T11:47:53.214 INFO:teuthology.orchestra.run.trial078.stdout:51539607605 2026-02-17T11:47:53.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640309 got 47244640309 for osd.0 2026-02-17T11:47:53.220 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:53.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607605 got 51539607605 for osd.1 2026-02-17T11:47:53.224 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:53.252 INFO:teuthology.orchestra.run.trial078.stdout:42949673012 2026-02-17T11:47:53.253 INFO:teuthology.orchestra.run.trial078.stdout:38654705719 2026-02-17T11:47:53.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673012 got 42949673012 for osd.3 2026-02-17T11:47:53.261 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:53.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705718 got 38654705719 for osd.2 2026-02-17T11:47:53.263 DEBUG:teuthology.parallel:result is None 2026-02-17T11:47:53.264 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:47:53.460 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:47:53.461 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:47:53.469 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2026-02-17T11:47:52.196921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":109388,"kb_used_data":1520,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377972,"statfs":{"total":386547056640,"available":386435043328,"internally_reserved":0,"allocated":1556480,"data_stored":483408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:47:48.388921+0000","last_change":"2026-02-17T11:47:48.388921+0000","last_active":"2026-02-17T11:47:48.388921+0000","last_peered":"2026-02-17T11:47:48.388921+0000","last_clean":"2026-02-17T11:47:48.388921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:47:48.388921+0000","last_undegraded":"2026-02-17T11:47:48.388921+0000","last_fullsized":"2026-02-17T11:47:48.388921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:47:48.388921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:47:48.388921+0000","last_clean_scrub_stamp":"2026-02-17T11:47:48.388921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:47:49.976407+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:47:49.976407+0000","last_peered":"2026-02-17T11:47:49.976407+0000","last_clean":"2026-02-17T11:47:49.976407+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:47:49.976407+0000","last_undegraded":"2026-02-17T11:47:49.976407+0000","last_fullsized":"2026-02-17T11:47:49.976407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607605,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":389120,"data_stored":120852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640309,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":389120,"data_stored":120852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673012,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":389120,"data_stored":120852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705719,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":389120,"data_stored":120852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:47:59.471 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:47:59.472 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:47:59.472 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:47:59.473 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:47:59.562 INFO:teuthology.orchestra.run.trial078.stdout:38654705721 2026-02-17T11:47:59.562 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:47:59.563 INFO:teuthology.orchestra.run.trial078.stdout:51539607607 2026-02-17T11:47:59.564 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:47:59.565 INFO:teuthology.orchestra.run.trial078.stdout:47244640312 2026-02-17T11:47:59.565 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:47:59.566 INFO:teuthology.orchestra.run.trial078.stdout:42949673015 2026-02-17T11:47:59.566 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:47:59.765 INFO:teuthology.orchestra.run.trial078.stdout:47244640310 2026-02-17T11:47:59.766 INFO:teuthology.orchestra.run.trial078.stdout:51539607606 2026-02-17T11:47:59.767 INFO:teuthology.orchestra.run.trial078.stdout:38654705720 2026-02-17T11:47:59.769 INFO:teuthology.orchestra.run.trial078.stdout:42949673014 2026-02-17T11:47:59.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640312 got 47244640310 for osd.0 2026-02-17T11:47:59.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607607 got 51539607606 for osd.1 2026-02-17T11:47:59.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705721 got 38654705720 for osd.2 2026-02-17T11:47:59.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673015 got 42949673014 for osd.3 2026-02-17T11:48:00.776 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:00.777 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:00.778 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:00.780 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:00.937 INFO:teuthology.orchestra.run.trial078.stdout:47244640312 2026-02-17T11:48:00.942 INFO:teuthology.orchestra.run.trial078.stdout:51539607607 2026-02-17T11:48:00.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640312 got 47244640312 for osd.0 2026-02-17T11:48:00.949 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:00.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607607 got 51539607607 for osd.1 2026-02-17T11:48:00.952 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:00.979 INFO:teuthology.orchestra.run.trial078.stdout:38654705721 2026-02-17T11:48:00.985 INFO:teuthology.orchestra.run.trial078.stdout:42949673015 2026-02-17T11:48:00.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705721 got 38654705721 for osd.2 2026-02-17T11:48:00.988 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:00.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673015 got 42949673015 for osd.3 2026-02-17T11:48:00.994 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:00.994 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:48:01.193 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:48:01.193 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:48:01.201 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2026-02-17T11:48:00.197649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":109388,"kb_used_data":1520,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377972,"statfs":{"total":386547056640,"available":386435043328,"internally_reserved":0,"allocated":1556480,"data_stored":483408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:47:48.388921+0000","last_change":"2026-02-17T11:47:48.388921+0000","last_active":"2026-02-17T11:47:48.388921+0000","last_peered":"2026-02-17T11:47:48.388921+0000","last_clean":"2026-02-17T11:47:48.388921+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:47:48.388921+0000","last_undegraded":"2026-02-17T11:47:48.388921+0000","last_fullsized":"2026-02-17T11:47:48.388921+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:47:48.388921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:47:48.388921+0000","last_clean_scrub_stamp":"2026-02-17T11:47:48.388921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":43,"state":"active+clean","last_fresh":"2026-02-17T11:47:49.976407+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:47:49.976407+0000","last_peered":"2026-02-17T11:47:49.976407+0000","last_clean":"2026-02-17T11:47:49.976407+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:47:49.976407+0000","last_undegraded":"2026-02-17T11:47:49.976407+0000","last_fullsized":"2026-02-17T11:47:49.976407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607607,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":389120,"data_stored":120852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640312,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":389120,"data_stored":120852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673015,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":389120,"data_stored":120852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705721,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":389120,"data_stored":120852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:48:01.202 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_8 2026-02-17T11:48:01.203 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_8 unique_pool_8 --yes-i-really-really-mean-it 2026-02-17T11:48:01.408 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_8' removed 2026-02-17T11:48:01.417 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_9 2026-02-17T11:48:01.418 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_9 1 2026-02-17T11:48:02.412 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_9' created 2026-02-17T11:48:02.424 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_9 rados --yes-i-really-mean-it || true 2026-02-17T11:48:03.413 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_9' 2026-02-17T11:48:04.427 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:48:04.585 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:48:04.585 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":46,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:48:03.412071+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"unique_pool_9","create_time":"2026-02-17T11:48:01.582251+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:48:04.595 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:48:04.596 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:48:04.596 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:48:04.597 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:48:04.682 INFO:teuthology.orchestra.run.trial078.stdout:42949673017 2026-02-17T11:48:04.683 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:04.684 INFO:teuthology.orchestra.run.trial078.stdout:47244640314 2026-02-17T11:48:04.685 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:04.686 INFO:teuthology.orchestra.run.trial078.stdout:51539607609 2026-02-17T11:48:04.687 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:04.688 INFO:teuthology.orchestra.run.trial078.stdout:38654705723 2026-02-17T11:48:04.689 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:04.885 INFO:teuthology.orchestra.run.trial078.stdout:51539607608 2026-02-17T11:48:04.887 INFO:teuthology.orchestra.run.trial078.stdout:42949673016 2026-02-17T11:48:04.889 INFO:teuthology.orchestra.run.trial078.stdout:38654705722 2026-02-17T11:48:04.892 INFO:teuthology.orchestra.run.trial078.stdout:47244640313 2026-02-17T11:48:04.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607609 got 51539607608 for osd.1 2026-02-17T11:48:04.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673017 got 42949673016 for osd.3 2026-02-17T11:48:04.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705723 got 38654705722 for osd.2 2026-02-17T11:48:04.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640314 got 47244640313 for osd.0 2026-02-17T11:48:05.895 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:05.897 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:05.899 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:05.903 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:06.057 INFO:teuthology.orchestra.run.trial078.stdout:42949673016 2026-02-17T11:48:06.063 INFO:teuthology.orchestra.run.trial078.stdout:51539607608 2026-02-17T11:48:06.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673017 got 42949673016 for osd.3 2026-02-17T11:48:06.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607609 got 51539607608 for osd.1 2026-02-17T11:48:06.099 INFO:teuthology.orchestra.run.trial078.stdout:47244640313 2026-02-17T11:48:06.100 INFO:teuthology.orchestra.run.trial078.stdout:38654705722 2026-02-17T11:48:06.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640314 got 47244640313 for osd.0 2026-02-17T11:48:06.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705723 got 38654705722 for osd.2 2026-02-17T11:48:07.068 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:07.074 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:07.109 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:07.110 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:07.230 INFO:teuthology.orchestra.run.trial078.stdout:42949673017 2026-02-17T11:48:07.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673017 got 42949673017 for osd.3 2026-02-17T11:48:07.243 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:07.273 INFO:teuthology.orchestra.run.trial078.stdout:47244640314 2026-02-17T11:48:07.275 INFO:teuthology.orchestra.run.trial078.stdout:38654705723 2026-02-17T11:48:07.278 INFO:teuthology.orchestra.run.trial078.stdout:51539607610 2026-02-17T11:48:07.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640314 got 47244640314 for osd.0 2026-02-17T11:48:07.284 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:07.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705723 got 38654705723 for osd.2 2026-02-17T11:48:07.286 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:07.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607609 got 51539607610 for osd.1 2026-02-17T11:48:07.288 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:07.288 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:48:07.482 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:48:07.483 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:48:07.490 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2026-02-17T11:48:06.198566+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":109504,"kb_used_data":1624,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377856,"statfs":{"total":386547056640,"available":386434924544,"internally_reserved":0,"allocated":1662976,"data_stored":518931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"10.0","version":"0'0","reported_seq":3,"reported_epoch":46,"state":"creating+activating","last_fresh":"2026-02-17T11:48:03.416378+0000","last_change":"2026-02-17T11:48:03.416378+0000","last_active":"2026-02-17T11:48:02.409369+0000","last_peered":"2026-02-17T11:48:02.409369+0000","last_clean":"2026-02-17T11:48:02.409369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:48:03.416378+0000","last_undegraded":"2026-02-17T11:48:03.416378+0000","last_fullsized":"2026-02-17T11:48:03.416378+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:48:02.409369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:48:02.409369+0000","last_clean_scrub_stamp":"2026-02-17T11:48:02.409369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":67,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-17T11:48:03.414922+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:48:03.414922+0000","last_peered":"2026-02-17T11:48:03.414922+0000","last_clean":"2026-02-17T11:48:03.414922+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:48:03.414922+0000","last_undegraded":"2026-02-17T11:48:03.414922+0000","last_fullsized":"2026-02-17T11:48:03.414922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607610,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":417792,"data_stored":130570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640314,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":409600,"data_stored":127221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673017,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27376,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":417792,"data_stored":130570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":417792,"data_stored":130570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:48:13.492 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:48:13.493 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:48:13.493 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:48:13.493 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:48:13.581 INFO:teuthology.orchestra.run.trial078.stdout:38654705727 2026-02-17T11:48:13.582 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:13.584 INFO:teuthology.orchestra.run.trial078.stdout:51539607612 2026-02-17T11:48:13.584 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:13.586 INFO:teuthology.orchestra.run.trial078.stdout:47244640317 2026-02-17T11:48:13.587 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:13.588 INFO:teuthology.orchestra.run.trial078.stdout:42949673020 2026-02-17T11:48:13.589 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:13.784 INFO:teuthology.orchestra.run.trial078.stdout:47244640315 2026-02-17T11:48:13.787 INFO:teuthology.orchestra.run.trial078.stdout:51539607611 2026-02-17T11:48:13.788 INFO:teuthology.orchestra.run.trial078.stdout:42949673018 2026-02-17T11:48:13.788 INFO:teuthology.orchestra.run.trial078.stdout:38654705725 2026-02-17T11:48:13.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640317 got 47244640315 for osd.0 2026-02-17T11:48:13.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607612 got 51539607611 for osd.1 2026-02-17T11:48:13.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673020 got 42949673018 for osd.3 2026-02-17T11:48:13.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705727 got 38654705725 for osd.2 2026-02-17T11:48:14.794 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:14.799 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:14.800 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:14.800 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:14.957 INFO:teuthology.orchestra.run.trial078.stdout:47244640317 2026-02-17T11:48:14.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640317 got 47244640317 for osd.0 2026-02-17T11:48:14.968 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:14.995 INFO:teuthology.orchestra.run.trial078.stdout:38654705727 2026-02-17T11:48:15.000 INFO:teuthology.orchestra.run.trial078.stdout:42949673020 2026-02-17T11:48:15.002 INFO:teuthology.orchestra.run.trial078.stdout:51539607612 2026-02-17T11:48:15.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705727 got 38654705727 for osd.2 2026-02-17T11:48:15.005 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:15.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673020 got 42949673020 for osd.3 2026-02-17T11:48:15.010 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:15.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607612 got 51539607612 for osd.1 2026-02-17T11:48:15.012 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:15.013 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:48:15.206 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:48:15.207 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:48:15.215 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2026-02-17T11:48:14.199486+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":109508,"kb_used_data":1632,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377852,"statfs":{"total":386547056640,"available":386434920448,"internally_reserved":0,"allocated":1671168,"data_stored":522280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"10.0","version":"0'0","reported_seq":3,"reported_epoch":46,"state":"creating+activating","last_fresh":"2026-02-17T11:48:03.416378+0000","last_change":"2026-02-17T11:48:03.416378+0000","last_active":"2026-02-17T11:48:02.409369+0000","last_peered":"2026-02-17T11:48:02.409369+0000","last_clean":"2026-02-17T11:48:02.409369+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:48:03.416378+0000","last_undegraded":"2026-02-17T11:48:03.416378+0000","last_fullsized":"2026-02-17T11:48:03.416378+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:48:02.409369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:48:02.409369+0000","last_clean_scrub_stamp":"2026-02-17T11:48:02.409369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":67,"reported_epoch":46,"state":"active+clean","last_fresh":"2026-02-17T11:48:03.414922+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:48:03.414922+0000","last_peered":"2026-02-17T11:48:03.414922+0000","last_clean":"2026-02-17T11:48:03.414922+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:48:03.414922+0000","last_undegraded":"2026-02-17T11:48:03.414922+0000","last_fullsized":"2026-02-17T11:48:03.414922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607612,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":417792,"data_stored":130570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640317,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":417792,"data_stored":130570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27376,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":417792,"data_stored":130570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705727,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":417792,"data_stored":130570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:48:15.216 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_9 2026-02-17T11:48:15.216 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_9 unique_pool_9 --yes-i-really-really-mean-it 2026-02-17T11:48:15.429 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_9' removed 2026-02-17T11:48:15.438 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_10 2026-02-17T11:48:15.438 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_10 1 2026-02-17T11:48:16.432 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_10' created 2026-02-17T11:48:16.443 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_10 rados --yes-i-really-mean-it || true 2026-02-17T11:48:17.435 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_10' 2026-02-17T11:48:18.447 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:48:18.608 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:48:18.609 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":49,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:48:17.432116+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"unique_pool_10","create_time":"2026-02-17T11:48:15.597369+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:48:18.617 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:48:18.618 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:48:18.618 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:48:18.619 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:48:18.705 INFO:teuthology.orchestra.run.trial078.stdout:38654705729 2026-02-17T11:48:18.706 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:18.708 INFO:teuthology.orchestra.run.trial078.stdout:47244640319 2026-02-17T11:48:18.708 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:18.709 INFO:teuthology.orchestra.run.trial078.stdout:42949673022 2026-02-17T11:48:18.710 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:18.906 INFO:teuthology.orchestra.run.trial078.stdout:38654705728 2026-02-17T11:48:18.909 INFO:teuthology.orchestra.run.trial078.stdout:47244640317 2026-02-17T11:48:18.911 INFO:teuthology.orchestra.run.trial078.stdout:42949673021 2026-02-17T11:48:18.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705729 got 38654705728 for osd.2 2026-02-17T11:48:18.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640319 got 47244640317 for osd.0 2026-02-17T11:48:18.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673022 got 42949673021 for osd.3 2026-02-17T11:48:19.917 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:19.919 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:19.922 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:20.081 INFO:teuthology.orchestra.run.trial078.stdout:38654705728 2026-02-17T11:48:20.082 INFO:teuthology.orchestra.run.trial078.stdout:47244640317 2026-02-17T11:48:20.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705729 got 38654705728 for osd.2 2026-02-17T11:48:20.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640319 got 47244640317 for osd.0 2026-02-17T11:48:20.121 INFO:teuthology.orchestra.run.trial078.stdout:42949673021 2026-02-17T11:48:20.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673022 got 42949673021 for osd.3 2026-02-17T11:48:21.092 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:21.092 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:21.131 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:21.257 INFO:teuthology.orchestra.run.trial078.stdout:47244640319 2026-02-17T11:48:21.262 INFO:teuthology.orchestra.run.trial078.stdout:38654705729 2026-02-17T11:48:21.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640319 got 47244640319 for osd.0 2026-02-17T11:48:21.267 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:21.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705729 got 38654705729 for osd.2 2026-02-17T11:48:21.272 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:21.292 INFO:teuthology.orchestra.run.trial078.stdout:42949673022 2026-02-17T11:48:21.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673022 got 42949673022 for osd.3 2026-02-17T11:48:21.302 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:21.706 INFO:teuthology.orchestra.run.trial078.stdout:51539607615 2026-02-17T11:48:21.706 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:21.861 INFO:teuthology.orchestra.run.trial078.stdout:51539607613 2026-02-17T11:48:21.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607615 got 51539607613 for osd.1 2026-02-17T11:48:22.870 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:23.027 INFO:teuthology.orchestra.run.trial078.stdout:51539607615 2026-02-17T11:48:23.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607615 got 51539607615 for osd.1 2026-02-17T11:48:23.036 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:23.037 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:48:23.190 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:48:23.191 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:48:23.199 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2026-02-17T11:48:22.200400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":109560,"kb_used_data":1704,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377800,"statfs":{"total":386547056640,"available":386434867200,"internally_reserved":0,"allocated":1744896,"data_stored":544382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:48:16.429314+0000","last_change":"2026-02-17T11:48:16.429314+0000","last_active":"2026-02-17T11:48:16.429314+0000","last_peered":"2026-02-17T11:48:16.429314+0000","last_clean":"2026-02-17T11:48:16.429314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:48:16.429314+0000","last_undegraded":"2026-02-17T11:48:16.429314+0000","last_fullsized":"2026-02-17T11:48:16.429314+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:48:16.429314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:48:16.429314+0000","last_clean_scrub_stamp":"2026-02-17T11:48:16.429314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-17T11:48:17.435929+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:48:17.435929+0000","last_peered":"2026-02-17T11:48:17.435929+0000","last_clean":"2026-02-17T11:48:17.435929+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:48:17.435929+0000","last_undegraded":"2026-02-17T11:48:17.435929+0000","last_fullsized":"2026-02-17T11:48:17.435929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607615,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":446464,"data_stored":140283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640319,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":438272,"data_stored":136941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":430080,"data_stored":133579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705729,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":430080,"data_stored":133579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:48:29.201 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:48:29.201 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:48:29.202 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:48:29.202 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:48:29.289 INFO:teuthology.orchestra.run.trial078.stdout:51539607617 2026-02-17T11:48:29.290 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:29.291 INFO:teuthology.orchestra.run.trial078.stdout:47244640322 2026-02-17T11:48:29.292 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:29.293 INFO:teuthology.orchestra.run.trial078.stdout:38654705732 2026-02-17T11:48:29.293 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:29.294 INFO:teuthology.orchestra.run.trial078.stdout:42949673025 2026-02-17T11:48:29.295 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:29.488 INFO:teuthology.orchestra.run.trial078.stdout:38654705731 2026-02-17T11:48:29.491 INFO:teuthology.orchestra.run.trial078.stdout:47244640320 2026-02-17T11:48:29.494 INFO:teuthology.orchestra.run.trial078.stdout:51539607616 2026-02-17T11:48:29.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705732 got 38654705731 for osd.2 2026-02-17T11:48:29.499 INFO:teuthology.orchestra.run.trial078.stdout:42949673024 2026-02-17T11:48:29.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640322 got 47244640320 for osd.0 2026-02-17T11:48:29.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607617 got 51539607616 for osd.1 2026-02-17T11:48:29.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673025 got 42949673024 for osd.3 2026-02-17T11:48:30.499 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:30.502 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:30.505 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:30.509 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:30.658 INFO:teuthology.orchestra.run.trial078.stdout:38654705732 2026-02-17T11:48:30.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705732 got 38654705732 for osd.2 2026-02-17T11:48:30.668 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:30.699 INFO:teuthology.orchestra.run.trial078.stdout:47244640322 2026-02-17T11:48:30.700 INFO:teuthology.orchestra.run.trial078.stdout:51539607617 2026-02-17T11:48:30.705 INFO:teuthology.orchestra.run.trial078.stdout:42949673025 2026-02-17T11:48:30.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640322 got 47244640322 for osd.0 2026-02-17T11:48:30.708 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:30.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607617 got 51539607617 for osd.1 2026-02-17T11:48:30.710 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:30.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673025 got 42949673025 for osd.3 2026-02-17T11:48:30.714 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:30.715 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:48:30.911 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:48:30.911 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:48:30.919 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2026-02-17T11:48:30.201133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":109612,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377748,"statfs":{"total":386547056640,"available":386434813952,"internally_reserved":0,"allocated":1785856,"data_stored":561132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:48:16.429314+0000","last_change":"2026-02-17T11:48:16.429314+0000","last_active":"2026-02-17T11:48:16.429314+0000","last_peered":"2026-02-17T11:48:16.429314+0000","last_clean":"2026-02-17T11:48:16.429314+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:48:16.429314+0000","last_undegraded":"2026-02-17T11:48:16.429314+0000","last_fullsized":"2026-02-17T11:48:16.429314+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:48:16.429314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:48:16.429314+0000","last_clean_scrub_stamp":"2026-02-17T11:48:16.429314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":49,"state":"active+clean","last_fresh":"2026-02-17T11:48:17.435929+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:48:17.435929+0000","last_peered":"2026-02-17T11:48:17.435929+0000","last_clean":"2026-02-17T11:48:17.435929+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:48:17.435929+0000","last_undegraded":"2026-02-17T11:48:17.435929+0000","last_fullsized":"2026-02-17T11:48:17.435929+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607617,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":446464,"data_stored":140283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640322,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":446464,"data_stored":140283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673025,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27404,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":446464,"data_stored":140283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27404,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":446464,"data_stored":140283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:48:30.920 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_10 2026-02-17T11:48:30.921 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_10 unique_pool_10 --yes-i-really-really-mean-it 2026-02-17T11:48:31.451 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_10' removed 2026-02-17T11:48:31.462 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_11 2026-02-17T11:48:31.462 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_11 1 2026-02-17T11:48:32.456 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_11' created 2026-02-17T11:48:32.467 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_11 rados --yes-i-really-mean-it || true 2026-02-17T11:48:33.459 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_11' 2026-02-17T11:48:34.473 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:48:34.627 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:48:34.628 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":52,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:48:33.455920+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"unique_pool_11","create_time":"2026-02-17T11:48:31.622091+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:48:34.636 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:48:34.637 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:48:34.638 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:48:34.638 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:48:34.724 INFO:teuthology.orchestra.run.trial078.stdout:38654705734 2026-02-17T11:48:34.725 INFO:teuthology.orchestra.run.trial078.stdout:42949673027 2026-02-17T11:48:34.726 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:34.727 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:34.728 INFO:teuthology.orchestra.run.trial078.stdout:51539607619 2026-02-17T11:48:34.728 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:34.729 INFO:teuthology.orchestra.run.trial078.stdout:47244640324 2026-02-17T11:48:34.730 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:34.927 INFO:teuthology.orchestra.run.trial078.stdout:42949673026 2026-02-17T11:48:34.930 INFO:teuthology.orchestra.run.trial078.stdout:38654705733 2026-02-17T11:48:34.935 INFO:teuthology.orchestra.run.trial078.stdout:51539607618 2026-02-17T11:48:34.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673027 got 42949673026 for osd.3 2026-02-17T11:48:34.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705734 got 38654705733 for osd.2 2026-02-17T11:48:34.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607619 got 51539607618 for osd.1 2026-02-17T11:48:34.974 INFO:teuthology.orchestra.run.trial078.stdout:47244640323 2026-02-17T11:48:34.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640324 got 47244640323 for osd.0 2026-02-17T11:48:35.938 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:35.941 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:35.946 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:35.984 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:36.103 INFO:teuthology.orchestra.run.trial078.stdout:42949673026 2026-02-17T11:48:36.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673027 got 42949673026 for osd.3 2026-02-17T11:48:36.140 INFO:teuthology.orchestra.run.trial078.stdout:51539607618 2026-02-17T11:48:36.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607619 got 51539607618 for osd.1 2026-02-17T11:48:36.182 INFO:teuthology.orchestra.run.trial078.stdout:47244640323 2026-02-17T11:48:36.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640324 got 47244640323 for osd.0 2026-02-17T11:48:37.114 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:37.150 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:37.193 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:37.272 INFO:teuthology.orchestra.run.trial078.stdout:42949673027 2026-02-17T11:48:37.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673027 got 42949673027 for osd.3 2026-02-17T11:48:37.283 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:37.320 INFO:teuthology.orchestra.run.trial078.stdout:51539607620 2026-02-17T11:48:37.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607619 got 51539607620 for osd.1 2026-02-17T11:48:37.331 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:37.360 INFO:teuthology.orchestra.run.trial078.stdout:47244640324 2026-02-17T11:48:37.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640324 got 47244640324 for osd.0 2026-02-17T11:48:37.370 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:39.142 INFO:teuthology.orchestra.run.trial078.stdout:38654705735 2026-02-17T11:48:39.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705734 got 38654705735 for osd.2 2026-02-17T11:48:39.152 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:39.152 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:48:39.307 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:48:39.308 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:48:39.316 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2026-02-17T11:48:38.202219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":109712,"kb_used_data":1840,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377648,"statfs":{"total":386547056640,"available":386434711552,"internally_reserved":0,"allocated":1884160,"data_stored":593304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:48:32.453007+0000","last_change":"2026-02-17T11:48:32.453007+0000","last_active":"2026-02-17T11:48:32.453007+0000","last_peered":"2026-02-17T11:48:32.453007+0000","last_clean":"2026-02-17T11:48:32.453007+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:48:32.453007+0000","last_undegraded":"2026-02-17T11:48:32.453007+0000","last_fullsized":"2026-02-17T11:48:32.453007+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:48:32.453007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:48:32.453007+0000","last_clean_scrub_stamp":"2026-02-17T11:48:32.453007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":78,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T11:48:33.460013+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:48:33.460013+0000","last_peered":"2026-02-17T11:48:33.460013+0000","last_clean":"2026-02-17T11:48:33.460013+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:48:33.460013+0000","last_undegraded":"2026-02-17T11:48:33.460013+0000","last_fullsized":"2026-02-17T11:48:33.460013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607620,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":475136,"data_stored":149997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640324,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":466944,"data_stored":146655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":475136,"data_stored":149997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705735,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":466944,"data_stored":146655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:48:45.318 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:48:45.319 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:48:45.319 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:48:45.320 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:48:45.408 INFO:teuthology.orchestra.run.trial078.stdout:51539607622 2026-02-17T11:48:45.409 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:45.410 INFO:teuthology.orchestra.run.trial078.stdout:47244640327 2026-02-17T11:48:45.411 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:45.412 INFO:teuthology.orchestra.run.trial078.stdout:38654705737 2026-02-17T11:48:45.412 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:45.415 INFO:teuthology.orchestra.run.trial078.stdout:42949673030 2026-02-17T11:48:45.416 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:45.615 INFO:teuthology.orchestra.run.trial078.stdout:42949673029 2026-02-17T11:48:45.617 INFO:teuthology.orchestra.run.trial078.stdout:47244640326 2026-02-17T11:48:45.619 INFO:teuthology.orchestra.run.trial078.stdout:38654705736 2026-02-17T11:48:45.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673030 got 42949673029 for osd.3 2026-02-17T11:48:45.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640327 got 47244640326 for osd.0 2026-02-17T11:48:45.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705737 got 38654705736 for osd.2 2026-02-17T11:48:45.772 INFO:teuthology.orchestra.run.trial078.stdout:51539607621 2026-02-17T11:48:45.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607622 got 51539607621 for osd.1 2026-02-17T11:48:46.626 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:46.628 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:46.630 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:46.782 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:46.785 INFO:teuthology.orchestra.run.trial078.stdout:47244640327 2026-02-17T11:48:46.787 INFO:teuthology.orchestra.run.trial078.stdout:42949673030 2026-02-17T11:48:46.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640327 got 47244640327 for osd.0 2026-02-17T11:48:46.795 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:46.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673030 got 42949673030 for osd.3 2026-02-17T11:48:46.798 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:46.829 INFO:teuthology.orchestra.run.trial078.stdout:38654705737 2026-02-17T11:48:46.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705737 got 38654705737 for osd.2 2026-02-17T11:48:46.839 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:46.941 INFO:teuthology.orchestra.run.trial078.stdout:51539607623 2026-02-17T11:48:46.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607622 got 51539607623 for osd.1 2026-02-17T11:48:46.949 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:46.950 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:48:47.107 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:48:47.107 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:48:47.115 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2026-02-17T11:48:46.203090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":109724,"kb_used_data":1856,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377636,"statfs":{"total":386547056640,"available":386434699264,"internally_reserved":0,"allocated":1900544,"data_stored":599988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:48:32.453007+0000","last_change":"2026-02-17T11:48:32.453007+0000","last_active":"2026-02-17T11:48:32.453007+0000","last_peered":"2026-02-17T11:48:32.453007+0000","last_clean":"2026-02-17T11:48:32.453007+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:48:32.453007+0000","last_undegraded":"2026-02-17T11:48:32.453007+0000","last_fullsized":"2026-02-17T11:48:32.453007+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:48:32.453007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:48:32.453007+0000","last_clean_scrub_stamp":"2026-02-17T11:48:32.453007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":78,"reported_epoch":52,"state":"active+clean","last_fresh":"2026-02-17T11:48:33.460013+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:48:33.460013+0000","last_peered":"2026-02-17T11:48:33.460013+0000","last_clean":"2026-02-17T11:48:33.460013+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:48:33.460013+0000","last_undegraded":"2026-02-17T11:48:33.460013+0000","last_fullsized":"2026-02-17T11:48:33.460013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607623,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":475136,"data_stored":149997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640327,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":475136,"data_stored":149997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673030,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":475136,"data_stored":149997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705737,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":475136,"data_stored":149997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:48:47.116 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_11 2026-02-17T11:48:47.117 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_11 unique_pool_11 --yes-i-really-really-mean-it 2026-02-17T11:48:47.471 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_11' removed 2026-02-17T11:48:47.481 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_12 2026-02-17T11:48:47.482 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_12 1 2026-02-17T11:48:48.476 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_12' created 2026-02-17T11:48:48.489 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_12 rados --yes-i-really-mean-it || true 2026-02-17T11:48:50.479 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_12' 2026-02-17T11:48:51.491 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:48:51.646 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:48:51.647 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":56,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:48:50.478273+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"unique_pool_12","create_time":"2026-02-17T11:48:47.642568+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:48:51.656 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:48:51.657 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:48:51.658 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:48:51.658 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:48:51.745 INFO:teuthology.orchestra.run.trial078.stdout:42949673032 2026-02-17T11:48:51.745 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:51.747 INFO:teuthology.orchestra.run.trial078.stdout:38654705739 2026-02-17T11:48:51.747 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:51.748 INFO:teuthology.orchestra.run.trial078.stdout:47244640329 2026-02-17T11:48:51.749 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:51.750 INFO:teuthology.orchestra.run.trial078.stdout:51539607625 2026-02-17T11:48:51.751 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:51.947 INFO:teuthology.orchestra.run.trial078.stdout:47244640328 2026-02-17T11:48:51.950 INFO:teuthology.orchestra.run.trial078.stdout:42949673031 2026-02-17T11:48:51.951 INFO:teuthology.orchestra.run.trial078.stdout:38654705738 2026-02-17T11:48:51.953 INFO:teuthology.orchestra.run.trial078.stdout:51539607623 2026-02-17T11:48:51.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640329 got 47244640328 for osd.0 2026-02-17T11:48:51.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673032 got 42949673031 for osd.3 2026-02-17T11:48:51.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705739 got 38654705738 for osd.2 2026-02-17T11:48:51.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607625 got 51539607623 for osd.1 2026-02-17T11:48:52.959 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:48:52.961 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:48:52.962 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:48:52.964 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:48:53.123 INFO:teuthology.orchestra.run.trial078.stdout:51539607625 2026-02-17T11:48:53.123 INFO:teuthology.orchestra.run.trial078.stdout:42949673032 2026-02-17T11:48:53.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607625 got 51539607625 for osd.1 2026-02-17T11:48:53.132 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:53.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673032 got 42949673032 for osd.3 2026-02-17T11:48:53.133 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:56.125 INFO:teuthology.orchestra.run.trial078.stdout:38654705740 2026-02-17T11:48:56.125 INFO:teuthology.orchestra.run.trial078.stdout:47244640330 2026-02-17T11:48:56.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705739 got 38654705740 for osd.2 2026-02-17T11:48:56.135 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:56.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640329 got 47244640330 for osd.0 2026-02-17T11:48:56.136 DEBUG:teuthology.parallel:result is None 2026-02-17T11:48:56.137 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:48:56.291 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:48:56.291 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:48:56.299 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2026-02-17T11:48:56.204268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":109852,"kb_used_data":1992,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377508,"statfs":{"total":386547056640,"available":386434568192,"internally_reserved":0,"allocated":2039808,"data_stored":648870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:48:48.473486+0000","last_change":"2026-02-17T11:48:48.473486+0000","last_active":"2026-02-17T11:48:48.473486+0000","last_peered":"2026-02-17T11:48:48.473486+0000","last_clean":"2026-02-17T11:48:48.473486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:48:48.473486+0000","last_undegraded":"2026-02-17T11:48:48.473486+0000","last_fullsized":"2026-02-17T11:48:48.473486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:48:48.473486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:48:48.473486+0000","last_clean_scrub_stamp":"2026-02-17T11:48:48.473486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-17T11:48:53.147241+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:48:53.147241+0000","last_peered":"2026-02-17T11:48:53.147241+0000","last_clean":"2026-02-17T11:48:53.147241+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:48:53.147241+0000","last_undegraded":"2026-02-17T11:48:53.147241+0000","last_fullsized":"2026-02-17T11:48:53.147241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607626,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":512000,"data_stored":163053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640330,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":512000,"data_stored":163053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673033,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":512000,"data_stored":163053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":503808,"data_stored":159711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:49:02.300 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:49:02.301 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:49:02.301 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:49:02.302 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:49:02.387 INFO:teuthology.orchestra.run.trial078.stdout:51539607628 2026-02-17T11:49:02.388 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:02.389 INFO:teuthology.orchestra.run.trial078.stdout:47244640332 2026-02-17T11:49:02.390 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:02.391 INFO:teuthology.orchestra.run.trial078.stdout:42949673035 2026-02-17T11:49:02.391 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:02.392 INFO:teuthology.orchestra.run.trial078.stdout:38654705742 2026-02-17T11:49:02.393 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:02.587 INFO:teuthology.orchestra.run.trial078.stdout:42949673034 2026-02-17T11:49:02.592 INFO:teuthology.orchestra.run.trial078.stdout:51539607626 2026-02-17T11:49:02.593 INFO:teuthology.orchestra.run.trial078.stdout:47244640331 2026-02-17T11:49:02.595 INFO:teuthology.orchestra.run.trial078.stdout:38654705741 2026-02-17T11:49:02.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673035 got 42949673034 for osd.3 2026-02-17T11:49:02.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607628 got 51539607626 for osd.1 2026-02-17T11:49:02.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640332 got 47244640331 for osd.0 2026-02-17T11:49:02.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705742 got 38654705741 for osd.2 2026-02-17T11:49:03.599 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:03.604 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:03.605 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:03.606 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:03.759 INFO:teuthology.orchestra.run.trial078.stdout:42949673034 2026-02-17T11:49:03.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673035 got 42949673034 for osd.3 2026-02-17T11:49:03.805 INFO:teuthology.orchestra.run.trial078.stdout:38654705741 2026-02-17T11:49:03.807 INFO:teuthology.orchestra.run.trial078.stdout:47244640331 2026-02-17T11:49:03.812 INFO:teuthology.orchestra.run.trial078.stdout:51539607627 2026-02-17T11:49:03.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705742 got 38654705741 for osd.2 2026-02-17T11:49:03.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640332 got 47244640331 for osd.0 2026-02-17T11:49:03.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607628 got 51539607627 for osd.1 2026-02-17T11:49:04.774 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:04.815 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:04.818 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:04.823 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:04.938 INFO:teuthology.orchestra.run.trial078.stdout:42949673034 2026-02-17T11:49:04.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673035 got 42949673034 for osd.3 2026-02-17T11:49:04.979 INFO:teuthology.orchestra.run.trial078.stdout:38654705741 2026-02-17T11:49:04.980 INFO:teuthology.orchestra.run.trial078.stdout:47244640331 2026-02-17T11:49:04.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705742 got 38654705741 for osd.2 2026-02-17T11:49:04.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640332 got 47244640331 for osd.0 2026-02-17T11:49:05.019 INFO:teuthology.orchestra.run.trial078.stdout:51539607627 2026-02-17T11:49:05.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607628 got 51539607627 for osd.1 2026-02-17T11:49:05.950 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:05.991 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:05.991 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:06.029 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:06.115 INFO:teuthology.orchestra.run.trial078.stdout:42949673036 2026-02-17T11:49:06.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673035 got 42949673036 for osd.3 2026-02-17T11:49:06.127 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:06.155 INFO:teuthology.orchestra.run.trial078.stdout:47244640333 2026-02-17T11:49:06.156 INFO:teuthology.orchestra.run.trial078.stdout:38654705743 2026-02-17T11:49:06.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640332 got 47244640333 for osd.0 2026-02-17T11:49:06.165 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:06.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705742 got 38654705743 for osd.2 2026-02-17T11:49:06.166 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:06.197 INFO:teuthology.orchestra.run.trial078.stdout:51539607628 2026-02-17T11:49:06.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607628 got 51539607628 for osd.1 2026-02-17T11:49:06.206 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:06.207 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:49:06.401 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:49:06.401 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:49:06.408 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2026-02-17T11:49:06.205194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":377487360,"kb_used":109860,"kb_used_data":2000,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377500,"statfs":{"total":386547056640,"available":386434560000,"internally_reserved":0,"allocated":2048000,"data_stored":652212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-17T11:48:48.473486+0000","last_change":"2026-02-17T11:48:48.473486+0000","last_active":"2026-02-17T11:48:48.473486+0000","last_peered":"2026-02-17T11:48:48.473486+0000","last_clean":"2026-02-17T11:48:48.473486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:48:48.473486+0000","last_undegraded":"2026-02-17T11:48:48.473486+0000","last_fullsized":"2026-02-17T11:48:48.473486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:48:48.473486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:48:48.473486+0000","last_clean_scrub_stamp":"2026-02-17T11:48:48.473486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":85,"reported_epoch":56,"state":"active+clean","last_fresh":"2026-02-17T11:48:53.147241+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:48:53.147241+0000","last_peered":"2026-02-17T11:48:53.147241+0000","last_clean":"2026-02-17T11:48:53.147241+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:48:53.147241+0000","last_undegraded":"2026-02-17T11:48:53.147241+0000","last_fullsized":"2026-02-17T11:48:53.147241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607629,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":512000,"data_stored":163053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640333,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":512000,"data_stored":163053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":512000,"data_stored":163053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":512000,"data_stored":163053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:49:06.409 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_12 2026-02-17T11:49:06.410 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_12 unique_pool_12 --yes-i-really-really-mean-it 2026-02-17T11:49:07.131 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_12' removed 2026-02-17T11:49:07.143 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_13 2026-02-17T11:49:07.143 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_13 1 2026-02-17T11:49:08.135 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_13' created 2026-02-17T11:49:08.146 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_13 rados --yes-i-really-mean-it || true 2026-02-17T11:49:09.138 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_13' 2026-02-17T11:49:10.150 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:49:10.306 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:49:10.307 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":59,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:49:09.135084+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"unique_pool_13","create_time":"2026-02-17T11:49:07.303952+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:49:10.315 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:49:10.316 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:49:10.317 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:49:10.317 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:49:10.404 INFO:teuthology.orchestra.run.trial078.stdout:47244640335 2026-02-17T11:49:10.404 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:10.405 INFO:teuthology.orchestra.run.trial078.stdout:42949673038 2026-02-17T11:49:10.406 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:10.407 INFO:teuthology.orchestra.run.trial078.stdout:38654705745 2026-02-17T11:49:10.407 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:10.409 INFO:teuthology.orchestra.run.trial078.stdout:51539607630 2026-02-17T11:49:10.409 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:10.603 INFO:teuthology.orchestra.run.trial078.stdout:51539607629 2026-02-17T11:49:10.606 INFO:teuthology.orchestra.run.trial078.stdout:42949673037 2026-02-17T11:49:10.608 INFO:teuthology.orchestra.run.trial078.stdout:47244640333 2026-02-17T11:49:10.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607630 got 51539607629 for osd.1 2026-02-17T11:49:10.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673038 got 42949673037 for osd.3 2026-02-17T11:49:10.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640335 got 47244640333 for osd.0 2026-02-17T11:49:11.616 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:11.618 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:11.620 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:11.777 INFO:teuthology.orchestra.run.trial078.stdout:42949673037 2026-02-17T11:49:11.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673038 got 42949673037 for osd.3 2026-02-17T11:49:11.815 INFO:teuthology.orchestra.run.trial078.stdout:47244640334 2026-02-17T11:49:11.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640335 got 47244640334 for osd.0 2026-02-17T11:49:12.787 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:12.824 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:12.945 INFO:teuthology.orchestra.run.trial078.stdout:42949673037 2026-02-17T11:49:12.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673038 got 42949673037 for osd.3 2026-02-17T11:49:12.984 INFO:teuthology.orchestra.run.trial078.stdout:47244640334 2026-02-17T11:49:12.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640335 got 47244640334 for osd.0 2026-02-17T11:49:13.604 INFO:teuthology.orchestra.run.trial078.stdout:38654705745 2026-02-17T11:49:13.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705745 got 38654705745 for osd.2 2026-02-17T11:49:13.614 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:13.956 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:13.995 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:14.115 INFO:teuthology.orchestra.run.trial078.stdout:42949673038 2026-02-17T11:49:14.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673038 got 42949673038 for osd.3 2026-02-17T11:49:14.125 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:14.157 INFO:teuthology.orchestra.run.trial078.stdout:47244640335 2026-02-17T11:49:14.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640335 got 47244640335 for osd.0 2026-02-17T11:49:14.167 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:14.778 INFO:teuthology.orchestra.run.trial078.stdout:51539607631 2026-02-17T11:49:14.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607630 got 51539607631 for osd.1 2026-02-17T11:49:14.788 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:14.788 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:49:14.943 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:49:14.944 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:49:14.952 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2026-02-17T11:49:14.206163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":109972,"kb_used_data":2104,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377388,"statfs":{"total":386547056640,"available":386434445312,"internally_reserved":0,"allocated":2154496,"data_stored":687750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"14.0","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2026-02-17T11:49:09.140141+0000","last_change":"2026-02-17T11:49:09.140141+0000","last_active":"2026-02-17T11:49:08.131428+0000","last_peered":"2026-02-17T11:49:08.131428+0000","last_clean":"2026-02-17T11:49:08.131428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:49:09.140141+0000","last_undegraded":"2026-02-17T11:49:09.140141+0000","last_fullsized":"2026-02-17T11:49:09.140141+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:49:08.131428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:49:08.131428+0000","last_clean_scrub_stamp":"2026-02-17T11:49:08.131428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":89,"reported_epoch":58,"state":"active+clean","last_fresh":"2026-02-17T11:49:09.347817+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:49:09.347817+0000","last_peered":"2026-02-17T11:49:09.347817+0000","last_clean":"2026-02-17T11:49:09.347817+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:49:09.347817+0000","last_undegraded":"2026-02-17T11:49:09.347817+0000","last_fullsized":"2026-02-17T11:49:09.347817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607631,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":532480,"data_stored":169425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640336,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":540672,"data_stored":172775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":540672,"data_stored":172775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705746,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":540672,"data_stored":172775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:49:20.955 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:49:20.956 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:49:20.956 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:49:20.957 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:49:21.045 INFO:teuthology.orchestra.run.trial078.stdout:38654705748 2026-02-17T11:49:21.046 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:21.047 INFO:teuthology.orchestra.run.trial078.stdout:42949673041 2026-02-17T11:49:21.048 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:21.049 INFO:teuthology.orchestra.run.trial078.stdout:51539607634 2026-02-17T11:49:21.049 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:21.050 INFO:teuthology.orchestra.run.trial078.stdout:47244640338 2026-02-17T11:49:21.051 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:21.250 INFO:teuthology.orchestra.run.trial078.stdout:38654705747 2026-02-17T11:49:21.254 INFO:teuthology.orchestra.run.trial078.stdout:51539607632 2026-02-17T11:49:21.256 INFO:teuthology.orchestra.run.trial078.stdout:42949673040 2026-02-17T11:49:21.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705748 got 38654705747 for osd.2 2026-02-17T11:49:21.261 INFO:teuthology.orchestra.run.trial078.stdout:47244640337 2026-02-17T11:49:21.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607634 got 51539607632 for osd.1 2026-02-17T11:49:21.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673041 got 42949673040 for osd.3 2026-02-17T11:49:21.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640338 got 47244640337 for osd.0 2026-02-17T11:49:22.261 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:22.267 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:22.268 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:22.272 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:22.422 INFO:teuthology.orchestra.run.trial078.stdout:38654705748 2026-02-17T11:49:22.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705748 got 38654705748 for osd.2 2026-02-17T11:49:22.433 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:22.465 INFO:teuthology.orchestra.run.trial078.stdout:51539607634 2026-02-17T11:49:22.466 INFO:teuthology.orchestra.run.trial078.stdout:42949673041 2026-02-17T11:49:22.469 INFO:teuthology.orchestra.run.trial078.stdout:47244640338 2026-02-17T11:49:22.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607634 got 51539607634 for osd.1 2026-02-17T11:49:22.475 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:22.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673041 got 42949673041 for osd.3 2026-02-17T11:49:22.477 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:22.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640338 got 47244640338 for osd.0 2026-02-17T11:49:22.479 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:22.479 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:49:22.675 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:49:22.676 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:49:22.684 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2026-02-17T11:49:22.207045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":377487360,"kb_used":109976,"kb_used_data":2112,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377384,"statfs":{"total":386547056640,"available":386434441216,"internally_reserved":0,"allocated":2162688,"data_stored":691100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"14.0","version":"0'0","reported_seq":3,"reported_epoch":59,"state":"creating+activating","last_fresh":"2026-02-17T11:49:09.140141+0000","last_change":"2026-02-17T11:49:09.140141+0000","last_active":"2026-02-17T11:49:08.131428+0000","last_peered":"2026-02-17T11:49:08.131428+0000","last_clean":"2026-02-17T11:49:08.131428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-17T11:49:09.140141+0000","last_undegraded":"2026-02-17T11:49:09.140141+0000","last_fullsized":"2026-02-17T11:49:09.140141+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:49:08.131428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:49:08.131428+0000","last_clean_scrub_stamp":"2026-02-17T11:49:08.131428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2026-02-17T11:49:10.880352+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:49:10.880352+0000","last_peered":"2026-02-17T11:49:10.880352+0000","last_clean":"2026-02-17T11:49:10.880352+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:49:10.880352+0000","last_undegraded":"2026-02-17T11:49:10.880352+0000","last_fullsized":"2026-02-17T11:49:10.880352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607634,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":540672,"data_stored":172775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640338,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":540672,"data_stored":172775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673041,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":540672,"data_stored":172775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705748,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":540672,"data_stored":172775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:49:22.685 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_13 2026-02-17T11:49:22.685 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_13 unique_pool_13 --yes-i-really-really-mean-it 2026-02-17T11:49:23.264 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_13' removed 2026-02-17T11:49:23.275 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_14 2026-02-17T11:49:23.276 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_14 1 2026-02-17T11:49:24.266 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_14' created 2026-02-17T11:49:24.276 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_14 rados --yes-i-really-mean-it || true 2026-02-17T11:49:25.269 INFO:teuthology.orchestra.run.trial078.stderr:enabled application 'rados' on pool 'unique_pool_14' 2026-02-17T11:49:26.280 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:49:26.437 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:49:26.437 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":63,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:49:26.268865+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:44:52.851566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"unique_pool_14","create_time":"2026-02-17T11:49:23.435354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:49:26.446 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:49:26.447 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:49:26.448 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:49:26.448 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:49:26.535 INFO:teuthology.orchestra.run.trial078.stdout:51539607636 2026-02-17T11:49:26.536 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:26.537 INFO:teuthology.orchestra.run.trial078.stdout:38654705750 2026-02-17T11:49:26.537 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:26.538 INFO:teuthology.orchestra.run.trial078.stdout:47244640340 2026-02-17T11:49:26.539 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:26.540 INFO:teuthology.orchestra.run.trial078.stdout:42949673044 2026-02-17T11:49:26.540 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:26.740 INFO:teuthology.orchestra.run.trial078.stdout:38654705749 2026-02-17T11:49:26.744 INFO:teuthology.orchestra.run.trial078.stdout:47244640339 2026-02-17T11:49:26.745 INFO:teuthology.orchestra.run.trial078.stdout:51539607635 2026-02-17T11:49:26.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705750 got 38654705749 for osd.2 2026-02-17T11:49:26.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640340 got 47244640339 for osd.0 2026-02-17T11:49:26.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607636 got 51539607635 for osd.1 2026-02-17T11:49:26.782 INFO:teuthology.orchestra.run.trial078.stdout:42949673042 2026-02-17T11:49:26.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673044 got 42949673042 for osd.3 2026-02-17T11:49:27.751 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:27.755 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:27.756 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:27.792 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:27.910 INFO:teuthology.orchestra.run.trial078.stdout:38654705749 2026-02-17T11:49:27.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705750 got 38654705749 for osd.2 2026-02-17T11:49:27.954 INFO:teuthology.orchestra.run.trial078.stdout:47244640339 2026-02-17T11:49:27.956 INFO:teuthology.orchestra.run.trial078.stdout:42949673042 2026-02-17T11:49:27.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640340 got 47244640339 for osd.0 2026-02-17T11:49:27.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673044 got 42949673042 for osd.3 2026-02-17T11:49:28.921 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:28.965 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:28.966 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:29.083 INFO:teuthology.orchestra.run.trial078.stdout:38654705751 2026-02-17T11:49:29.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705750 got 38654705751 for osd.2 2026-02-17T11:49:29.094 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:29.122 INFO:teuthology.orchestra.run.trial078.stdout:47244640340 2026-02-17T11:49:29.126 INFO:teuthology.orchestra.run.trial078.stdout:42949673045 2026-02-17T11:49:29.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640340 got 47244640340 for osd.0 2026-02-17T11:49:29.132 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:29.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673044 got 42949673045 for osd.3 2026-02-17T11:49:29.136 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:30.955 INFO:teuthology.orchestra.run.trial078.stdout:51539607636 2026-02-17T11:49:30.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607636 got 51539607636 for osd.1 2026-02-17T11:49:30.965 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:30.965 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:49:31.118 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:49:31.119 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:49:31.126 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2026-02-17T11:49:30.208194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":110088,"kb_used_data":2224,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377272,"statfs":{"total":386547056640,"available":386434326528,"internally_reserved":0,"allocated":2277376,"data_stored":729960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-17T11:49:25.417054+0000","last_change":"2026-02-17T11:49:25.416732+0000","last_active":"2026-02-17T11:49:25.417054+0000","last_peered":"2026-02-17T11:49:25.417054+0000","last_clean":"2026-02-17T11:49:25.417054+0000","last_became_active":"2026-02-17T11:49:25.416624+0000","last_became_peered":"2026-02-17T11:49:25.416624+0000","last_unstale":"2026-02-17T11:49:25.417054+0000","last_undegraded":"2026-02-17T11:49:25.417054+0000","last_fullsized":"2026-02-17T11:49:25.417054+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:49:24.264091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:49:24.264091+0000","last_clean_scrub_stamp":"2026-02-17T11:49:24.264091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:00:58.964677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-17T11:49:26.271799+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:49:26.271799+0000","last_peered":"2026-02-17T11:49:26.271799+0000","last_clean":"2026-02-17T11:49:26.271799+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:49:26.271799+0000","last_undegraded":"2026-02-17T11:49:26.271799+0000","last_fullsized":"2026-02-17T11:49:26.271799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":552960,"data_stored":175785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640341,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":577536,"data_stored":185839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673045,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":577536,"data_stored":185839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705751,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":569344,"data_stored":182497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:49:37.129 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:49:37.130 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:49:37.130 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:49:37.130 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T11:49:37.221 INFO:teuthology.orchestra.run.trial078.stdout:38654705753 2026-02-17T11:49:37.221 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:37.222 INFO:teuthology.orchestra.run.trial078.stdout:51539607639 2026-02-17T11:49:37.223 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:37.224 INFO:teuthology.orchestra.run.trial078.stdout:47244640343 2026-02-17T11:49:37.224 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:37.225 INFO:teuthology.orchestra.run.trial078.stdout:42949673047 2026-02-17T11:49:37.226 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:37.423 INFO:teuthology.orchestra.run.trial078.stdout:51539607638 2026-02-17T11:49:37.424 INFO:teuthology.orchestra.run.trial078.stdout:38654705752 2026-02-17T11:49:37.429 INFO:teuthology.orchestra.run.trial078.stdout:42949673046 2026-02-17T11:49:37.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607639 got 51539607638 for osd.1 2026-02-17T11:49:37.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705753 got 38654705752 for osd.2 2026-02-17T11:49:37.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673047 got 42949673046 for osd.3 2026-02-17T11:49:38.433 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:38.434 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:38.440 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T11:49:38.592 INFO:teuthology.orchestra.run.trial078.stdout:51539607639 2026-02-17T11:49:38.595 INFO:teuthology.orchestra.run.trial078.stdout:38654705754 2026-02-17T11:49:38.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607639 got 51539607639 for osd.1 2026-02-17T11:49:38.603 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:38.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705753 got 38654705754 for osd.2 2026-02-17T11:49:38.605 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:38.638 INFO:teuthology.orchestra.run.trial078.stdout:42949673048 2026-02-17T11:49:38.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673047 got 42949673048 for osd.3 2026-02-17T11:49:38.648 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:40.421 INFO:teuthology.orchestra.run.trial078.stdout:47244640344 2026-02-17T11:49:40.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640343 got 47244640344 for osd.0 2026-02-17T11:49:40.431 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:40.431 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:49:40.588 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:49:40.588 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:49:40.596 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2026-02-17T11:49:40.209152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":110116,"kb_used_data":2256,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377244,"statfs":{"total":386547056640,"available":386434297856,"internally_reserved":0,"allocated":2310144,"data_stored":743356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-17T11:49:29.421578+0000","last_change":"2026-02-17T11:49:25.416732+0000","last_active":"2026-02-17T11:49:29.421578+0000","last_peered":"2026-02-17T11:49:29.421578+0000","last_clean":"2026-02-17T11:49:29.421578+0000","last_became_active":"2026-02-17T11:49:25.416624+0000","last_became_peered":"2026-02-17T11:49:25.416624+0000","last_unstale":"2026-02-17T11:49:29.421578+0000","last_undegraded":"2026-02-17T11:49:29.421578+0000","last_fullsized":"2026-02-17T11:49:29.421578+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:49:24.264091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:49:24.264091+0000","last_clean_scrub_stamp":"2026-02-17T11:49:24.264091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:56:13.659701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-17T11:49:26.271799+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:49:26.271799+0000","last_peered":"2026-02-17T11:49:26.271799+0000","last_clean":"2026-02-17T11:49:26.271799+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:49:26.271799+0000","last_undegraded":"2026-02-17T11:49:26.271799+0000","last_fullsized":"2026-02-17T11:49:26.271799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607639,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":577536,"data_stored":185839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640344,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":577536,"data_stored":185839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673048,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":577536,"data_stored":185839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705754,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":577536,"data_stored":185839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:49:40.597 INFO:tasks.osd_max_pg_per_osd:3. mark an osd out 2026-02-17T11:49:40.597 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:49:40.750 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:49:40.750 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:49:40.758 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2026-02-17T11:49:40.209152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":110116,"kb_used_data":2256,"kb_used_omap":6,"kb_used_meta":107769,"kb_avail":377377244,"statfs":{"total":386547056640,"available":386434297856,"internally_reserved":0,"allocated":2310144,"data_stored":743356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6374,"internal_metadata":110356250},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-17T11:49:29.421578+0000","last_change":"2026-02-17T11:49:25.416732+0000","last_active":"2026-02-17T11:49:29.421578+0000","last_peered":"2026-02-17T11:49:29.421578+0000","last_clean":"2026-02-17T11:49:29.421578+0000","last_became_active":"2026-02-17T11:49:25.416624+0000","last_became_peered":"2026-02-17T11:49:25.416624+0000","last_unstale":"2026-02-17T11:49:29.421578+0000","last_undegraded":"2026-02-17T11:49:29.421578+0000","last_fullsized":"2026-02-17T11:49:29.421578+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:49:24.264091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:49:24.264091+0000","last_clean_scrub_stamp":"2026-02-17T11:49:24.264091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:56:13.659701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-17T11:49:26.271799+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:49:26.271799+0000","last_peered":"2026-02-17T11:49:26.271799+0000","last_clean":"2026-02-17T11:49:26.271799+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:49:26.271799+0000","last_undegraded":"2026-02-17T11:49:26.271799+0000","last_fullsized":"2026-02-17T11:49:26.271799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607639,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":577536,"data_stored":185839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640344,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":577536,"data_stored":185839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":10,"seq":42949673048,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":577536,"data_stored":185839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705754,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":577536,"data_stored":185839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:49:40.759 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2026-02-17T11:49:40.919 INFO:tasks.ceph.mon.a.trial078.stderr:2026-02-17T11:49:40.918+0000 7ffaf8eae640 -1 mon.a@0(leader).osd e63 definitely_dead 0 2026-02-17T11:49:41.283 INFO:teuthology.orchestra.run.trial078.stderr:marked out osd.3. 2026-02-17T11:49:41.297 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:49:41.454 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:49:41.454 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":64,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:49:41.280483+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:49:41.280483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"unique_pool_0","create_time":"2026-02-17T11:45:10.130991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"unique_pool_14","create_time":"2026-02-17T11:49:23.435354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":65536,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:49:41.463 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:49:41.464 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:49:41.464 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:49:41.549 INFO:teuthology.orchestra.run.trial078.stdout:38654705755 2026-02-17T11:49:41.550 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:41.551 INFO:teuthology.orchestra.run.trial078.stdout:47244640345 2026-02-17T11:49:41.552 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:41.553 INFO:teuthology.orchestra.run.trial078.stdout:51539607641 2026-02-17T11:49:41.553 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:41.749 INFO:teuthology.orchestra.run.trial078.stdout:51539607639 2026-02-17T11:49:41.751 INFO:teuthology.orchestra.run.trial078.stdout:38654705754 2026-02-17T11:49:41.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607641 got 51539607639 for osd.1 2026-02-17T11:49:41.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705755 got 38654705754 for osd.2 2026-02-17T11:49:42.759 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:42.760 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:42.919 INFO:teuthology.orchestra.run.trial078.stdout:38654705755 2026-02-17T11:49:42.921 INFO:teuthology.orchestra.run.trial078.stdout:51539607641 2026-02-17T11:49:42.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705755 got 38654705755 for osd.2 2026-02-17T11:49:42.929 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:42.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607641 got 51539607641 for osd.1 2026-02-17T11:49:42.931 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:44.750 INFO:teuthology.orchestra.run.trial078.stdout:47244640346 2026-02-17T11:49:44.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640345 got 47244640346 for osd.0 2026-02-17T11:49:44.760 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:44.760 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:49:47.915 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:49:47.916 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:49:47.924 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2026-02-17T11:49:46.210067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82632,"kb_used_data":1732,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283032888,"statfs":{"total":289910292480,"available":289825677312,"internally_reserved":0,"allocated":1773568,"data_stored":572780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"15.0","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"activating","last_fresh":"2026-02-17T11:49:42.286592+0000","last_change":"2026-02-17T11:49:42.286662+0000","last_active":"2026-02-17T11:49:41.284653+0000","last_peered":"2026-02-17T11:49:29.421594+0000","last_clean":"2026-02-17T11:49:29.421594+0000","last_became_active":"2026-02-17T11:49:25.416624+0000","last_became_peered":"2026-02-17T11:49:25.416624+0000","last_unstale":"2026-02-17T11:49:42.286592+0000","last_undegraded":"2026-02-17T11:49:42.286592+0000","last_fullsized":"2026-02-17T11:49:42.286592+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:49:24.264091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:49:24.264091+0000","last_clean_scrub_stamp":"2026-02-17T11:49:24.264091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":102,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-17T11:49:42.285635+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:49:42.285635+0000","last_peered":"2026-02-17T11:49:42.285635+0000","last_clean":"2026-02-17T11:49:42.285635+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:49:42.285635+0000","last_undegraded":"2026-02-17T11:49:42.285635+0000","last_fullsized":"2026-02-17T11:49:42.285635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607642,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640346,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":42949673049,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705756,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":585728,"data_stored":188920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:49:53.926 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T11:49:53.927 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T11:49:53.927 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T11:49:54.014 INFO:teuthology.orchestra.run.trial078.stdout:38654705759 2026-02-17T11:49:54.015 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:54.016 INFO:teuthology.orchestra.run.trial078.stdout:51539607644 2026-02-17T11:49:54.016 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:54.213 INFO:teuthology.orchestra.run.trial078.stdout:38654705757 2026-02-17T11:49:54.213 INFO:teuthology.orchestra.run.trial078.stdout:51539607643 2026-02-17T11:49:54.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705759 got 38654705757 for osd.2 2026-02-17T11:49:54.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607644 got 51539607643 for osd.1 2026-02-17T11:49:55.224 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T11:49:55.225 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T11:49:55.384 INFO:teuthology.orchestra.run.trial078.stdout:51539607644 2026-02-17T11:49:55.385 INFO:teuthology.orchestra.run.trial078.stdout:38654705759 2026-02-17T11:49:55.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607644 got 51539607644 for osd.1 2026-02-17T11:49:55.395 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:55.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705759 got 38654705759 for osd.2 2026-02-17T11:49:55.396 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:57.015 INFO:teuthology.orchestra.run.trial078.stdout:47244640350 2026-02-17T11:49:57.015 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:57.173 INFO:teuthology.orchestra.run.trial078.stdout:47244640349 2026-02-17T11:49:57.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640350 got 47244640349 for osd.0 2026-02-17T11:49:58.183 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:58.340 INFO:teuthology.orchestra.run.trial078.stdout:47244640349 2026-02-17T11:49:58.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640350 got 47244640349 for osd.0 2026-02-17T11:49:59.349 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T11:49:59.506 INFO:teuthology.orchestra.run.trial078.stdout:47244640350 2026-02-17T11:49:59.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640350 got 47244640350 for osd.0 2026-02-17T11:49:59.514 DEBUG:teuthology.parallel:result is None 2026-02-17T11:49:59.515 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:49:59.671 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:49:59.671 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:49:59.680 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2026-02-17T11:49:58.211437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82644,"kb_used_data":1740,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283032876,"statfs":{"total":289910292480,"available":289825665024,"internally_reserved":0,"allocated":1781760,"data_stored":575790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"15.0","version":"0'0","reported_seq":15,"reported_epoch":65,"state":"activating","last_fresh":"2026-02-17T11:49:42.286592+0000","last_change":"2026-02-17T11:49:42.286662+0000","last_active":"2026-02-17T11:49:41.284653+0000","last_peered":"2026-02-17T11:49:29.421594+0000","last_clean":"2026-02-17T11:49:29.421594+0000","last_became_active":"2026-02-17T11:49:25.416624+0000","last_became_peered":"2026-02-17T11:49:25.416624+0000","last_unstale":"2026-02-17T11:49:42.286592+0000","last_undegraded":"2026-02-17T11:49:42.286592+0000","last_fullsized":"2026-02-17T11:49:42.286592+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:49:24.264091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:49:24.264091+0000","last_clean_scrub_stamp":"2026-02-17T11:49:24.264091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":102,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-17T11:49:42.285635+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:49:42.285635+0000","last_peered":"2026-02-17T11:49:42.285635+0000","last_clean":"2026-02-17T11:49:42.285635+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:49:42.285635+0000","last_undegraded":"2026-02-17T11:49:42.285635+0000","last_fullsized":"2026-02-17T11:49:42.285635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607645,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640350,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":42949673052,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705760,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:49:59.681 INFO:tasks.osd_max_pg_per_osd:4. removing pool.b 2026-02-17T11:49:59.681 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_14 2026-02-17T11:49:59.681 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_14 unique_pool_14 --yes-i-really-really-mean-it 2026-02-17T11:50:00.352 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_14' removed 2026-02-17T11:50:00.363 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:50:00.364 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:00.519 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:50:00.520 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:50:00.528 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2026-02-17T11:50:00.351734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82644,"kb_used_data":1740,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283032876,"statfs":{"total":289910292480,"available":289825665024,"internally_reserved":0,"allocated":1781760,"data_stored":575790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":102,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-17T11:49:42.285635+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:49:42.285635+0000","last_peered":"2026-02-17T11:49:42.285635+0000","last_clean":"2026-02-17T11:49:42.285635+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:49:42.285635+0000","last_undegraded":"2026-02-17T11:49:42.285635+0000","last_fullsized":"2026-02-17T11:49:42.285635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607645,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640351,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":42949673052,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705760,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:50:00.529 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:00.682 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:50:00.683 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:50:00.691 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2026-02-17T11:50:00.351734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82644,"kb_used_data":1740,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283032876,"statfs":{"total":289910292480,"available":289825665024,"internally_reserved":0,"allocated":1781760,"data_stored":575790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":102,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-17T11:49:42.285635+0000","last_change":"2026-02-17T11:45:12.737691+0000","last_active":"2026-02-17T11:49:42.285635+0000","last_peered":"2026-02-17T11:49:42.285635+0000","last_clean":"2026-02-17T11:49:42.285635+0000","last_became_active":"2026-02-17T11:45:12.737516+0000","last_became_peered":"2026-02-17T11:45:12.737516+0000","last_unstale":"2026-02-17T11:49:42.285635+0000","last_undegraded":"2026-02-17T11:49:42.285635+0000","last_fullsized":"2026-02-17T11:49:42.285635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T11:45:10.468836+0000","last_clean_scrub_stamp":"2026-02-17T11:45:10.468836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:18:45.398611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607645,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640351,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":42949673052,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705760,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T11:50:00.691 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:50:00.692 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-17T11:50:00.692 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-17T11:50:01.355 INFO:teuthology.orchestra.run.trial078.stderr:pool 'unique_pool_0' removed 2026-02-17T11:50:01.366 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T11:50:01.380 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T11:50:01.380 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:01.537 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:50:01.537 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:50:01.546 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2026-02-17T11:50:01.355019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82644,"kb_used_data":1740,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283032876,"statfs":{"total":289910292480,"available":289825665024,"internally_reserved":0,"allocated":1781760,"data_stored":575790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607646,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640351,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":42949673052,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705760,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T11:50:01.547 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:01.702 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:50:01.702 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:50:01.710 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2026-02-17T11:50:01.355019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82644,"kb_used_data":1740,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283032876,"statfs":{"total":289910292480,"available":289825665024,"internally_reserved":0,"allocated":1781760,"data_stored":575790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607646,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640351,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":42949673052,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705760,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T11:50:01.710 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T11:50:01.711 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:01.864 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:50:01.864 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:50:01.872 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2026-02-17T11:50:01.355019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82644,"kb_used_data":1740,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283032876,"statfs":{"total":289910292480,"available":289825665024,"internally_reserved":0,"allocated":1781760,"data_stored":575790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607646,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640351,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":42949673052,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705760,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":593920,"data_stored":191930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T11:50:01.873 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T11:50:02.027 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:50:02.027 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":67,"fsid":"236d14d8-98ee-4890-8151-1dbd079b8475","created":"2026-02-17T11:44:51.952927+0000","modified":"2026-02-17T11:50:01.351888+0000","last_up_change":"2026-02-17T11:45:04.455262+0000","last_in_change":"2026-02-17T11:49:41.280483+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bb321727-43bc-4ca3-9b42-040be5f268f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6813","nonce":2165213675}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6814","nonce":2165213675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6816","nonce":2165213675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6815","nonce":2165213675}]},"public_addr":"10.20.193.78:6813/2165213675","cluster_addr":"10.20.193.78:6814/2165213675","heartbeat_back_addr":"10.20.193.78:6816/2165213675","heartbeat_front_addr":"10.20.193.78:6815/2165213675","state":["exists","up"]},{"osd":1,"uuid":"2407ef90-24c0-4ef2-9b6c-0b2ad56ed49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6805","nonce":3299577819}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6806","nonce":3299577819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6808","nonce":3299577819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6807","nonce":3299577819}]},"public_addr":"10.20.193.78:6805/3299577819","cluster_addr":"10.20.193.78:6806/3299577819","heartbeat_back_addr":"10.20.193.78:6808/3299577819","heartbeat_front_addr":"10.20.193.78:6807/3299577819","state":["exists","up"]},{"osd":2,"uuid":"a6b0b09b-97e0-41cd-818d-b6f45aef9175","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6801","nonce":4205817860}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6802","nonce":4205817860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6804","nonce":4205817860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6803","nonce":4205817860}]},"public_addr":"10.20.193.78:6801/4205817860","cluster_addr":"10.20.193.78:6802/4205817860","heartbeat_back_addr":"10.20.193.78:6804/4205817860","heartbeat_front_addr":"10.20.193.78:6803/4205817860","state":["exists","up"]},{"osd":3,"uuid":"68b5ed55-d078-4536-a06a-86fa9340cfe3","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6809","nonce":3461480126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6810","nonce":3461480126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6812","nonce":3461480126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.78:6811","nonce":3461480126}]},"public_addr":"10.20.193.78:6809/3461480126","cluster_addr":"10.20.193.78:6810/3461480126","heartbeat_back_addr":"10.20.193.78:6812/3461480126","heartbeat_front_addr":"10.20.193.78:6811/3461480126","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.846304+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.368385+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T11:44:59.395695+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":65536,"last_purged_snaps_scrub":"2026-02-17T11:45:00.074992+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T11:50:03.037 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T11:50:03.037 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:50:03.118 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-17T11:50:03.118 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:50:03.118 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-17T11:50:03.125 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T11:50:03.282 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T11:50:03.291 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T11:50:03.291 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:50:03.373 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-17T11:50:03.374 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:50:03.374 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-17T11:50:03.380 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T11:50:03.536 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T11:50:03.544 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T11:50:03.545 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:50:03.623 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-17T11:50:03.623 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:50:03.623 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-17T11:50:03.629 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T11:50:07.701 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T11:50:07.714 INFO:tasks.ceph:Scrubbing osd.3 2026-02-17T11:50:07.714 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-17T11:50:07.792 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-17T11:50:07.792 INFO:teuthology.orchestra.run.trial078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T11:50:07.792 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-17T11:50:07.797 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-17T11:50:07.952 INFO:teuthology.orchestra.run.trial078.stderr:instructed osd(s) 3 to deep-scrub 2026-02-17T11:50:07.960 DEBUG:teuthology.orchestra.run.trial078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T11:50:08.119 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-17T11:50:08.120 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-17T11:50:08.127 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2026-02-17T11:50:06.212299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":86856,"kb_used_data":1800,"kb_used_omap":4,"kb_used_meta":84987,"kb_avail":283028664,"statfs":{"total":289910292480,"available":289821351936,"internally_reserved":0,"allocated":1843200,"data_stored":590108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87027026},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[],"pool_stats":[],"osd_stats":[{"osd":1,"up_from":12,"seq":51539607647,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27568,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":618496,"data_stored":197584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640352,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31732,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":618496,"data_stored":197584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":42949673053,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705761,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27556,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":606208,"data_stored":194940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2026-02-17T11:50:08.128 DEBUG:teuthology.orchestra.run.trial078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T11:50:08.294 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T11:50:08.295 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T11:50:08.295 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T11:50:08.295 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:50:08.337 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T11:50:08.337 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T11:50:08.337 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:50:08.364 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T11:50:08.364 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T11:50:08.365 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:50:08.438 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T11:50:08.439 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-17T11:50:08.439 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:50:08.507 INFO:tasks.ceph.osd.3:Stopped 2026-02-17T11:50:08.507 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T11:50:08.508 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T11:50:08.508 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:50:08.577 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T11:50:08.578 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T11:50:08.578 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T11:50:08.578 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T11:50:08.627 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T11:50:08.627 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T11:50:08.628 DEBUG:teuthology.orchestra.run.trial078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v '\(PG_' | egrep -v '\(PENDING_CREATING_PGS\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v '\(MON_DOWN\)' | head -n 1 2026-02-17T11:50:08.693 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial078.front.sepia.ceph.com 2026-02-17T11:50:08.694 DEBUG:teuthology.orchestra.run.trial078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T11:50:08.768 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial078.front.sepia.ceph.com 2026-02-17T11:50:08.768 DEBUG:teuthology.orchestra.run.trial078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T11:50:08.839 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial078.front.sepia.ceph.com 2026-02-17T11:50:08.840 DEBUG:teuthology.orchestra.run.trial078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T11:50:08.914 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial078.front.sepia.ceph.com 2026-02-17T11:50:08.914 DEBUG:teuthology.orchestra.run.trial078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-17T11:50:08.983 INFO:tasks.ceph:Archiving mon data... 2026-02-17T11:50:08.984 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51339/data/mon.a.tgz 2026-02-17T11:50:08.985 DEBUG:teuthology.orchestra.run.trial078:> mktemp 2026-02-17T11:50:09.039 INFO:teuthology.orchestra.run.trial078.stdout:/tmp/tmp.Ff74CV6RES 2026-02-17T11:50:09.039 DEBUG:teuthology.orchestra.run.trial078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Ff74CV6RES 2026-02-17T11:50:09.132 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 0666 /tmp/tmp.Ff74CV6RES 2026-02-17T11:50:09.216 DEBUG:teuthology.orchestra.remote:trial078:/tmp/tmp.Ff74CV6RES is 236KB 2026-02-17T11:50:09.311 DEBUG:teuthology.orchestra.run.trial078:> rm -fr /tmp/tmp.Ff74CV6RES 2026-02-17T11:50:09.328 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T11:50:09.328 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T11:50:09.448 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T11:50:09.448 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T11:50:09.450 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51339/remote/trial078/crash 2026-02-17T11:50:09.451 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T11:50:09.514 INFO:tasks.ceph:Compressing logs... 2026-02-17T11:50:09.514 DEBUG:teuthology.orchestra.run.trial078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:50:09.578 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57313.log 2026-02-17T11:50:09.660 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62270.log 2026-02-17T11:50:09.660 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48013.log 2026-02-17T11:50:09.660 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57313.log.gz 2026-02-17T11:50:09.660 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62270.log.gz 2026-02-17T11:50:09.660 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52581.log 2026-02-17T11:50:09.660 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48013.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T11:50:09.660 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48013.log.gz 2026-02-17T11:50:09.660 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68154.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52581.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56147.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68154.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63245.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69482.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56147.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63245.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56021.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69482.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56021.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56343.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62071.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56343.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74705.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72138.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62071.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74705.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47520.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72138.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54400.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50344.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.47520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47520.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54400.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49240.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53417.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50344.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49240.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52157.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49928.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53417.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66903.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52157.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49928.log.gz 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74071.log 2026-02-17T11:50:09.661 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66903.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58916.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55742.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74071.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58916.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58916.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48014.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55742.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63414.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48014.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75195.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50098.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63414.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.75195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68650.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75195.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50098.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48216.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50100.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68650.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58740.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48216.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50100.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74179.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58740.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69699.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60210.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74179.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64139.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69699.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60210.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70189.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57264.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64139.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70189.log.gz 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69601.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51057.log 2026-02-17T11:50:09.662 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57264.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69601.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49463.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52583.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51057.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73116.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49463.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52583.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63244.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67451.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73116.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67817.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63244.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67451.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70518.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64138.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67817.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54203.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70518.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64138.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63938.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71300.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54203.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63938.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63938.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71300.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74070.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66596.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74070.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70883.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51355.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66596.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70883.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51890.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51355.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66196.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51890.log.gz 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71704.log 2026-02-17T11:50:09.663 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52780.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66196.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67932.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71704.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60259.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52780.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55193.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67932.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75293.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60259.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54401.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55193.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.75293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65409.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75293.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60735.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54401.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65409.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53876.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60539.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60735.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.53876.log: -- /var/log/ceph/ceph-client.admin.57215.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53876.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58789.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60539.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57215.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.53742.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57215.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63743.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58789.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65577.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53742.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48524.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63743.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64250.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65577.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53558.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48524.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64250.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50488.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50719.log 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53558.log.gz 2026-02-17T11:50:09.664 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68653.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50488.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70712.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50719.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56556.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68653.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66390.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70712.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58002.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56556.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74999.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66390.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51694.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58002.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64978.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74999.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49734.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51694.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63742.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64978.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49929.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49734.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69288.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63742.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73380.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49929.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70517.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69288.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51551.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73380.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59529.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70517.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56952.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51551.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63103.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59529.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58436.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56952.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67815.log 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63103.log.gz 2026-02-17T11:50:09.665 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59947.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58436.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65233.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67815.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64573.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59947.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74276.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65233.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71070.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64573.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70065.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74276.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71070.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54204.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51963.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70065.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74852.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54204.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51963.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62906.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53616.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74852.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72539.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62906.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52059.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53616.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71703.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72539.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63564.log 0.0% 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52059.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55036.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71703.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73316.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63564.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51550.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55036.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53415.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73316.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62608.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51550.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75244.log 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53415.log.gz 2026-02-17T11:50:09.666 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62607.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62608.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.75244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56950.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75244.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49305.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62607.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65282.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56950.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49305.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54398.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68848.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65282.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60360.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54398.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48671.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68848.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55644.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60360.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73255.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48671.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67344.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55644.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63939.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73255.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71907.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67344.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55843.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63939.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72641.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71907.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69486.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55843.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64769.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72641.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69042.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69486.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60941.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64769.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58917.log 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69042.log.gz 2026-02-17T11:50:09.667 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60941.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48413.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71495.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58917.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66609.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48413.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:gzip/var/log/ceph/ceph-client.admin.71495.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.71172.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71495.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53221.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66609.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43574.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71172.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67201.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53221.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.43574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54399.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43574.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67201.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.67201.log.gz -- 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: /var/log/ceph/ceph-client.admin.69993.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67241.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54399.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73256.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69993.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73968.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67241.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73117.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73256.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70131.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73968.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72340.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73117.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63463.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70131.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57708.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72340.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75146.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63463.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54205.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57708.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.75146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43463.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75146.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54205.log.gz 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69797.log 2026-02-17T11:50:09.668 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51226.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.43463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43463.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48015.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69797.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50718.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51226.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48015.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56457.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51753.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50718.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58435.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56457.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56148.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51753.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69160.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58435.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64080.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56148.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49096.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69160.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72307.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64080.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49096.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73776.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67202.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72307.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57709.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73776.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53414.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67202.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57709.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73630.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56951.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53414.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57896.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73630.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49931.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56951.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73884.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57896.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68155.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49931.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56754.log 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73884.log.gz 2026-02-17T11:50:09.669 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63101.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68155.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59948.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56754.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62777.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63101.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55315.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59948.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59034.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62777.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65575.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55315.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61794.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59034.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49733.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65575.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51354.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61794.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61434.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49733.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70713.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51354.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57136.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61434.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60939.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70713.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66017.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57136.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60939.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56344.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58289.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66017.log: /var/log/ceph/ceph-client.admin.56344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66017.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50270.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56344.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61843.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58289.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50331.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50270.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48158.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61843.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48723.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50331.log.gz 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61507.log 2026-02-17T11:50:09.670 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48158.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48723.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59750.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48412.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61507.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57543.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59750.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52790.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48412.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56245.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57543.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67407.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52790.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62269.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56245.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54026.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67407.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62486.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62269.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54026.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37593.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54026.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70339.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62486.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph.tmp-client.admin.37593.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37593.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55194.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59749.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70339.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50589.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55194.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53925.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59749.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55038.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50589.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59304.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53925.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55038.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43837.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65181.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59304.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.43837.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.43837.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65410.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65181.log.gz 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66393.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55195.log 2026-02-17T11:50:09.671 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65410.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56755.log 0.0% 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66393.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55195.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69287.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66389.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56755.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64576.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69287.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66389.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.66389.log.gz /var/log/ceph/ceph-client.admin.58132.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64576.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50914.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57544.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58132.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68846.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50914.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57544.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74409.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72136.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68846.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74277.log 0.0% 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74409.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72136.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70997.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64887.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74277.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70997.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69698.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51356.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64887.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63741.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69698.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48622.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51356.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64081.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63741.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60538.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48622.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71302.log 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64081.log.gz 2026-02-17T11:50:09.672 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60538.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63740.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49095.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71302.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68422.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63740.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49095.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63613.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43790.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68422.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62905.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63613.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.43790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43790.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64346.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62905.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73114.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62665.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64346.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70515.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73114.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62665.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49304.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58590.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70515.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48772.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49304.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58918.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58590.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71299.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48772.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49605.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58918.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69485.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71299.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43743.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49605.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65696.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69485.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.43743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62411.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43743.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52387.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65696.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52108.log 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62411.log.gz 2026-02-17T11:50:09.673 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57705.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52387.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70516.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52108.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52209.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57705.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56020.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70516.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69853.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52209.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65875.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56020.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57138.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69853.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65132.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65875.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72705.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57138.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68652.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65132.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56756.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72705.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71099.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68652.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56756.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49097.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64575.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71099.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59946.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49097.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66599.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64575.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51754.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59946.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62073.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66599.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60308.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51754.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47820.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62073.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73885.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60308.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.47820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47820.log.gz 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67536.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74950.log 2026-02-17T11:50:09.674 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73885.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50912.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67536.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50540.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74950.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50912.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52895.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50540.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55510.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49732.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52895.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65697.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55510.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49732.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47821.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48233.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65697.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.47821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58919.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47821.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59137.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48233.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47818.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58919.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50175.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59137.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.47818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72305.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47818.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73628.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50175.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70714.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72305.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74507.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73628.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47819.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70714.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51549.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74507.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.47819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71498.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47819.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55499.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51549.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72135.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71498.log.gz 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47642.log 2026-02-17T11:50:09.675 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55499.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55791.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72135.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.47642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61340.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47642.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59296.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55791.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61340.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.61340.log.gz --verbose 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr: -- /var/log/ceph/ceph-client.admin.74803.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59296.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74754.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54516.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74803.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74754.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61174.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60409.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54516.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62266.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61174.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50269.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60409.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60933.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62266.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67816.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50269.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54712.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60933.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64574.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67816.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54712.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54202.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64574.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61046.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54202.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72137.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61046.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51131.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72137.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63102.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51131.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54598.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63102.log.gz 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62412.log 2026-02-17T11:50:09.676 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54598.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69289.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69044.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62412.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69289.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72920.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69044.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48159.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip/var/log/ceph/ceph-client.admin.72920.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48354.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72920.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48159.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73527.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48354.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67200.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73527.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69902.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67200.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51889.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69902.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55035.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51889.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61176.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55035.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68014.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61176.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54908.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52958.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68014.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54908.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47593.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52958.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52958.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.47593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47593.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49409.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55595.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70056.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49409.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55595.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61696.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60537.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70056.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61696.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61696.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73118.log 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60537.log.gz 2026-02-17T11:50:09.677 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48900.log 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54075.log 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73118.log.gz 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65411.log 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48900.log.gz 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54075.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.54075.log.gz -5 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59091.log 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72548.log 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65411.log.gz 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59091.log.gz 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65968.log 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64446.log 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72548.log.gz 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68849.log 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65968.log.gz 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64446.log.gz 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66194.log 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68849.log.gz 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72922.log 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66194.log.gz 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71702.log 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66066.log 2026-02-17T11:50:09.678 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72922.log.gz 2026-02-17T11:50:09.685 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71702.log.gz 2026-02-17T11:50:09.685 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48017.log 2026-02-17T11:50:09.685 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66066.log.gz 2026-02-17T11:50:09.685 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53091.log 2026-02-17T11:50:09.685 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48017.log.gz 2026-02-17T11:50:09.685 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61944.log 2026-02-17T11:50:09.685 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57843.log 2026-02-17T11:50:09.685 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53091.log.gz 2026-02-17T11:50:09.685 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61944.log.gz 2026-02-17T11:50:09.685 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49239.log 2026-02-17T11:50:09.685 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57843.log.gz 2026-02-17T11:50:09.685 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69045.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49239.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56246.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57365.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69045.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56246.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74556.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57365.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67612.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74556.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71809.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67612.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.63302.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67612.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71809.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74360.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63302.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51056.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74360.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59489.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53743.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51056.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59489.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55892.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68013.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53743.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55892.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57538.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53219.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68013.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57538.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57064.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53219.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71496.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57064.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50913.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71496.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50717.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56627.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50913.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50717.log.gz 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68324.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56627.log.gzgzip 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48899.log 2026-02-17T11:50:09.686 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68324.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60731.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48899.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.48899.log.gz --verbose 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr: -- /var/log/ceph/ceph-client.admin.69043.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64968.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60731.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69043.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64340.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51552.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64968.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48355.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64340.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51552.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60122.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48355.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68474.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60122.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49465.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68474.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68021.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49465.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71959.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68021.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60059.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71959.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62072.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60059.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70852.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52699.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62072.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72792.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70852.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52699.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64772.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.72792.log: -- /var/log/ceph/ceph-client.admin.73629.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72792.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64772.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53218.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59230.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73629.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53218.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65576.log 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59230.log.gz 2026-02-17T11:50:09.687 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59490.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65576.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69701.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52258.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59490.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69701.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58541.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66508.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52258.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58541.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66753.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66508.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61895.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66753.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57794.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61895.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75389.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56757.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57794.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.75389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75389.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49098.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72921.log 0.0% 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56757.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49098.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61341.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70968.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72921.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61341.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70711.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54597.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70968.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70711.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74656.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50915.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54597.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74656.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53617.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69483.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50915.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53617.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73777.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75097.log 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69483.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73777.log.gz 2026-02-17T11:50:09.688 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67032.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.75097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51130.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75097.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67032.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44290.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51130.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61175.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.44290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58130.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44290.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61175.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63936.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63937.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58130.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63936.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55365.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52783.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63937.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55365.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51353.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75048.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52783.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51353.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51964.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73775.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.75048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75048.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.51964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51964.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65747.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50716.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73775.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65747.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.65747.log.gz -5 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60123.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50716.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52582.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64770.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60123.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52582.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61634.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61508.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64770.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61634.log.gz 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74458.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72008.log 2026-02-17T11:50:09.689 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61508.log.gz 2026-02-17T11:50:09.691 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74458.log.gz 2026-02-17T11:50:09.691 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72306.log 2026-02-17T11:50:09.691 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54769.log 2026-02-17T11:50:09.691 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72008.log.gz 2026-02-17T11:50:09.691 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72306.log.gz 2026-02-17T11:50:09.691 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69852.log 2026-02-17T11:50:09.691 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58287.log 2026-02-17T11:50:09.691 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54769.log.gz 2026-02-17T11:50:09.691 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69852.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74069.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65843.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58287.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74069.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58434.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48573.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65843.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58434.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53774.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59622.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48573.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53774.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61585.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69290.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59622.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61585.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62074.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.69290.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.69290.log.gz /var/log/ceph/ceph-client.admin.53974.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62074.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48902.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73478.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53974.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48902.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56555.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73478.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66392.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56555.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53416.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66392.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59752.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53416.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71497.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43884.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59752.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71497.log.gz 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55037.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.43884.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.74606.log 2026-02-17T11:50:09.692 INFO:teuthology.orchestra.run.trial078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43884.log.gz 2026-02-17T11:50:09.693 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55037.log.gz 2026-02-17T11:50:09.693 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57953.log 2026-02-17T11:50:09.693 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74606.log.gz 2026-02-17T11:50:09.693 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49930.log 2026-02-17T11:50:09.693 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57953.log.gz 2026-02-17T11:50:09.693 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55693.log 2026-02-17T11:50:09.693 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53000.log 2026-02-17T11:50:09.693 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49930.log.gz 2026-02-17T11:50:09.693 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55693.log.gz 2026-02-17T11:50:09.693 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47691.log 2026-02-17T11:50:09.693 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72919.log 2026-02-17T11:50:09.693 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53000.log.gz 2026-02-17T11:50:09.694 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.47691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47691.log.gz 2026-02-17T11:50:09.694 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65844.log 2026-02-17T11:50:09.694 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72919.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T11:50:09.694 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72919.log.gz 2026-02-17T11:50:09.694 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65844.log.gz 2026-02-17T11:50:09.694 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66195.log 2026-02-17T11:50:09.694 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67413.log 2026-02-17T11:50:09.694 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66195.log.gz 2026-02-17T11:50:09.694 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66197.log 2026-02-17T11:50:09.694 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71301.log 2026-02-17T11:50:09.694 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67413.log.gz 2026-02-17T11:50:09.695 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66197.log.gz 2026-02-17T11:50:09.695 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62666.log 2026-02-17T11:50:09.695 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55314.log 2026-02-17T11:50:09.695 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71301.log.gz 2026-02-17T11:50:09.695 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62666.log.gz 2026-02-17T11:50:09.695 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72449.log 2026-02-17T11:50:09.696 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68523.log 2026-02-17T11:50:09.696 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55314.log.gz 2026-02-17T11:50:09.696 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72449.log.gz 2026-02-17T11:50:09.696 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65412.log 2026-02-17T11:50:09.696 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68523.log.gz 2026-02-17T11:50:09.696 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67030.log 2026-02-17T11:50:09.696 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65412.log.gz 2026-02-17T11:50:09.696 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56953.log 2026-02-17T11:50:09.696 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67030.log.gz 2026-02-17T11:50:09.696 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52388.log 2026-02-17T11:50:09.697 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56953.log.gz 2026-02-17T11:50:09.697 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64969.log 2026-02-17T11:50:09.697 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52388.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.52388.log.gz -5 2026-02-17T11:50:09.697 INFO:teuthology.orchestra.run.trial078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67687.log 2026-02-17T11:50:09.697 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64969.log.gz 2026-02-17T11:50:09.697 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68273.log 2026-02-17T11:50:09.698 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67687.log.gz 2026-02-17T11:50:09.698 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49735.log 2026-02-17T11:50:09.698 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62268.log 2026-02-17T11:50:09.698 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68273.log.gz 2026-02-17T11:50:09.698 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49735.log.gz 2026-02-17T11:50:09.698 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52385.log 2026-02-17T11:50:09.698 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62268.log.gz 2026-02-17T11:50:09.698 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68651.log 2026-02-17T11:50:09.698 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52385.log.gz 2026-02-17T11:50:09.699 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60734.log 2026-02-17T11:50:09.699 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67031.log 2026-02-17T11:50:09.699 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68651.log.gz 2026-02-17T11:50:09.699 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60734.log.gz 2026-02-17T11:50:09.699 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66704.log 2026-02-17T11:50:09.699 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67031.log.gz 2026-02-17T11:50:09.699 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67583.log 2026-02-17T11:50:09.699 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66704.log.gz 2026-02-17T11:50:09.700 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50439.log 2026-02-17T11:50:09.700 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67583.log.gz 2026-02-17T11:50:09.700 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70388.log 2026-02-17T11:50:09.700 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50439.log.gz 2026-02-17T11:50:09.700 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68202.log 2026-02-17T11:50:09.700 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70388.log.gz 2026-02-17T11:50:09.700 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60850.log 2026-02-17T11:50:09.700 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68202.log.gz 2026-02-17T11:50:09.701 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67814.log 2026-02-17T11:50:09.701 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60850.log.gz 2026-02-17T11:50:09.701 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71613.log 2026-02-17T11:50:09.701 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67814.log.gz 2026-02-17T11:50:09.701 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49513.log 2026-02-17T11:50:09.701 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71613.log.gz 2026-02-17T11:50:09.701 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61745.log 2026-02-17T11:50:09.701 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.49513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49513.log.gz 2026-02-17T11:50:09.701 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54776.log 2026-02-17T11:50:09.702 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61745.log.gz 2026-02-17T11:50:09.702 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74901.log 2026-02-17T11:50:09.702 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54776.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T11:50:09.702 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54776.log.gz 2026-02-17T11:50:09.702 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74901.log.gz 2026-02-17T11:50:09.702 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58128.log 2026-02-17T11:50:09.703 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53559.log 2026-02-17T11:50:09.703 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58128.log.gz 2026-02-17T11:50:09.703 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70287.log 2026-02-17T11:50:09.703 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53559.log: 87.1% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T11:50:09.703 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53559.log.gz 2026-02-17T11:50:09.703 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59945.log 2026-02-17T11:50:09.703 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70287.log.gz 2026-02-17T11:50:09.703 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58688.log 2026-02-17T11:50:09.704 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59945.log.gz 2026-02-17T11:50:09.704 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62907.log 2026-02-17T11:50:09.704 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58688.log.gz 2026-02-17T11:50:09.704 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60733.log 2026-02-17T11:50:09.704 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62907.log.gz 2026-02-17T11:50:09.704 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64339.log 2026-02-17T11:50:09.704 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60733.log.gz 2026-02-17T11:50:09.704 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59751.log 2026-02-17T11:50:09.705 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64339.log.gz 2026-02-17T11:50:09.705 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56019.log 2026-02-17T11:50:09.705 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59751.log.gz 2026-02-17T11:50:09.705 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74178.log 2026-02-17T11:50:09.705 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56019.log.gz 2026-02-17T11:50:09.705 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44037.log 2026-02-17T11:50:09.705 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.74178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74178.log.gz 2026-02-17T11:50:09.705 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56458.log 2026-02-17T11:50:09.706 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.44037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44037.log.gz 2026-02-17T11:50:09.706 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70851.log 2026-02-17T11:50:09.706 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56458.log.gz 2026-02-17T11:50:09.706 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48901.log 2026-02-17T11:50:09.706 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70851.log.gz 2026-02-17T11:50:09.706 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56022.log 2026-02-17T11:50:09.706 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.48901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48901.log.gz 2026-02-17T11:50:09.706 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65083.log 2026-02-17T11:50:09.706 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.56022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56022.log.gz 2026-02-17T11:50:09.706 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72550.log 2026-02-17T11:50:09.707 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.65083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65083.log.gz 2026-02-17T11:50:09.707 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54599.log 2026-02-17T11:50:09.707 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63303.log 2026-02-17T11:50:09.708 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72550.log.gz 2026-02-17T11:50:09.708 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54826.log 2026-02-17T11:50:09.708 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54599.log.gz 2026-02-17T11:50:09.708 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63303.log.gz 2026-02-17T11:50:09.708 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57414.log 2026-02-17T11:50:09.708 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.54826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75342.log 2026-02-17T11:50:09.708 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54826.log.gz 2026-02-17T11:50:09.708 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63512.log 2026-02-17T11:50:09.708 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57414.log.gz 2026-02-17T11:50:09.709 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.75342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66854.log 2026-02-17T11:50:09.709 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75342.log.gz 2026-02-17T11:50:09.709 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72696.log 2026-02-17T11:50:09.709 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63512.log.gz 2026-02-17T11:50:09.709 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66802.log 2026-02-17T11:50:09.709 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66854.log.gz 2026-02-17T11:50:09.709 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.72696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58131.log 2026-02-17T11:50:09.709 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72696.log.gz 2026-02-17T11:50:09.709 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.66802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59426.log 2026-02-17T11:50:09.709 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66802.log.gz 2026-02-17T11:50:09.709 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64771.log 2026-02-17T11:50:09.709 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58131.log.gz 2026-02-17T11:50:09.710 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51693.log 2026-02-17T11:50:09.710 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59426.log.gz 2026-02-17T11:50:09.710 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58639.log 2026-02-17T11:50:09.710 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.64771.log: /var/log/ceph/ceph-client.admin.51693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64771.log.gz 2026-02-17T11:50:09.710 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63100.log 2026-02-17T11:50:09.710 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51693.log.gz 2026-02-17T11:50:09.710 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68847.log 2026-02-17T11:50:09.710 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58639.log.gz 2026-02-17T11:50:09.711 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.63100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59334.log 2026-02-17T11:50:09.711 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63100.log.gz 2026-02-17T11:50:09.711 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57542.log 2026-02-17T11:50:09.711 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68847.log.gz 2026-02-17T11:50:09.711 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50099.log 2026-02-17T11:50:09.711 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59334.log.gz 2026-02-17T11:50:09.711 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.57542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52386.log 2026-02-17T11:50:09.711 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57542.log.gz 2026-02-17T11:50:09.711 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.50099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52967.log 2026-02-17T11:50:09.711 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50099.log.gz 2026-02-17T11:50:09.711 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61173.log 2026-02-17T11:50:09.711 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52386.log.gz 2026-02-17T11:50:09.712 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55436.log 2026-02-17T11:50:09.712 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52967.log.gz 2026-02-17T11:50:09.712 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52584.log 2026-02-17T11:50:09.712 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61173.log.gz 2026-02-17T11:50:09.712 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.55436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68373.log 2026-02-17T11:50:09.712 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55436.log.gz 2026-02-17T11:50:09.712 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.52584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58288.log 2026-02-17T11:50:09.712 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52584.log.gz 2026-02-17T11:50:09.712 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.68373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70238.log 2026-02-17T11:50:09.712 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68373.log.gz 2026-02-17T11:50:09.712 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.58288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62904.log 2026-02-17T11:50:09.712 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58288.log.gz 2026-02-17T11:50:09.713 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.70238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67033.log 2026-02-17T11:50:09.713 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70238.log.gz 2026-02-17T11:50:09.713 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60536.log 2026-02-17T11:50:09.713 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62904.log.gz 2026-02-17T11:50:09.713 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.67033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59092.log 2026-02-17T11:50:09.713 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67033.log.gz 2026-02-17T11:50:09.713 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.60536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53220.log 2026-02-17T11:50:09.713 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60536.log.gz 2026-02-17T11:50:09.713 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.59092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61339.log 2026-02-17T11:50:09.713 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59092.log.gz 2026-02-17T11:50:09.714 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.53220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73429.log 2026-02-17T11:50:09.714 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53220.log.gz 2026-02-17T11:50:09.714 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.61339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71858.log 2026-02-17T11:50:09.714 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61339.log.gz 2026-02-17T11:50:09.714 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.73429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62485.log 2026-02-17T11:50:09.714 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73429.log.gz 2026-02-17T11:50:09.714 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.71858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71858.log.gz 2026-02-17T11:50:09.714 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/ceph-client.admin.62485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62485.log.gz 2026-02-17T11:50:09.731 INFO:teuthology.orchestra.run.trial078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T11:50:09.731 INFO:teuthology.orchestra.run.trial078.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T11:50:09.874 INFO:teuthology.orchestra.run.trial078.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T11:50:09.881 INFO:teuthology.orchestra.run.trial078.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T11:50:09.962 INFO:teuthology.orchestra.run.trial078.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T11:50:09.964 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-17T11:50:09.964 INFO:teuthology.orchestra.run.trial078.stderr:real 0m0.393s 2026-02-17T11:50:09.964 INFO:teuthology.orchestra.run.trial078.stderr:user 0m1.242s 2026-02-17T11:50:09.964 INFO:teuthology.orchestra.run.trial078.stderr:sys 0m0.216s 2026-02-17T11:50:09.964 INFO:tasks.ceph:Archiving logs... 2026-02-17T11:50:09.965 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51339/remote/trial078/log 2026-02-17T11:50:09.966 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T11:50:10.421 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T11:50:10.445 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T11:50:10.445 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T11:50:10.570 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T11:50:10.582 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T11:50:10.582 DEBUG:teuthology.orchestra.run.trial078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:50:10.598 INFO:teuthology.orchestra.run.trial078.stderr:bash: line 1: ntpq: command not found 2026-02-17T11:50:10.631 INFO:teuthology.orchestra.run.trial078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T11:50:10.631 INFO:teuthology.orchestra.run.trial078.stdout:=============================================================================== 2026-02-17T11:50:10.631 INFO:teuthology.orchestra.run.trial078.stdout:^* 157.245.125.229 2 6 377 0 +682us[ +594us] +/- 29ms 2026-02-17T11:50:10.631 INFO:teuthology.orchestra.run.trial078.stdout:^+ time.trtnw.net 2 6 377 64 +434us[ +346us] +/- 36ms 2026-02-17T11:50:10.631 INFO:teuthology.orchestra.run.trial078.stdout:^+ sushi.ruselabs.com 2 6 377 62 -1745us[-1834us] +/- 35ms 2026-02-17T11:50:10.631 INFO:teuthology.orchestra.run.trial078.stdout:^+ wdc1.us.ntp.li 3 6 377 63 +373us[ +285us] +/- 30ms 2026-02-17T11:50:10.632 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T11:50:10.645 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T11:50:10.646 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T11:50:10.661 DEBUG:teuthology.orchestra.run.trial078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T11:50:10.734 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T11:50:10.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:50:10.762 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T11:50:10.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T11:50:10.795 INFO:teuthology.task.internal:Duration was 567.107253 seconds 2026-02-17T11:50:10.796 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T11:50:10.811 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T11:50:10.812 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T11:50:10.849 INFO:teuthology.orchestra.run.trial078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T11:50:11.164 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T11:50:11.164 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial078.front.sepia.ceph.com 2026-02-17T11:50:11.165 DEBUG:teuthology.orchestra.run.trial078:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T11:50:11.224 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T11:50:11.225 DEBUG:teuthology.orchestra.run.trial078:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:50:11.332 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T11:50:11.332 DEBUG:teuthology.orchestra.run.trial078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:50:11.357 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:50:11.357 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:50:11.357 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:50:11.357 INFO:teuthology.orchestra.run.trial078.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T11:50:11.357 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T11:50:11.367 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 84.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T11:50:11.369 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T11:50:11.386 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T11:50:11.386 DEBUG:teuthology.orchestra.run.trial078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T11:50:11.434 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T11:50:11.451 DEBUG:teuthology.orchestra.run.trial078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:50:11.497 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern = core 2026-02-17T11:50:11.512 DEBUG:teuthology.orchestra.run.trial078:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:50:11.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:50:11.567 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T11:50:11.584 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T11:50:11.585 DEBUG:teuthology.misc:Transferring archived files from trial078:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51339/remote/trial078 2026-02-17T11:50:11.585 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T11:50:11.647 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T11:50:11.648 DEBUG:teuthology.orchestra.run.trial078:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T11:50:11.693 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T11:50:11.710 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T11:50:11.710 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T11:50:11.728 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T11:50:11.728 DEBUG:teuthology.orchestra.run.trial078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T11:50:11.749 INFO:teuthology.orchestra.run.trial078.stdout: 786857 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 11:50 /home/ubuntu/cephtest 2026-02-17T11:50:11.750 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T11:50:11.767 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T11:50:11.805 INFO:teuthology.run:Summary data: description: rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} duration: 567.1072525978088 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T11:50:11.805 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:50:11.932 INFO:teuthology.run:pass