2026-02-17T12:19:46.997 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T12:19:47.012 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T12:19:47.090 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51452 branch: wip-bharath20-testing-2026-02-13-0906-squid description: rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51452' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath20-testing-2026-02-13-0906-squid ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - \(MON_DOWN\) sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath20-testing-2026-02-13-0906-squid sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 4581 sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath20-testing-2026-02-13-0906-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 targets: trial176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHvYh5Fuq3YONo+q2fHCDh/FcY0bJSIJDjEQM2qfZdBuj2VaxRWI6lTBiLIvusQWhlGHssqjesuRQ3plgmMUhwA= tasks: - install: null - ceph: conf: mon: debug auth: 30 log-ignorelist: - no reply from - overall HEALTH_ - \(MON_DOWN\) - \(MGR_DOWN\) - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_APP_NOT_ENABLED\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - full_sequential: - radosbench: clients: - client.0 time: 30 - rebuild_mondb: null - radosbench: clients: - client.0 time: 30 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:10:36 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T12:19:47.090 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa; will attempt to use it 2026-02-17T12:19:47.091 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks 2026-02-17T12:19:47.091 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T12:19:47.092 INFO:teuthology.task.internal:Checking packages... 2026-02-17T12:19:47.092 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3c96dfb3f50b3d02598a82af7104764bfdcd3919' 2026-02-17T12:19:47.092 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T12:19:47.092 INFO:teuthology.packaging:ref: None 2026-02-17T12:19:47.092 INFO:teuthology.packaging:tag: None 2026-02-17T12:19:47.092 INFO:teuthology.packaging:branch: wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T12:19:47.092 INFO:teuthology.packaging:sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:19:47.092 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T12:19:47.210 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-675.g3c96dfb3 2026-02-17T12:19:47.211 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T12:19:47.221 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T12:19:47.221 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T12:19:47.234 INFO:teuthology.task.internal:Saving configuration 2026-02-17T12:19:47.245 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T12:19:47.255 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T12:19:47.331 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial176.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51452', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 12:16:21.714297', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHvYh5Fuq3YONo+q2fHCDh/FcY0bJSIJDjEQM2qfZdBuj2VaxRWI6lTBiLIvusQWhlGHssqjesuRQ3plgmMUhwA='} 2026-02-17T12:19:47.331 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T12:19:47.342 INFO:teuthology.task.internal:roles: ubuntu@trial176.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T12:19:47.342 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T12:19:47.427 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7a8808576480>, signals=[15]) 2026-02-17T12:19:47.427 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T12:19:47.438 INFO:teuthology.task.internal:Opening connections... 2026-02-17T12:19:47.438 DEBUG:teuthology.task.internal:connecting to ubuntu@trial176.front.sepia.ceph.com 2026-02-17T12:19:47.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:19:47.501 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T12:19:47.512 DEBUG:teuthology.orchestra.run.trial176:> uname -m 2026-02-17T12:19:47.577 INFO:teuthology.orchestra.run.trial176.stdout:x86_64 2026-02-17T12:19:47.577 DEBUG:teuthology.orchestra.run.trial176:> cat /etc/os-release 2026-02-17T12:19:47.633 INFO:teuthology.orchestra.run.trial176.stdout:NAME="CentOS Stream" 2026-02-17T12:19:47.633 INFO:teuthology.orchestra.run.trial176.stdout:VERSION="9" 2026-02-17T12:19:47.634 INFO:teuthology.orchestra.run.trial176.stdout:ID="centos" 2026-02-17T12:19:47.634 INFO:teuthology.orchestra.run.trial176.stdout:ID_LIKE="rhel fedora" 2026-02-17T12:19:47.634 INFO:teuthology.orchestra.run.trial176.stdout:VERSION_ID="9" 2026-02-17T12:19:47.634 INFO:teuthology.orchestra.run.trial176.stdout:PLATFORM_ID="platform:el9" 2026-02-17T12:19:47.634 INFO:teuthology.orchestra.run.trial176.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T12:19:47.634 INFO:teuthology.orchestra.run.trial176.stdout:ANSI_COLOR="0;31" 2026-02-17T12:19:47.634 INFO:teuthology.orchestra.run.trial176.stdout:LOGO="fedora-logo-icon" 2026-02-17T12:19:47.634 INFO:teuthology.orchestra.run.trial176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T12:19:47.634 INFO:teuthology.orchestra.run.trial176.stdout:HOME_URL="https://centos.org/" 2026-02-17T12:19:47.634 INFO:teuthology.orchestra.run.trial176.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T12:19:47.634 INFO:teuthology.orchestra.run.trial176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T12:19:47.634 INFO:teuthology.orchestra.run.trial176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T12:19:47.635 INFO:teuthology.lock.ops:Updating trial176.front.sepia.ceph.com on lock server 2026-02-17T12:19:47.723 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T12:19:47.737 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T12:19:47.747 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T12:19:47.747 DEBUG:teuthology.orchestra.run.trial176:> test '!' -e /home/ubuntu/cephtest 2026-02-17T12:19:47.762 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T12:19:47.773 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T12:19:47.773 DEBUG:teuthology.orchestra.run.trial176:> test -z $(ls -A /var/lib/ceph) 2026-02-17T12:19:47.819 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T12:19:47.926 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T12:19:47.945 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T12:19:47.946 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T12:19:47.946 DEBUG:teuthology.orchestra.run.trial176:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T12:19:47.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:19:47.961 DEBUG:teuthology.orchestra.run.trial176:> uname -r 2026-02-17T12:19:48.016 INFO:teuthology.orchestra.run.trial176.stdout:5.14.0-645.el9.x86_64 2026-02-17T12:19:48.016 INFO:teuthology.task.kernel:Running kernel on trial176: 5.14.0-645.el9.x86_64 2026-02-17T12:19:48.016 DEBUG:teuthology.orchestra.run.trial176:> sudo yum install -y kernel 2026-02-17T12:19:49.203 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-17T12:20:17.227 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - AppStream 999 kB/s | 27 MB 00:27 2026-02-17T12:20:28.713 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - CRB 873 kB/s | 7.8 MB 00:09 2026-02-17T12:20:30.592 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-17T12:20:31.196 INFO:teuthology.orchestra.run.trial176.stdout:Extra Packages for Enterprise Linux 37 MB/s | 20 MB 00:00 2026-02-17T12:20:34.364 INFO:teuthology.orchestra.run.trial176.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-17T12:20:35.382 INFO:teuthology.orchestra.run.trial176.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T12:20:35.402 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:20:35.403 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:20:35.403 INFO:teuthology.orchestra.run.trial176.stdout: Package Architecture Version Repository Size 2026-02-17T12:20:35.403 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:20:35.404 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T12:20:35.404 INFO:teuthology.orchestra.run.trial176.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T12:20:35.404 INFO:teuthology.orchestra.run.trial176.stdout:Installing dependencies: 2026-02-17T12:20:35.404 INFO:teuthology.orchestra.run.trial176.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T12:20:35.404 INFO:teuthology.orchestra.run.trial176.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T12:20:35.404 INFO:teuthology.orchestra.run.trial176.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T12:20:35.404 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:20:35.404 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T12:20:35.404 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:20:35.404 INFO:teuthology.orchestra.run.trial176.stdout:Install 4 Packages 2026-02-17T12:20:35.404 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:20:35.405 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 88 M 2026-02-17T12:20:35.405 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 135 M 2026-02-17T12:20:35.405 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T12:20:36.143 INFO:teuthology.orchestra.run.trial176.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2026-02-17T12:20:36.702 INFO:teuthology.orchestra.run.trial176.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 14 MB/s | 17 MB 00:01 2026-02-17T12:20:37.228 INFO:teuthology.orchestra.run.trial176.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 28 MB/s | 31 MB 00:01 2026-02-17T12:20:37.374 INFO:teuthology.orchestra.run.trial176.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-17T12:20:37.374 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:20:37.374 INFO:teuthology.orchestra.run.trial176.stdout:Total 45 MB/s | 88 MB 00:01 2026-02-17T12:20:37.563 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T12:20:37.766 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T12:20:37.767 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T12:20:38.113 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T12:20:38.113 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T12:20:39.198 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T12:20:39.479 INFO:teuthology.orchestra.run.trial176.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T12:20:39.498 INFO:teuthology.orchestra.run.trial176.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T12:20:41.275 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T12:20:41.303 INFO:teuthology.orchestra.run.trial176.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T12:20:44.389 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T12:20:44.395 INFO:teuthology.orchestra.run.trial176.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:20:47.628 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:21:18.163 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:21:18.183 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:21:18.248 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:21:18.248 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T12:21:18.248 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T12:21:18.248 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T12:21:18.300 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T12:21:18.300 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:21:18.300 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T12:21:18.300 INFO:teuthology.orchestra.run.trial176.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T12:21:18.300 INFO:teuthology.orchestra.run.trial176.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T12:21:18.300 INFO:teuthology.orchestra.run.trial176.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T12:21:18.300 INFO:teuthology.orchestra.run.trial176.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T12:21:18.301 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:21:18.301 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:21:18.360 DEBUG:teuthology.orchestra.run.trial176:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T12:21:18.385 INFO:teuthology.orchestra.run.trial176.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T12:21:18.386 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T12:21:18.386 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T12:21:18.387 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T12:21:18.387 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T12:21:18.387 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T12:21:18.387 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial176.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T12:21:18.387 DEBUG:teuthology.orchestra.run.trial176:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T12:21:18.450 INFO:teuthology.orchestra.run.trial176.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T12:21:18.451 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T12:21:18.451 DEBUG:teuthology.orchestra.run.trial176:> sudo rpm -qi grub2-tools 2026-02-17T12:21:18.519 INFO:teuthology.orchestra.run.trial176.stdout:Name : grub2-tools 2026-02-17T12:21:18.519 INFO:teuthology.orchestra.run.trial176.stdout:Epoch : 1 2026-02-17T12:21:18.519 INFO:teuthology.orchestra.run.trial176.stdout:Version : 2.06 2026-02-17T12:21:18.519 INFO:teuthology.orchestra.run.trial176.stdout:Release : 118.el9 2026-02-17T12:21:18.519 INFO:teuthology.orchestra.run.trial176.stdout:Architecture: x86_64 2026-02-17T12:21:18.519 INFO:teuthology.orchestra.run.trial176.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T12:21:18.519 INFO:teuthology.orchestra.run.trial176.stdout:Group : Unspecified 2026-02-17T12:21:18.519 INFO:teuthology.orchestra.run.trial176.stdout:Size : 8393909 2026-02-17T12:21:18.519 INFO:teuthology.orchestra.run.trial176.stdout:License : GPLv3+ 2026-02-17T12:21:18.520 INFO:teuthology.orchestra.run.trial176.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T12:21:18.520 INFO:teuthology.orchestra.run.trial176.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T12:21:18.520 INFO:teuthology.orchestra.run.trial176.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T12:21:18.520 INFO:teuthology.orchestra.run.trial176.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T12:21:18.520 INFO:teuthology.orchestra.run.trial176.stdout:Packager : builder@centos.org 2026-02-17T12:21:18.520 INFO:teuthology.orchestra.run.trial176.stdout:Vendor : CentOS 2026-02-17T12:21:18.520 INFO:teuthology.orchestra.run.trial176.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T12:21:18.520 INFO:teuthology.orchestra.run.trial176.stdout:Summary : Support tools for GRUB. 2026-02-17T12:21:18.520 INFO:teuthology.orchestra.run.trial176.stdout:Description : 2026-02-17T12:21:18.520 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:21:18.520 INFO:teuthology.orchestra.run.trial176.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T12:21:18.520 INFO:teuthology.orchestra.run.trial176.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T12:21:18.521 INFO:teuthology.orchestra.run.trial176.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T12:21:18.521 INFO:teuthology.orchestra.run.trial176.stdout:hardware devices. 2026-02-17T12:21:18.521 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:21:18.521 INFO:teuthology.orchestra.run.trial176.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T12:21:18.522 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T12:21:18.522 INFO:teuthology.task.kernel:Updating grub on trial176 to boot 5.14.0-681.el9.x86_64 2026-02-17T12:21:18.522 DEBUG:teuthology.orchestra.run.trial176:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T12:21:18.586 INFO:teuthology.orchestra.run.trial176.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T12:21:18.588 DEBUG:teuthology.orchestra.run.trial176:> sudo command -v grubby && echo yes || echo no 2026-02-17T12:21:18.651 INFO:teuthology.orchestra.run.trial176.stdout:/sbin/grubby 2026-02-17T12:21:18.652 INFO:teuthology.orchestra.run.trial176.stdout:yes 2026-02-17T12:21:18.653 DEBUG:teuthology.orchestra.run.trial176:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T12:21:18.717 INFO:teuthology.orchestra.run.trial176.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T12:21:18.718 DEBUG:teuthology.orchestra.run.trial176:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T12:21:18.790 DEBUG:teuthology.orchestra.run.trial176:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T12:21:18.999 INFO:teuthology.orchestra.run.trial176.stderr:Generating grub configuration file ... 2026-02-17T12:21:19.062 INFO:teuthology.orchestra.run.trial176.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T12:21:19.068 INFO:teuthology.orchestra.run.trial176.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T12:21:19.323 INFO:teuthology.orchestra.run.trial176.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T12:21:19.329 INFO:teuthology.orchestra.run.trial176.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T12:21:19.361 INFO:teuthology.orchestra.run.trial176.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T12:21:19.368 INFO:teuthology.orchestra.run.trial176.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T12:21:19.391 INFO:teuthology.orchestra.run.trial176.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T12:21:19.398 INFO:teuthology.orchestra.run.trial176.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T12:21:19.481 INFO:teuthology.orchestra.run.trial176.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T12:21:19.489 INFO:teuthology.orchestra.run.trial176.stderr:done 2026-02-17T12:21:19.491 DEBUG:teuthology.orchestra.run.trial176:> test -d /sys/firmware/efi 2026-02-17T12:21:19.508 DEBUG:teuthology.orchestra.run.trial176:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T12:21:19.573 INFO:teuthology.orchestra.run.trial176.stdout:/boot/efi/EFI/BOOT 2026-02-17T12:21:19.573 INFO:teuthology.orchestra.run.trial176.stdout:/boot/efi/EFI/centos 2026-02-17T12:21:19.575 DEBUG:teuthology.orchestra.run.trial176:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T12:21:19.639 INFO:teuthology.orchestra.run.trial176.stdout:no 2026-02-17T12:21:19.640 DEBUG:teuthology.orchestra.run.trial176:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T12:21:19.704 INFO:teuthology.orchestra.run.trial176.stdout:yes 2026-02-17T12:21:19.704 DEBUG:teuthology.orchestra.run.trial176:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T12:21:19.769 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial176 2026-02-17T12:21:19.769 DEBUG:teuthology.orchestra.run.trial176:> sudo bash -c ' 2026-02-17T12:21:19.769 DEBUG:teuthology.orchestra.run.trial176:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T12:21:19.769 DEBUG:teuthology.orchestra.run.trial176:> ' 2026-02-17T12:21:49.813 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T12:21:49.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial176.front.sepia.ceph.com' 2026-02-17T12:21:49.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:22:49.867 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T12:22:58.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial176.front.sepia.ceph.com' 2026-02-17T12:22:58.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:22:59.008 DEBUG:teuthology.orchestra.run.trial176:> true 2026-02-17T12:22:59.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial176.front.sepia.ceph.com' 2026-02-17T12:22:59.162 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T12:22:59.163 DEBUG:teuthology.orchestra.run.trial176:> uname -r 2026-02-17T12:22:59.218 INFO:teuthology.orchestra.run.trial176.stdout:5.14.0-681.el9.x86_64 2026-02-17T12:22:59.219 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T12:22:59.219 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T12:22:59.219 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T12:23:00.220 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T12:23:00.220 DEBUG:teuthology.orchestra.run.trial176:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T12:23:00.250 INFO:teuthology.orchestra.run.trial176.stdout:ttyS1 2026-02-17T12:23:00.277 DEBUG:teuthology.parallel:result is None 2026-02-17T12:23:00.277 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T12:23:00.286 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T12:23:00.286 DEBUG:teuthology.orchestra.run.trial176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T12:23:00.335 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T12:23:00.347 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T12:23:00.360 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T12:23:00.360 DEBUG:teuthology.orchestra.run.trial176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T12:23:00.397 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T12:23:00.409 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T12:23:00.410 DEBUG:teuthology.orchestra.run.trial176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T12:23:00.457 INFO:teuthology.orchestra.run.trial176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:23:00.466 INFO:teuthology.orchestra.run.trial176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:23:00.467 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T12:23:00.479 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T12:23:00.480 DEBUG:teuthology.orchestra.run.trial176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T12:23:00.533 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T12:23:00.549 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T12:23:00.550 DEBUG:teuthology.orchestra.run.trial176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T12:23:00.590 DEBUG:teuthology.orchestra.run.trial176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:23:00.757 DEBUG:teuthology.orchestra.run.trial176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:23:00.783 DEBUG:teuthology.orchestra.run.trial176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:23:00.934 DEBUG:teuthology.orchestra.run.trial176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:23:00.958 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:23:00.958 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T12:23:01.023 DEBUG:teuthology.orchestra.run.trial176:> sudo service rsyslog restart 2026-02-17T12:23:01.092 INFO:teuthology.orchestra.run.trial176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:23:01.548 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T12:23:01.561 INFO:teuthology.task.internal:Starting timer... 2026-02-17T12:23:01.561 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T12:23:01.582 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T12:23:01.600 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-17T12:23:01.600 DEBUG:teuthology.orchestra.run.trial176:> sudo service auditd rotate 2026-02-17T12:23:01.628 INFO:teuthology.orchestra.run.trial176.stdout:Rotating logs: 2026-02-17T12:23:01.630 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T12:23:01.630 DEBUG:teuthology.orchestra.run.trial176:> /usr/sbin/getenforce 2026-02-17T12:23:01.686 INFO:teuthology.orchestra.run.trial176.stdout:Permissive 2026-02-17T12:23:01.687 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial176.front.sepia.ceph.com': 'permissive'} 2026-02-17T12:23:01.687 DEBUG:teuthology.orchestra.run.trial176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:23:01.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:23:01.750 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T12:23:01.751 DEBUG:teuthology.orchestra.run.trial176:> sudo /usr/sbin/setenforce permissive 2026-02-17T12:23:01.814 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T12:23:01.831 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T12:23:01.845 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T12:23:01.846 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T12:25:58.989 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial176.front.sepia.ceph.com')] 2026-02-17T12:25:58.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial176.front.sepia.ceph.com' 2026-02-17T12:25:58.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:25:59.055 DEBUG:teuthology.orchestra.run.trial176:> true 2026-02-17T12:25:59.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial176.front.sepia.ceph.com' 2026-02-17T12:25:59.131 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T12:25:59.144 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T12:25:59.144 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T12:25:59.144 DEBUG:teuthology.orchestra.run.trial176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:25:59.198 INFO:teuthology.orchestra.run.trial176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T12:25:59.209 INFO:teuthology.orchestra.run.trial176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T12:25:59.228 INFO:teuthology.orchestra.run.trial176.stderr:sudo: ntpd: command not found 2026-02-17T12:25:59.237 INFO:teuthology.orchestra.run.trial176.stdout:506 Cannot talk to daemon 2026-02-17T12:25:59.249 INFO:teuthology.orchestra.run.trial176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T12:25:59.260 INFO:teuthology.orchestra.run.trial176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T12:25:59.306 INFO:teuthology.orchestra.run.trial176.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:25:59.333 INFO:teuthology.orchestra.run.trial176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:25:59.333 INFO:teuthology.orchestra.run.trial176.stdout:=============================================================================== 2026-02-17T12:25:59.333 INFO:teuthology.orchestra.run.trial176.stdout:^? 108.61.73.244 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:25:59.333 INFO:teuthology.orchestra.run.trial176.stdout:^? 23-95-35-34-host.colocro> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:25:59.333 INFO:teuthology.orchestra.run.trial176.stdout:^? 172-235-154-118.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:25:59.333 INFO:teuthology.orchestra.run.trial176.stdout:^? ntp1.lax.us.hojmark.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:25:59.334 INFO:teuthology.run_tasks:Running task install... 2026-02-17T12:25:59.345 DEBUG:teuthology.task.install:project ceph 2026-02-17T12:25:59.346 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}} 2026-02-17T12:25:59.346 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'} 2026-02-17T12:25:59.346 INFO:teuthology.task.install:Using flavor: default 2026-02-17T12:25:59.348 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T12:25:59.348 INFO:teuthology.task.install:extra packages: [] 2026-02-17T12:25:59.349 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T12:25:59.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:25:59.507 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T12:25:59.507 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T12:25:59.626 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T12:25:59.626 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:25:59.626 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T12:25:59.652 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T12:25:59.652 DEBUG:teuthology.orchestra.run.trial176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T12:25:59.717 DEBUG:teuthology.orchestra.run.trial176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T12:25:59.791 DEBUG:teuthology.orchestra.run.trial176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T12:25:59.855 INFO:teuthology.orchestra.run.trial176.stdout:check_obsoletes = 1 2026-02-17T12:25:59.857 DEBUG:teuthology.orchestra.run.trial176:> sudo yum clean all 2026-02-17T12:26:00.006 INFO:teuthology.orchestra.run.trial176.stdout:41 files removed 2026-02-17T12:26:00.020 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-radosgw 2026-02-17T12:26:00.292 INFO:teuthology.orchestra.run.trial176.stdout:ceph packages for x86_64 665 kB/s | 86 kB 00:00 2026-02-17T12:26:00.426 INFO:teuthology.orchestra.run.trial176.stdout:ceph noarch packages 114 kB/s | 12 kB 00:00 2026-02-17T12:26:00.553 INFO:teuthology.orchestra.run.trial176.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T12:26:01.968 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.9 MB 00:01 2026-02-17T12:26:05.096 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T12:26:08.507 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-17T12:26:09.489 INFO:teuthology.orchestra.run.trial176.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 20 kB 00:00 2026-02-17T12:26:10.774 INFO:teuthology.orchestra.run.trial176.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-17T12:26:14.077 INFO:teuthology.orchestra.run.trial176.stdout:lab-extras 1.0 MB/s | 50 kB 00:00 2026-02-17T12:26:15.295 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:15.296 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:15.297 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repository Size 2026-02-17T12:26:15.297 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:15.297 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T12:26:15.297 INFO:teuthology.orchestra.run.trial176.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T12:26:15.297 INFO:teuthology.orchestra.run.trial176.stdout:Upgrading: 2026-02-17T12:26:15.297 INFO:teuthology.orchestra.run.trial176.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T12:26:15.297 INFO:teuthology.orchestra.run.trial176.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T12:26:15.297 INFO:teuthology.orchestra.run.trial176.stdout:Installing dependencies: 2026-02-17T12:26:15.297 INFO:teuthology.orchestra.run.trial176.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T12:26:15.297 INFO:teuthology.orchestra.run.trial176.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T12:26:15.297 INFO:teuthology.orchestra.run.trial176.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T12:26:15.298 INFO:teuthology.orchestra.run.trial176.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T12:26:15.298 INFO:teuthology.orchestra.run.trial176.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T12:26:15.298 INFO:teuthology.orchestra.run.trial176.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T12:26:15.298 INFO:teuthology.orchestra.run.trial176.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T12:26:15.298 INFO:teuthology.orchestra.run.trial176.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T12:26:15.298 INFO:teuthology.orchestra.run.trial176.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T12:26:15.298 INFO:teuthology.orchestra.run.trial176.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T12:26:15.298 INFO:teuthology.orchestra.run.trial176.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T12:26:15.298 INFO:teuthology.orchestra.run.trial176.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T12:26:15.298 INFO:teuthology.orchestra.run.trial176.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T12:26:15.298 INFO:teuthology.orchestra.run.trial176.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T12:26:15.298 INFO:teuthology.orchestra.run.trial176.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T12:26:15.299 INFO:teuthology.orchestra.run.trial176.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T12:26:15.299 INFO:teuthology.orchestra.run.trial176.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T12:26:15.299 INFO:teuthology.orchestra.run.trial176.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T12:26:15.299 INFO:teuthology.orchestra.run.trial176.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T12:26:15.299 INFO:teuthology.orchestra.run.trial176.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T12:26:15.299 INFO:teuthology.orchestra.run.trial176.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T12:26:15.299 INFO:teuthology.orchestra.run.trial176.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T12:26:15.299 INFO:teuthology.orchestra.run.trial176.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T12:26:15.299 INFO:teuthology.orchestra.run.trial176.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T12:26:15.299 INFO:teuthology.orchestra.run.trial176.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T12:26:15.299 INFO:teuthology.orchestra.run.trial176.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T12:26:15.299 INFO:teuthology.orchestra.run.trial176.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T12:26:15.299 INFO:teuthology.orchestra.run.trial176.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T12:26:15.300 INFO:teuthology.orchestra.run.trial176.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T12:26:15.300 INFO:teuthology.orchestra.run.trial176.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T12:26:15.300 INFO:teuthology.orchestra.run.trial176.stdout:Installing weak dependencies: 2026-02-17T12:26:15.300 INFO:teuthology.orchestra.run.trial176.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T12:26:15.300 INFO:teuthology.orchestra.run.trial176.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T12:26:15.300 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:15.300 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T12:26:15.300 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:15.300 INFO:teuthology.orchestra.run.trial176.stdout:Install 33 Packages 2026-02-17T12:26:15.300 INFO:teuthology.orchestra.run.trial176.stdout:Upgrade 2 Packages 2026-02-17T12:26:15.300 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:15.301 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 63 M 2026-02-17T12:26:15.301 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T12:26:16.167 INFO:teuthology.orchestra.run.trial176.stdout:(1/35): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 19 MB/s | 5.5 MB 00:00 2026-02-17T12:26:16.198 INFO:teuthology.orchestra.run.trial176.stdout:(2/35): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 817 kB/s | 25 kB 00:00 2026-02-17T12:26:16.252 INFO:teuthology.orchestra.run.trial176.stdout:(3/35): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 18 MB/s | 999 kB 00:00 2026-02-17T12:26:16.297 INFO:teuthology.orchestra.run.trial176.stdout:(4/35): libradosstriper1-19.2.3-675.g3c96dfb3.e 11 MB/s | 503 kB 00:00 2026-02-17T12:26:16.584 INFO:teuthology.orchestra.run.trial176.stdout:(5/35): ceph-radosgw-19.2.3-675.g3c96dfb3.el9.x 15 MB/s | 11 MB 00:00 2026-02-17T12:26:16.604 INFO:teuthology.orchestra.run.trial176.stdout:(6/35): librgw2-19.2.3-675.g3c96dfb3.el9.x86_64 18 MB/s | 5.4 MB 00:00 2026-02-17T12:26:16.605 INFO:teuthology.orchestra.run.trial176.stdout:(7/35): python3-ceph-argparse-19.2.3-675.g3c96d 2.2 MB/s | 45 kB 00:00 2026-02-17T12:26:16.623 INFO:teuthology.orchestra.run.trial176.stdout:(8/35): python3-ceph-common-19.2.3-675.g3c96dfb 7.2 MB/s | 142 kB 00:00 2026-02-17T12:26:16.627 INFO:teuthology.orchestra.run.trial176.stdout:(9/35): python3-cephfs-19.2.3-675.g3c96dfb3.el9 7.1 MB/s | 165 kB 00:00 2026-02-17T12:26:16.649 INFO:teuthology.orchestra.run.trial176.stdout:(10/35): python3-rados-19.2.3-675.g3c96dfb3.el9 12 MB/s | 322 kB 00:00 2026-02-17T12:26:16.655 INFO:teuthology.orchestra.run.trial176.stdout:(11/35): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 11 MB/s | 303 kB 00:00 2026-02-17T12:26:16.673 INFO:teuthology.orchestra.run.trial176.stdout:(12/35): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 4.0 MB/s | 100 kB 00:00 2026-02-17T12:26:16.680 INFO:teuthology.orchestra.run.trial176.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 1.3 MB/s | 33 kB 00:00 2026-02-17T12:26:16.701 INFO:teuthology.orchestra.run.trial176.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 4.3 MB/s | 93 kB 00:00 2026-02-17T12:26:16.736 INFO:teuthology.orchestra.run.trial176.stdout:(15/35): nvme-cli-2.13-1.el9.x86_64.rpm 17 MB/s | 1.1 MB 00:00 2026-02-17T12:26:16.768 INFO:teuthology.orchestra.run.trial176.stdout:(16/35): ceph-common-19.2.3-675.g3c96dfb3.el9.x 24 MB/s | 22 MB 00:00 2026-02-17T12:26:16.823 INFO:teuthology.orchestra.run.trial176.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 857 kB/s | 104 kB 00:00 2026-02-17T12:26:16.843 INFO:teuthology.orchestra.run.trial176.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.2 MB/s | 45 kB 00:00 2026-02-17T12:26:16.857 INFO:teuthology.orchestra.run.trial176.stdout:(19/35): libnbd-1.20.3-4.el9.x86_64.rpm 1.3 MB/s | 164 kB 00:00 2026-02-17T12:26:16.879 INFO:teuthology.orchestra.run.trial176.stdout:(20/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2026-02-17T12:26:16.901 INFO:teuthology.orchestra.run.trial176.stdout:(21/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.5 MB/s | 292 kB 00:00 2026-02-17T12:26:16.902 INFO:teuthology.orchestra.run.trial176.stdout:(22/35): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2026-02-17T12:26:16.921 INFO:teuthology.orchestra.run.trial176.stdout:(23/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.8 MB/s | 37 kB 00:00 2026-02-17T12:26:16.922 INFO:teuthology.orchestra.run.trial176.stdout:(24/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 3.2 MB/s | 66 kB 00:00 2026-02-17T12:26:16.927 INFO:teuthology.orchestra.run.trial176.stdout:(25/35): qatlib-25.08.0-2.el9.x86_64.rpm 4.9 MB/s | 240 kB 00:00 2026-02-17T12:26:17.006 INFO:teuthology.orchestra.run.trial176.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 314 kB/s | 25 kB 00:00 2026-02-17T12:26:17.054 INFO:teuthology.orchestra.run.trial176.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2026-02-17T12:26:17.090 INFO:teuthology.orchestra.run.trial176.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 1.9 MB/s | 67 kB 00:00 2026-02-17T12:26:17.090 INFO:teuthology.orchestra.run.trial176.stdout:(29/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.8 MB/s | 308 kB 00:00 2026-02-17T12:26:17.123 INFO:teuthology.orchestra.run.trial176.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2026-02-17T12:26:17.189 INFO:teuthology.orchestra.run.trial176.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 8.2 MB/s | 838 kB 00:00 2026-02-17T12:26:17.209 INFO:teuthology.orchestra.run.trial176.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2026-02-17T12:26:17.252 INFO:teuthology.orchestra.run.trial176.stdout:(33/35): libarrow-9.0.0-15.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2026-02-17T12:26:17.291 INFO:teuthology.orchestra.run.trial176.stdout:(34/35): librados2-19.2.3-675.g3c96dfb3.el9.x86 34 MB/s | 3.4 MB 00:00 2026-02-17T12:26:17.313 INFO:teuthology.orchestra.run.trial176.stdout:(35/35): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 30 MB/s | 3.2 MB 00:00 2026-02-17T12:26:17.315 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:26:17.315 INFO:teuthology.orchestra.run.trial176.stdout:Total 31 MB/s | 63 MB 00:02 2026-02-17T12:26:17.418 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T12:26:17.438 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T12:26:17.438 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T12:26:17.677 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T12:26:17.677 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T12:26:17.970 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T12:26:17.978 INFO:teuthology.orchestra.run.trial176.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T12:26:17.980 INFO:teuthology.orchestra.run.trial176.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T12:26:17.992 INFO:teuthology.orchestra.run.trial176.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T12:26:18.143 INFO:teuthology.orchestra.run.trial176.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T12:26:18.148 INFO:teuthology.orchestra.run.trial176.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T12:26:18.176 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T12:26:18.218 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T12:26:18.219 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T12:26:18.230 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T12:26:18.234 INFO:teuthology.orchestra.run.trial176.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T12:26:18.243 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/37 2026-02-17T12:26:18.265 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T12:26:18.266 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T12:26:18.279 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T12:26:18.311 INFO:teuthology.orchestra.run.trial176.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T12:26:18.314 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T12:26:18.321 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T12:26:18.323 INFO:teuthology.orchestra.run.trial176.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T12:26:18.326 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T12:26:18.331 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T12:26:18.472 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T12:26:18.473 INFO:teuthology.orchestra.run.trial176.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T12:26:18.498 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/37 2026-02-17T12:26:18.500 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/37 2026-02-17T12:26:18.507 INFO:teuthology.orchestra.run.trial176.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T12:26:18.732 INFO:teuthology.orchestra.run.trial176.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T12:26:18.734 INFO:teuthology.orchestra.run.trial176.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T12:26:18.749 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/37 2026-02-17T12:26:18.753 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/37 2026-02-17T12:26:18.757 INFO:teuthology.orchestra.run.trial176.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T12:26:18.760 INFO:teuthology.orchestra.run.trial176.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T12:26:18.760 INFO:teuthology.orchestra.run.trial176.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T12:26:18.779 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T12:26:18.894 INFO:teuthology.orchestra.run.trial176.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T12:26:18.896 INFO:teuthology.orchestra.run.trial176.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T12:26:19.174 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T12:26:19.174 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T12:26:19.174 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:19.212 INFO:teuthology.orchestra.run.trial176.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T12:26:19.213 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 31/37 2026-02-17T12:26:20.200 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T12:26:20.202 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T12:26:20.487 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/37 2026-02-17T12:26:20.490 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T12:26:20.534 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/37 2026-02-17T12:26:20.535 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T12:26:20.535 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T12:26:20.535 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:20.538 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T12:26:25.039 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T12:26:25.039 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /sys 2026-02-17T12:26:25.039 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /proc 2026-02-17T12:26:25.039 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /mnt 2026-02-17T12:26:25.039 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /var/tmp 2026-02-17T12:26:25.039 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /home 2026-02-17T12:26:25.039 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /root 2026-02-17T12:26:25.040 INFO:teuthology.orchestra.run.trial176.stdout:skipping the directory /tmp 2026-02-17T12:26:25.040 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:25.491 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T12:26:25.515 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/37 2026-02-17T12:26:25.515 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:26:25.515 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T12:26:25.515 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:26:25.515 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:26:25.515 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:25.517 INFO:teuthology.orchestra.run.trial176.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T12:26:25.530 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T12:26:25.530 INFO:teuthology.orchestra.run.trial176.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T12:26:25.587 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T12:26:25.587 INFO:teuthology.orchestra.run.trial176.stdout:Creating group 'qat' with GID 992. 2026-02-17T12:26:25.587 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:25.853 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/37 2026-02-17T12:26:25.853 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/37 2026-02-17T12:26:25.853 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/37 2026-02-17T12:26:25.853 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/37 2026-02-17T12:26:25.853 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/37 2026-02-17T12:26:25.853 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/37 2026-02-17T12:26:25.853 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/37 2026-02-17T12:26:25.853 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/37 2026-02-17T12:26:25.853 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/37 2026-02-17T12:26:25.853 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/37 2026-02-17T12:26:25.853 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T12:26:25.854 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 36/37 2026-02-17T12:26:25.916 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T12:26:25.917 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:25.917 INFO:teuthology.orchestra.run.trial176.stdout:Upgraded: 2026-02-17T12:26:25.917 INFO:teuthology.orchestra.run.trial176.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.917 INFO:teuthology.orchestra.run.trial176.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.917 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T12:26:25.917 INFO:teuthology.orchestra.run.trial176.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T12:26:25.917 INFO:teuthology.orchestra.run.trial176.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.917 INFO:teuthology.orchestra.run.trial176.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.917 INFO:teuthology.orchestra.run.trial176.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.918 INFO:teuthology.orchestra.run.trial176.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.918 INFO:teuthology.orchestra.run.trial176.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T12:26:25.918 INFO:teuthology.orchestra.run.trial176.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T12:26:25.918 INFO:teuthology.orchestra.run.trial176.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T12:26:25.918 INFO:teuthology.orchestra.run.trial176.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.918 INFO:teuthology.orchestra.run.trial176.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T12:26:25.918 INFO:teuthology.orchestra.run.trial176.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T12:26:25.918 INFO:teuthology.orchestra.run.trial176.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T12:26:25.918 INFO:teuthology.orchestra.run.trial176.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T12:26:25.918 INFO:teuthology.orchestra.run.trial176.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.918 INFO:teuthology.orchestra.run.trial176.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T12:26:25.918 INFO:teuthology.orchestra.run.trial176.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.919 INFO:teuthology.orchestra.run.trial176.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T12:26:25.919 INFO:teuthology.orchestra.run.trial176.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T12:26:25.919 INFO:teuthology.orchestra.run.trial176.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T12:26:25.919 INFO:teuthology.orchestra.run.trial176.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T12:26:25.919 INFO:teuthology.orchestra.run.trial176.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T12:26:25.919 INFO:teuthology.orchestra.run.trial176.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T12:26:25.919 INFO:teuthology.orchestra.run.trial176.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.919 INFO:teuthology.orchestra.run.trial176.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.919 INFO:teuthology.orchestra.run.trial176.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.919 INFO:teuthology.orchestra.run.trial176.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.919 INFO:teuthology.orchestra.run.trial176.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.919 INFO:teuthology.orchestra.run.trial176.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:25.920 INFO:teuthology.orchestra.run.trial176.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T12:26:25.920 INFO:teuthology.orchestra.run.trial176.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T12:26:25.920 INFO:teuthology.orchestra.run.trial176.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T12:26:25.920 INFO:teuthology.orchestra.run.trial176.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T12:26:25.920 INFO:teuthology.orchestra.run.trial176.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T12:26:25.920 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:25.920 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:25.963 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-test 2026-02-17T12:26:26.270 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:26.352 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:26.353 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:26.353 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repository Size 2026-02-17T12:26:26.354 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:26.354 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T12:26:26.354 INFO:teuthology.orchestra.run.trial176.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T12:26:26.354 INFO:teuthology.orchestra.run.trial176.stdout:Installing dependencies: 2026-02-17T12:26:26.354 INFO:teuthology.orchestra.run.trial176.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T12:26:26.354 INFO:teuthology.orchestra.run.trial176.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T12:26:26.354 INFO:teuthology.orchestra.run.trial176.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T12:26:26.354 INFO:teuthology.orchestra.run.trial176.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T12:26:26.354 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:26.354 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T12:26:26.354 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:26.355 INFO:teuthology.orchestra.run.trial176.stdout:Install 5 Packages 2026-02-17T12:26:26.355 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:26.355 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 50 M 2026-02-17T12:26:26.355 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 212 M 2026-02-17T12:26:26.355 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T12:26:26.516 INFO:teuthology.orchestra.run.trial176.stdout:(1/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T12:26:27.288 INFO:teuthology.orchestra.run.trial176.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 273 kB/s | 233 kB 00:00 2026-02-17T12:26:27.353 INFO:teuthology.orchestra.run.trial176.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 363 kB/s | 303 kB 00:00 2026-02-17T12:26:27.479 INFO:teuthology.orchestra.run.trial176.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 333 kB/s | 64 kB 00:00 2026-02-17T12:26:27.876 INFO:teuthology.orchestra.run.trial176.stdout:(5/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 34 MB/s | 50 MB 00:01 2026-02-17T12:26:27.878 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:26:27.878 INFO:teuthology.orchestra.run.trial176.stdout:Total 33 MB/s | 50 MB 00:01 2026-02-17T12:26:27.905 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T12:26:27.915 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T12:26:27.915 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T12:26:28.106 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T12:26:28.106 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T12:26:28.320 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T12:26:28.325 INFO:teuthology.orchestra.run.trial176.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T12:26:28.330 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T12:26:28.338 INFO:teuthology.orchestra.run.trial176.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T12:26:28.339 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T12:26:30.628 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T12:26:30.646 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T12:26:30.880 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T12:26:30.881 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T12:26:30.881 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T12:26:30.881 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T12:26:30.881 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T12:26:30.937 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T12:26:30.937 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:30.937 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T12:26:30.937 INFO:teuthology.orchestra.run.trial176.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:30.937 INFO:teuthology.orchestra.run.trial176.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:30.937 INFO:teuthology.orchestra.run.trial176.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T12:26:30.937 INFO:teuthology.orchestra.run.trial176.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T12:26:30.937 INFO:teuthology.orchestra.run.trial176.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T12:26:30.938 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:30.938 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:30.969 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph 2026-02-17T12:26:31.273 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:17 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:31.360 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:31.362 INFO:teuthology.orchestra.run.trial176.stdout:====================================================================================== 2026-02-17T12:26:31.363 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repository Size 2026-02-17T12:26:31.363 INFO:teuthology.orchestra.run.trial176.stdout:====================================================================================== 2026-02-17T12:26:31.363 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T12:26:31.363 INFO:teuthology.orchestra.run.trial176.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T12:26:31.363 INFO:teuthology.orchestra.run.trial176.stdout:Installing dependencies: 2026-02-17T12:26:31.363 INFO:teuthology.orchestra.run.trial176.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T12:26:31.363 INFO:teuthology.orchestra.run.trial176.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T12:26:31.363 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T12:26:31.363 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T12:26:31.364 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T12:26:31.364 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T12:26:31.364 INFO:teuthology.orchestra.run.trial176.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T12:26:31.364 INFO:teuthology.orchestra.run.trial176.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T12:26:31.364 INFO:teuthology.orchestra.run.trial176.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T12:26:31.364 INFO:teuthology.orchestra.run.trial176.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T12:26:31.364 INFO:teuthology.orchestra.run.trial176.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T12:26:31.364 INFO:teuthology.orchestra.run.trial176.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T12:26:31.364 INFO:teuthology.orchestra.run.trial176.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T12:26:31.364 INFO:teuthology.orchestra.run.trial176.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T12:26:31.364 INFO:teuthology.orchestra.run.trial176.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T12:26:31.364 INFO:teuthology.orchestra.run.trial176.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T12:26:31.365 INFO:teuthology.orchestra.run.trial176.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T12:26:31.365 INFO:teuthology.orchestra.run.trial176.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T12:26:31.365 INFO:teuthology.orchestra.run.trial176.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T12:26:31.365 INFO:teuthology.orchestra.run.trial176.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T12:26:31.365 INFO:teuthology.orchestra.run.trial176.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T12:26:31.365 INFO:teuthology.orchestra.run.trial176.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T12:26:31.365 INFO:teuthology.orchestra.run.trial176.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T12:26:31.365 INFO:teuthology.orchestra.run.trial176.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T12:26:31.365 INFO:teuthology.orchestra.run.trial176.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T12:26:31.365 INFO:teuthology.orchestra.run.trial176.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T12:26:31.365 INFO:teuthology.orchestra.run.trial176.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T12:26:31.365 INFO:teuthology.orchestra.run.trial176.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T12:26:31.365 INFO:teuthology.orchestra.run.trial176.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T12:26:31.366 INFO:teuthology.orchestra.run.trial176.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T12:26:31.366 INFO:teuthology.orchestra.run.trial176.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T12:26:31.366 INFO:teuthology.orchestra.run.trial176.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T12:26:31.366 INFO:teuthology.orchestra.run.trial176.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T12:26:31.366 INFO:teuthology.orchestra.run.trial176.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T12:26:31.366 INFO:teuthology.orchestra.run.trial176.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T12:26:31.366 INFO:teuthology.orchestra.run.trial176.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T12:26:31.366 INFO:teuthology.orchestra.run.trial176.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T12:26:31.366 INFO:teuthology.orchestra.run.trial176.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T12:26:31.366 INFO:teuthology.orchestra.run.trial176.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T12:26:31.366 INFO:teuthology.orchestra.run.trial176.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T12:26:31.366 INFO:teuthology.orchestra.run.trial176.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T12:26:31.366 INFO:teuthology.orchestra.run.trial176.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T12:26:31.367 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T12:26:31.367 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T12:26:31.367 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T12:26:31.367 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T12:26:31.367 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T12:26:31.367 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T12:26:31.367 INFO:teuthology.orchestra.run.trial176.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T12:26:31.367 INFO:teuthology.orchestra.run.trial176.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T12:26:31.367 INFO:teuthology.orchestra.run.trial176.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T12:26:31.367 INFO:teuthology.orchestra.run.trial176.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T12:26:31.367 INFO:teuthology.orchestra.run.trial176.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T12:26:31.367 INFO:teuthology.orchestra.run.trial176.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T12:26:31.367 INFO:teuthology.orchestra.run.trial176.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T12:26:31.368 INFO:teuthology.orchestra.run.trial176.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T12:26:31.368 INFO:teuthology.orchestra.run.trial176.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T12:26:31.368 INFO:teuthology.orchestra.run.trial176.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T12:26:31.368 INFO:teuthology.orchestra.run.trial176.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T12:26:31.368 INFO:teuthology.orchestra.run.trial176.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T12:26:31.368 INFO:teuthology.orchestra.run.trial176.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T12:26:31.368 INFO:teuthology.orchestra.run.trial176.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T12:26:31.368 INFO:teuthology.orchestra.run.trial176.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T12:26:31.368 INFO:teuthology.orchestra.run.trial176.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T12:26:31.368 INFO:teuthology.orchestra.run.trial176.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T12:26:31.368 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T12:26:31.368 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T12:26:31.368 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T12:26:31.369 INFO:teuthology.orchestra.run.trial176.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T12:26:31.369 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T12:26:31.369 INFO:teuthology.orchestra.run.trial176.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T12:26:31.369 INFO:teuthology.orchestra.run.trial176.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T12:26:31.369 INFO:teuthology.orchestra.run.trial176.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T12:26:31.369 INFO:teuthology.orchestra.run.trial176.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T12:26:31.369 INFO:teuthology.orchestra.run.trial176.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T12:26:31.369 INFO:teuthology.orchestra.run.trial176.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T12:26:31.369 INFO:teuthology.orchestra.run.trial176.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T12:26:31.369 INFO:teuthology.orchestra.run.trial176.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T12:26:31.369 INFO:teuthology.orchestra.run.trial176.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T12:26:31.369 INFO:teuthology.orchestra.run.trial176.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T12:26:31.369 INFO:teuthology.orchestra.run.trial176.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T12:26:31.370 INFO:teuthology.orchestra.run.trial176.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T12:26:31.370 INFO:teuthology.orchestra.run.trial176.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T12:26:31.370 INFO:teuthology.orchestra.run.trial176.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T12:26:31.370 INFO:teuthology.orchestra.run.trial176.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T12:26:31.370 INFO:teuthology.orchestra.run.trial176.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T12:26:31.370 INFO:teuthology.orchestra.run.trial176.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T12:26:31.370 INFO:teuthology.orchestra.run.trial176.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T12:26:31.370 INFO:teuthology.orchestra.run.trial176.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T12:26:31.370 INFO:teuthology.orchestra.run.trial176.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T12:26:31.370 INFO:teuthology.orchestra.run.trial176.stdout:Installing weak dependencies: 2026-02-17T12:26:31.370 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T12:26:31.370 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T12:26:31.370 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T12:26:31.371 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T12:26:31.371 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T12:26:31.371 INFO:teuthology.orchestra.run.trial176.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T12:26:31.371 INFO:teuthology.orchestra.run.trial176.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T12:26:31.371 INFO:teuthology.orchestra.run.trial176.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T12:26:31.371 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:31.371 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T12:26:31.371 INFO:teuthology.orchestra.run.trial176.stdout:====================================================================================== 2026-02-17T12:26:31.371 INFO:teuthology.orchestra.run.trial176.stdout:Install 99 Packages 2026-02-17T12:26:31.371 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:31.372 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 95 M 2026-02-17T12:26:31.372 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 520 M 2026-02-17T12:26:31.372 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T12:26:32.007 INFO:teuthology.orchestra.run.trial176.stdout:(1/99): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 115 kB/s | 6.5 kB 00:00 2026-02-17T12:26:32.082 INFO:teuthology.orchestra.run.trial176.stdout:(2/99): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 8.2 MB/s | 1.1 MB 00:00 2026-02-17T12:26:32.105 INFO:teuthology.orchestra.run.trial176.stdout:(3/99): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 16 MB/s | 2.4 MB 00:00 2026-02-17T12:26:32.131 INFO:teuthology.orchestra.run.trial176.stdout:(4/99): ceph-grafana-dashboards-19.2.3-675.g3c9 1.2 MB/s | 31 kB 00:00 2026-02-17T12:26:32.160 INFO:teuthology.orchestra.run.trial176.stdout:(5/99): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 5.1 MB/s | 150 kB 00:00 2026-02-17T12:26:32.318 INFO:teuthology.orchestra.run.trial176.stdout:(6/99): ceph-mgr-dashboard-19.2.3-675.g3c96dfb3 24 MB/s | 3.8 MB 00:00 2026-02-17T12:26:32.344 INFO:teuthology.orchestra.run.trial176.stdout:(7/99): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_6 14 MB/s | 4.7 MB 00:00 2026-02-17T12:26:32.391 INFO:teuthology.orchestra.run.trial176.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 472 kB/s | 22 kB 00:00 2026-02-17T12:26:32.445 INFO:teuthology.orchestra.run.trial176.stdout:(9/99): ceph-mgr-modules-core-19.2.3-675.g3c96d 4.6 MB/s | 253 kB 00:00 2026-02-17T12:26:32.497 INFO:teuthology.orchestra.run.trial176.stdout:(10/99): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 947 kB/s | 49 kB 00:00 2026-02-17T12:26:32.551 INFO:teuthology.orchestra.run.trial176.stdout:(11/99): ceph-prometheus-alerts-19.2.3-675.g3c9 311 kB/s | 17 kB 00:00 2026-02-17T12:26:32.575 INFO:teuthology.orchestra.run.trial176.stdout:(12/99): ceph-mgr-diskprediction-local-19.2.3-6 29 MB/s | 7.4 MB 00:00 2026-02-17T12:26:32.595 INFO:teuthology.orchestra.run.trial176.stdout:(13/99): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 6.7 MB/s | 299 kB 00:00 2026-02-17T12:26:32.612 INFO:teuthology.orchestra.run.trial176.stdout:(14/99): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 20 MB/s | 769 kB 00:00 2026-02-17T12:26:32.703 INFO:teuthology.orchestra.run.trial176.stdout:(15/99): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T12:26:32.703 INFO:teuthology.orchestra.run.trial176.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 445 kB/s | 40 kB 00:00 2026-02-17T12:26:32.777 INFO:teuthology.orchestra.run.trial176.stdout:(17/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 1.9 MB/s | 350 kB 00:00 2026-02-17T12:26:32.812 INFO:teuthology.orchestra.run.trial176.stdout:(18/99): libquadmath-11.5.0-14.el9.x86_64.rpm 5.1 MB/s | 184 kB 00:00 2026-02-17T12:26:32.814 INFO:teuthology.orchestra.run.trial176.stdout:(19/99): libconfig-1.7.2-9.el9.x86_64.rpm 644 kB/s | 72 kB 00:00 2026-02-17T12:26:32.851 INFO:teuthology.orchestra.run.trial176.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.4 MB/s | 253 kB 00:00 2026-02-17T12:26:32.878 INFO:teuthology.orchestra.run.trial176.stdout:(21/99): libgfortran-11.5.0-14.el9.x86_64.rpm 4.4 MB/s | 794 kB 00:00 2026-02-17T12:26:32.882 INFO:teuthology.orchestra.run.trial176.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 3.3 MB/s | 106 kB 00:00 2026-02-17T12:26:32.906 INFO:teuthology.orchestra.run.trial176.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 4.7 MB/s | 135 kB 00:00 2026-02-17T12:26:32.915 INFO:teuthology.orchestra.run.trial176.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 4.5 MB/s | 150 kB 00:00 2026-02-17T12:26:32.934 INFO:teuthology.orchestra.run.trial176.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 4.5 MB/s | 126 kB 00:00 2026-02-17T12:26:32.949 INFO:teuthology.orchestra.run.trial176.stdout:(26/99): python3-cryptography-36.0.1-5.el9.x86_ 9.3 MB/s | 1.2 MB 00:00 2026-02-17T12:26:32.951 INFO:teuthology.orchestra.run.trial176.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 5.9 MB/s | 218 kB 00:00 2026-02-17T12:26:32.962 INFO:teuthology.orchestra.run.trial176.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 6.3 MB/s | 182 kB 00:00 2026-02-17T12:26:32.976 INFO:teuthology.orchestra.run.trial176.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 9.4 MB/s | 266 kB 00:00 2026-02-17T12:26:32.995 INFO:teuthology.orchestra.run.trial176.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 674 kB/s | 30 kB 00:00 2026-02-17T12:26:32.999 INFO:teuthology.orchestra.run.trial176.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 667 kB/s | 15 kB 00:00 2026-02-17T12:26:33.026 INFO:teuthology.orchestra.run.trial176.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 7.8 MB/s | 246 kB 00:00 2026-02-17T12:26:33.030 INFO:teuthology.orchestra.run.trial176.stdout:(33/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 44 MB/s | 3.0 MB 00:00 2026-02-17T12:26:33.031 INFO:teuthology.orchestra.run.trial176.stdout:(34/99): lua-5.4.4-4.el9.x86_64.rpm 5.8 MB/s | 188 kB 00:00 2026-02-17T12:26:33.049 INFO:teuthology.orchestra.run.trial176.stdout:(35/99): openblas-0.3.29-1.el9.x86_64.rpm 1.8 MB/s | 42 kB 00:00 2026-02-17T12:26:33.063 INFO:teuthology.orchestra.run.trial176.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 31 MB/s | 1.0 MB 00:00 2026-02-17T12:26:33.077 INFO:teuthology.orchestra.run.trial176.stdout:(37/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 113 MB/s | 5.3 MB 00:00 2026-02-17T12:26:33.089 INFO:teuthology.orchestra.run.trial176.stdout:(38/99): python3-devel-3.9.25-2.el9.x86_64.rpm 9.8 MB/s | 244 kB 00:00 2026-02-17T12:26:33.098 INFO:teuthology.orchestra.run.trial176.stdout:(39/99): python3-babel-2.9.1-2.el9.noarch.rpm 122 MB/s | 6.0 MB 00:00 2026-02-17T12:26:33.102 INFO:teuthology.orchestra.run.trial176.stdout:(40/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 10 MB/s | 249 kB 00:00 2026-02-17T12:26:33.112 INFO:teuthology.orchestra.run.trial176.stdout:(41/99): python3-libstoragemgmt-1.10.1-1.el9.x8 7.4 MB/s | 177 kB 00:00 2026-02-17T12:26:33.125 INFO:teuthology.orchestra.run.trial176.stdout:(42/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 45 MB/s | 1.2 MB 00:00 2026-02-17T12:26:33.126 INFO:teuthology.orchestra.run.trial176.stdout:(43/99): python3-mako-1.1.4-6.el9.noarch.rpm 7.1 MB/s | 172 kB 00:00 2026-02-17T12:26:33.133 INFO:teuthology.orchestra.run.trial176.stdout:(44/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.6 MB/s | 35 kB 00:00 2026-02-17T12:26:33.156 INFO:teuthology.orchestra.run.trial176.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 15 MB/s | 442 kB 00:00 2026-02-17T12:26:33.156 INFO:teuthology.orchestra.run.trial176.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 3.3 MB/s | 77 kB 00:00 2026-02-17T12:26:33.176 INFO:teuthology.orchestra.run.trial176.stdout:(47/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 122 MB/s | 6.1 MB 00:00 2026-02-17T12:26:33.180 INFO:teuthology.orchestra.run.trial176.stdout:(48/99): python3-protobuf-3.14.0-17.el9.noarch. 11 MB/s | 267 kB 00:00 2026-02-17T12:26:33.188 INFO:teuthology.orchestra.run.trial176.stdout:(49/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.1 MB/s | 159 kB 00:00 2026-02-17T12:26:33.200 INFO:teuthology.orchestra.run.trial176.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 11 MB/s | 279 kB 00:00 2026-02-17T12:26:33.201 INFO:teuthology.orchestra.run.trial176.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 2.5 MB/s | 54 kB 00:00 2026-02-17T12:26:33.227 INFO:teuthology.orchestra.run.trial176.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 42 kB 00:00 2026-02-17T12:26:33.228 INFO:teuthology.orchestra.run.trial176.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 6.9 MB/s | 189 kB 00:00 2026-02-17T12:26:33.262 INFO:teuthology.orchestra.run.trial176.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 2.6 MB/s | 90 kB 00:00 2026-02-17T12:26:33.340 INFO:teuthology.orchestra.run.trial176.stdout:(55/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 127 MB/s | 19 MB 00:00 2026-02-17T12:26:33.729 INFO:teuthology.orchestra.run.trial176.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T12:26:33.744 INFO:teuthology.orchestra.run.trial176.stdout:(56/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.3 MB/s | 551 kB 00:00 2026-02-17T12:26:33.756 INFO:teuthology.orchestra.run.trial176.stdout:[MIRROR] protobuf-compiler-3.14.0-17.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-17.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T12:26:33.797 INFO:teuthology.orchestra.run.trial176.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 369 kB/s | 19 kB 00:00 2026-02-17T12:26:33.858 INFO:teuthology.orchestra.run.trial176.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 2.4 MB/s | 151 kB 00:00 2026-02-17T12:26:33.947 INFO:teuthology.orchestra.run.trial176.stdout:(59/99): python3-asyncssh-2.13.2-5.el9.noarch.r 6.1 MB/s | 548 kB 00:00 2026-02-17T12:26:34.000 INFO:teuthology.orchestra.run.trial176.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 553 kB/s | 29 kB 00:00 2026-02-17T12:26:34.055 INFO:teuthology.orchestra.run.trial176.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 1.1 MB/s | 60 kB 00:00 2026-02-17T12:26:34.111 INFO:teuthology.orchestra.run.trial176.stdout:(62/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 787 kB/s | 43 kB 00:00 2026-02-17T12:26:34.164 INFO:teuthology.orchestra.run.trial176.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 602 kB/s | 32 kB 00:00 2026-02-17T12:26:34.217 INFO:teuthology.orchestra.run.trial176.stdout:(64/99): python3-certifi-2023.05.07-4.el9.noarc 266 kB/s | 14 kB 00:00 2026-02-17T12:26:34.279 INFO:teuthology.orchestra.run.trial176.stdout:(65/99): python3-cheroot-10.0.1-4.el9.noarch.rp 2.8 MB/s | 173 kB 00:00 2026-02-17T12:26:34.350 INFO:teuthology.orchestra.run.trial176.stdout:(66/99): python3-cherrypy-18.6.1-2.el9.noarch.r 4.9 MB/s | 358 kB 00:00 2026-02-17T12:26:34.416 INFO:teuthology.orchestra.run.trial176.stdout:(67/99): python3-google-auth-2.45.0-1.el9.noarc 3.8 MB/s | 254 kB 00:00 2026-02-17T12:26:34.492 INFO:teuthology.orchestra.run.trial176.stdout:(68/99): lua-devel-5.4.4-4.el9.x86_64.rpm 18 kB/s | 22 kB 00:01 2026-02-17T12:26:34.576 INFO:teuthology.orchestra.run.trial176.stdout:(69/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 13 MB/s | 2.0 MB 00:00 2026-02-17T12:26:34.632 INFO:teuthology.orchestra.run.trial176.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 2.5 MB/s | 139 kB 00:00 2026-02-17T12:26:34.686 INFO:teuthology.orchestra.run.trial176.stdout:(71/99): python3-isodate-0.6.1-3.el9.noarch.rpm 1.0 MB/s | 56 kB 00:00 2026-02-17T12:26:34.739 INFO:teuthology.orchestra.run.trial176.stdout:(72/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 202 kB/s | 11 kB 00:00 2026-02-17T12:26:34.788 INFO:teuthology.orchestra.run.trial176.stdout:(73/99): python3-grpcio-tools-1.46.7-10.el9.x86 488 kB/s | 144 kB 00:00 2026-02-17T12:26:34.791 INFO:teuthology.orchestra.run.trial176.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 334 kB/s | 18 kB 00:00 2026-02-17T12:26:34.844 INFO:teuthology.orchestra.run.trial176.stdout:(75/99): python3-jaraco-context-6.0.1-3.el9.noa 369 kB/s | 20 kB 00:00 2026-02-17T12:26:34.862 INFO:teuthology.orchestra.run.trial176.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 314 kB/s | 23 kB 00:00 2026-02-17T12:26:34.898 INFO:teuthology.orchestra.run.trial176.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 364 kB/s | 19 kB 00:00 2026-02-17T12:26:34.924 INFO:teuthology.orchestra.run.trial176.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 422 kB/s | 26 kB 00:00 2026-02-17T12:26:34.968 INFO:teuthology.orchestra.run.trial176.stdout:(79/99): python3-kubernetes-26.1.0-3.el9.noarch 15 MB/s | 1.0 MB 00:00 2026-02-17T12:26:34.991 INFO:teuthology.orchestra.run.trial176.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 696 kB/s | 46 kB 00:00 2026-02-17T12:26:35.022 INFO:teuthology.orchestra.run.trial176.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 1.4 MB/s | 79 kB 00:00 2026-02-17T12:26:35.075 INFO:teuthology.orchestra.run.trial176.stdout:(82/99): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2026-02-17T12:26:35.076 INFO:teuthology.orchestra.run.trial176.stdout:(83/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.0 MB/s | 86 kB 00:00 2026-02-17T12:26:35.132 INFO:teuthology.orchestra.run.trial176.stdout:(84/99): python3-pecan-1.4.2-3.el9.noarch.rpm 4.7 MB/s | 272 kB 00:00 2026-02-17T12:26:35.133 INFO:teuthology.orchestra.run.trial176.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 291 kB/s | 16 kB 00:00 2026-02-17T12:26:35.186 INFO:teuthology.orchestra.run.trial176.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.6 MB/s | 90 kB 00:00 2026-02-17T12:26:35.193 INFO:teuthology.orchestra.run.trial176.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 503 kB/s | 31 kB 00:00 2026-02-17T12:26:35.241 INFO:teuthology.orchestra.run.trial176.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 3.3 MB/s | 188 kB 00:00 2026-02-17T12:26:35.264 INFO:teuthology.orchestra.run.trial176.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 833 kB/s | 59 kB 00:00 2026-02-17T12:26:35.297 INFO:teuthology.orchestra.run.trial176.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 2.2 MB/s | 125 kB 00:00 2026-02-17T12:26:35.328 INFO:teuthology.orchestra.run.trial176.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 563 kB/s | 36 kB 00:00 2026-02-17T12:26:35.352 INFO:teuthology.orchestra.run.trial176.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 1.5 MB/s | 86 kB 00:00 2026-02-17T12:26:35.405 INFO:teuthology.orchestra.run.trial176.stdout:(93/99): python3-websocket-client-1.2.3-2.el9.n 1.6 MB/s | 90 kB 00:00 2026-02-17T12:26:35.454 INFO:teuthology.orchestra.run.trial176.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2026-02-17T12:26:35.464 INFO:teuthology.orchestra.run.trial176.stdout:(95/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 7.1 MB/s | 427 kB 00:00 2026-02-17T12:26:35.510 INFO:teuthology.orchestra.run.trial176.stdout:(96/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 866 kB/s | 48 kB 00:00 2026-02-17T12:26:35.518 INFO:teuthology.orchestra.run.trial176.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 415 kB/s | 22 kB 00:00 2026-02-17T12:26:35.564 INFO:teuthology.orchestra.run.trial176.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 367 kB/s | 20 kB 00:00 2026-02-17T12:26:35.570 INFO:teuthology.orchestra.run.trial176.stdout:(99/99): protobuf-compiler-3.14.0-17.el9.x86_64 373 kB/s | 862 kB 00:02 2026-02-17T12:26:35.574 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:26:35.574 INFO:teuthology.orchestra.run.trial176.stdout:Total 23 MB/s | 95 MB 00:04 2026-02-17T12:26:35.995 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T12:26:36.032 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T12:26:36.032 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T12:26:36.453 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T12:26:36.453 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T12:26:36.899 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T12:26:36.901 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T12:26:36.932 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T12:26:36.937 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T12:26:36.958 INFO:teuthology.orchestra.run.trial176.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T12:26:36.964 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T12:26:36.997 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T12:26:37.007 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T12:26:37.012 INFO:teuthology.orchestra.run.trial176.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T12:26:37.014 INFO:teuthology.orchestra.run.trial176.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T12:26:37.018 INFO:teuthology.orchestra.run.trial176.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T12:26:37.042 INFO:teuthology.orchestra.run.trial176.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T12:26:37.054 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T12:26:37.058 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T12:26:37.064 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T12:26:37.065 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T12:26:37.077 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T12:26:37.083 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T12:26:37.107 INFO:teuthology.orchestra.run.trial176.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T12:26:37.110 INFO:teuthology.orchestra.run.trial176.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T12:26:37.117 INFO:teuthology.orchestra.run.trial176.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T12:26:37.142 INFO:teuthology.orchestra.run.trial176.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T12:26:37.193 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T12:26:37.206 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T12:26:37.208 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T12:26:37.214 INFO:teuthology.orchestra.run.trial176.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T12:26:37.220 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T12:26:37.224 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T12:26:37.227 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T12:26:37.242 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T12:26:37.263 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T12:26:37.268 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T12:26:37.273 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T12:26:37.284 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T12:26:37.293 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T12:26:37.300 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T12:26:37.320 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T12:26:37.328 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T12:26:37.383 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T12:26:37.395 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T12:26:37.411 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T12:26:37.416 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T12:26:37.424 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T12:26:37.464 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T12:26:37.793 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T12:26:37.802 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T12:26:37.806 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T12:26:37.812 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T12:26:37.814 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T12:26:37.842 INFO:teuthology.orchestra.run.trial176.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T12:26:37.886 INFO:teuthology.orchestra.run.trial176.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T12:26:37.893 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T12:26:37.896 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T12:26:37.902 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T12:26:37.905 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T12:26:37.912 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T12:26:37.916 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T12:26:37.944 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T12:26:37.954 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T12:26:37.989 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T12:26:38.215 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T12:26:38.239 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T12:26:38.243 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T12:26:38.301 INFO:teuthology.orchestra.run.trial176.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T12:26:38.303 INFO:teuthology.orchestra.run.trial176.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T12:26:38.323 INFO:teuthology.orchestra.run.trial176.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T12:26:38.652 INFO:teuthology.orchestra.run.trial176.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T12:26:38.726 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T12:26:39.404 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T12:26:39.422 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T12:26:39.432 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T12:26:39.438 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T12:26:39.452 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T12:26:39.468 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T12:26:39.544 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T12:26:39.553 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T12:26:39.577 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T12:26:39.607 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T12:26:39.658 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T12:26:39.664 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T12:26:39.667 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T12:26:39.668 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T12:26:39.687 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T12:26:39.687 INFO:teuthology.orchestra.run.trial176.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T12:26:39.687 INFO:teuthology.orchestra.run.trial176.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T12:26:39.687 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:39.695 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T12:26:39.721 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T12:26:39.721 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T12:26:39.721 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:39.758 INFO:teuthology.orchestra.run.trial176.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T12:26:39.823 INFO:teuthology.orchestra.run.trial176.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T12:26:39.825 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T12:26:39.838 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 85/99 2026-02-17T12:26:39.838 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:26:39.839 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T12:26:39.839 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:40.555 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T12:26:40.580 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 86/99 2026-02-17T12:26:40.580 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:26:40.581 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T12:26:40.581 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T12:26:40.581 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T12:26:40.581 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:40.637 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T12:26:40.639 INFO:teuthology.orchestra.run.trial176.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 87/99 2026-02-17T12:26:40.644 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 88/99 2026-02-17T12:26:40.664 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 89/99 2026-02-17T12:26:40.665 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T12:26:41.162 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 90/99 2026-02-17T12:26:41.165 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T12:26:41.625 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 91/99 2026-02-17T12:26:41.627 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T12:26:41.640 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 92/99 2026-02-17T12:26:41.640 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T12:26:41.697 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 93/99 2026-02-17T12:26:41.747 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 94/99 2026-02-17T12:26:41.748 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T12:26:41.769 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 95/99 2026-02-17T12:26:41.769 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:26:41.769 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T12:26:41.770 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T12:26:41.770 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T12:26:41.770 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:41.782 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T12:26:42.005 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 96/99 2026-02-17T12:26:42.006 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T12:26:42.028 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/99 2026-02-17T12:26:42.028 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:26:42.028 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T12:26:42.028 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T12:26:42.029 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T12:26:42.029 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:42.131 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T12:26:42.153 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/99 2026-02-17T12:26:42.153 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:26:42.153 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T12:26:42.153 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T12:26:42.153 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T12:26:42.153 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:42.171 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T12:26:42.816 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 99/99 2026-02-17T12:26:42.816 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/99 2026-02-17T12:26:42.816 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/99 2026-02-17T12:26:42.816 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/99 2026-02-17T12:26:42.816 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/99 2026-02-17T12:26:42.816 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/99 2026-02-17T12:26:42.816 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/99 2026-02-17T12:26:42.817 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/99 2026-02-17T12:26:42.817 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/99 2026-02-17T12:26:42.817 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/99 2026-02-17T12:26:42.817 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/99 2026-02-17T12:26:42.817 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/99 2026-02-17T12:26:42.817 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/99 2026-02-17T12:26:42.817 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/99 2026-02-17T12:26:42.817 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/99 2026-02-17T12:26:42.817 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/99 2026-02-17T12:26:42.817 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T12:26:42.817 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T12:26:42.817 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T12:26:42.818 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T12:26:42.818 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T12:26:42.818 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T12:26:42.818 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T12:26:42.818 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T12:26:42.818 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T12:26:42.818 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T12:26:42.818 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T12:26:42.818 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T12:26:42.819 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T12:26:42.819 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T12:26:42.819 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T12:26:42.819 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T12:26:42.819 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T12:26:42.819 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T12:26:42.819 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T12:26:42.819 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T12:26:42.819 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T12:26:42.819 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T12:26:42.819 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T12:26:42.820 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T12:26:42.820 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T12:26:42.820 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T12:26:42.820 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T12:26:42.820 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T12:26:42.820 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T12:26:42.820 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T12:26:42.820 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T12:26:42.820 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T12:26:42.820 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T12:26:42.820 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T12:26:42.820 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T12:26:42.820 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T12:26:42.821 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T12:26:42.821 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T12:26:42.821 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T12:26:42.821 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T12:26:42.821 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T12:26:42.821 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T12:26:42.821 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T12:26:42.821 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T12:26:42.821 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T12:26:42.821 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T12:26:42.821 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T12:26:42.821 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T12:26:42.821 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T12:26:42.822 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T12:26:42.822 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T12:26:42.822 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T12:26:42.822 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T12:26:42.822 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T12:26:42.822 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T12:26:42.822 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T12:26:42.822 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T12:26:42.822 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T12:26:42.822 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T12:26:42.822 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T12:26:42.822 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T12:26:42.823 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T12:26:42.823 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T12:26:42.823 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T12:26:42.823 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T12:26:42.823 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T12:26:42.823 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T12:26:42.823 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T12:26:42.823 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T12:26:42.823 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T12:26:42.823 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T12:26:42.823 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T12:26:42.823 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T12:26:42.823 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T12:26:42.824 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T12:26:42.824 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T12:26:42.824 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T12:26:42.824 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T12:26:42.824 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T12:26:42.824 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T12:26:42.824 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T12:26:42.824 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T12:26:42.824 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T12:26:42.880 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T12:26:42.880 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:42.881 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T12:26:42.881 INFO:teuthology.orchestra.run.trial176.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T12:26:42.881 INFO:teuthology.orchestra.run.trial176.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:42.881 INFO:teuthology.orchestra.run.trial176.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:26:42.881 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:42.881 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:42.882 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:26:42.882 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:26:42.882 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:26:42.882 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:26:42.882 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:26:42.882 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:26:42.882 INFO:teuthology.orchestra.run.trial176.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:42.882 INFO:teuthology.orchestra.run.trial176.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:42.882 INFO:teuthology.orchestra.run.trial176.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:26:42.882 INFO:teuthology.orchestra.run.trial176.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:26:42.883 INFO:teuthology.orchestra.run.trial176.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:26:42.883 INFO:teuthology.orchestra.run.trial176.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T12:26:42.883 INFO:teuthology.orchestra.run.trial176.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T12:26:42.883 INFO:teuthology.orchestra.run.trial176.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T12:26:42.883 INFO:teuthology.orchestra.run.trial176.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T12:26:42.883 INFO:teuthology.orchestra.run.trial176.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T12:26:42.883 INFO:teuthology.orchestra.run.trial176.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T12:26:42.883 INFO:teuthology.orchestra.run.trial176.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T12:26:42.883 INFO:teuthology.orchestra.run.trial176.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T12:26:42.883 INFO:teuthology.orchestra.run.trial176.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T12:26:42.883 INFO:teuthology.orchestra.run.trial176.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T12:26:42.883 INFO:teuthology.orchestra.run.trial176.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T12:26:42.883 INFO:teuthology.orchestra.run.trial176.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T12:26:42.884 INFO:teuthology.orchestra.run.trial176.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T12:26:42.884 INFO:teuthology.orchestra.run.trial176.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T12:26:42.884 INFO:teuthology.orchestra.run.trial176.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T12:26:42.884 INFO:teuthology.orchestra.run.trial176.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T12:26:42.884 INFO:teuthology.orchestra.run.trial176.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T12:26:42.884 INFO:teuthology.orchestra.run.trial176.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T12:26:42.884 INFO:teuthology.orchestra.run.trial176.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T12:26:42.884 INFO:teuthology.orchestra.run.trial176.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T12:26:42.884 INFO:teuthology.orchestra.run.trial176.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T12:26:42.884 INFO:teuthology.orchestra.run.trial176.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T12:26:42.884 INFO:teuthology.orchestra.run.trial176.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T12:26:42.884 INFO:teuthology.orchestra.run.trial176.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T12:26:42.885 INFO:teuthology.orchestra.run.trial176.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T12:26:42.885 INFO:teuthology.orchestra.run.trial176.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T12:26:42.885 INFO:teuthology.orchestra.run.trial176.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T12:26:42.885 INFO:teuthology.orchestra.run.trial176.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T12:26:42.885 INFO:teuthology.orchestra.run.trial176.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T12:26:42.885 INFO:teuthology.orchestra.run.trial176.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T12:26:42.885 INFO:teuthology.orchestra.run.trial176.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T12:26:42.885 INFO:teuthology.orchestra.run.trial176.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T12:26:42.885 INFO:teuthology.orchestra.run.trial176.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T12:26:42.885 INFO:teuthology.orchestra.run.trial176.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T12:26:42.886 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T12:26:42.886 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T12:26:42.886 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T12:26:42.886 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T12:26:42.886 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T12:26:42.886 INFO:teuthology.orchestra.run.trial176.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T12:26:42.886 INFO:teuthology.orchestra.run.trial176.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T12:26:42.886 INFO:teuthology.orchestra.run.trial176.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T12:26:42.886 INFO:teuthology.orchestra.run.trial176.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T12:26:42.886 INFO:teuthology.orchestra.run.trial176.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T12:26:42.886 INFO:teuthology.orchestra.run.trial176.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T12:26:42.886 INFO:teuthology.orchestra.run.trial176.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T12:26:42.886 INFO:teuthology.orchestra.run.trial176.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T12:26:42.887 INFO:teuthology.orchestra.run.trial176.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T12:26:42.887 INFO:teuthology.orchestra.run.trial176.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T12:26:42.887 INFO:teuthology.orchestra.run.trial176.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T12:26:42.887 INFO:teuthology.orchestra.run.trial176.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T12:26:42.887 INFO:teuthology.orchestra.run.trial176.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T12:26:42.887 INFO:teuthology.orchestra.run.trial176.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T12:26:42.887 INFO:teuthology.orchestra.run.trial176.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T12:26:42.887 INFO:teuthology.orchestra.run.trial176.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T12:26:42.887 INFO:teuthology.orchestra.run.trial176.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T12:26:42.887 INFO:teuthology.orchestra.run.trial176.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T12:26:42.887 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T12:26:42.887 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T12:26:42.887 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T12:26:42.888 INFO:teuthology.orchestra.run.trial176.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T12:26:42.888 INFO:teuthology.orchestra.run.trial176.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T12:26:42.888 INFO:teuthology.orchestra.run.trial176.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T12:26:42.888 INFO:teuthology.orchestra.run.trial176.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T12:26:42.888 INFO:teuthology.orchestra.run.trial176.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T12:26:42.888 INFO:teuthology.orchestra.run.trial176.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T12:26:42.888 INFO:teuthology.orchestra.run.trial176.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T12:26:42.888 INFO:teuthology.orchestra.run.trial176.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T12:26:42.888 INFO:teuthology.orchestra.run.trial176.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T12:26:42.888 INFO:teuthology.orchestra.run.trial176.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T12:26:42.888 INFO:teuthology.orchestra.run.trial176.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T12:26:42.888 INFO:teuthology.orchestra.run.trial176.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T12:26:42.889 INFO:teuthology.orchestra.run.trial176.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T12:26:42.889 INFO:teuthology.orchestra.run.trial176.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T12:26:42.889 INFO:teuthology.orchestra.run.trial176.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T12:26:42.889 INFO:teuthology.orchestra.run.trial176.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T12:26:42.889 INFO:teuthology.orchestra.run.trial176.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T12:26:42.889 INFO:teuthology.orchestra.run.trial176.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T12:26:42.889 INFO:teuthology.orchestra.run.trial176.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T12:26:42.889 INFO:teuthology.orchestra.run.trial176.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T12:26:42.889 INFO:teuthology.orchestra.run.trial176.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T12:26:42.889 INFO:teuthology.orchestra.run.trial176.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T12:26:42.889 INFO:teuthology.orchestra.run.trial176.stdout: zip-3.0-35.el9.x86_64 2026-02-17T12:26:42.889 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:42.889 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:42.935 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-base 2026-02-17T12:26:43.248 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:43.312 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:26:43.329 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:43.330 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:43.330 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:43.351 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install cephadm 2026-02-17T12:26:43.656 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:43.720 INFO:teuthology.orchestra.run.trial176.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:26:43.737 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:43.738 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:43.738 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:43.758 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T12:26:44.065 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:44.147 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:44.147 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:44.148 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T12:26:44.148 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:44.148 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T12:26:44.148 INFO:teuthology.orchestra.run.trial176.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T12:26:44.148 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:44.148 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T12:26:44.148 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:44.148 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T12:26:44.148 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:44.148 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 145 k 2026-02-17T12:26:44.149 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 431 k 2026-02-17T12:26:44.149 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T12:26:44.232 INFO:teuthology.orchestra.run.trial176.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 1.7 MB/s | 145 kB 00:00 2026-02-17T12:26:44.232 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:26:44.233 INFO:teuthology.orchestra.run.trial176.stdout:Total 1.7 MB/s | 145 kB 00:00 2026-02-17T12:26:44.233 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T12:26:44.236 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T12:26:44.236 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T12:26:44.267 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T12:26:44.267 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T12:26:44.322 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T12:26:44.323 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:26:44.345 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:26:44.346 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:26:44.346 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T12:26:44.346 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:44.672 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:26:44.673 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:44.673 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T12:26:44.673 INFO:teuthology.orchestra.run.trial176.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:44.673 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:44.673 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:44.700 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-mgr 2026-02-17T12:26:45.010 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:45.074 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:26:45.092 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:45.092 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:45.092 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:45.114 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T12:26:45.424 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:45.488 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:26:45.506 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:45.506 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:45.506 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:45.528 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T12:26:45.834 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:45.898 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:26:45.915 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:45.916 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:45.916 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:45.937 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-mgr-rook 2026-02-17T12:26:46.252 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:46.315 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:26:46.333 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:46.333 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:46.333 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:46.356 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T12:26:46.668 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:46.732 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:26:46.750 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:46.750 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:46.750 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:46.772 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-fuse 2026-02-17T12:26:47.077 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:47.158 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:47.159 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:47.159 INFO:teuthology.orchestra.run.trial176.stdout: Package Architecture Version Repository Size 2026-02-17T12:26:47.159 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:47.159 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T12:26:47.159 INFO:teuthology.orchestra.run.trial176.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T12:26:47.159 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:47.159 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T12:26:47.160 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:47.160 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T12:26:47.160 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:47.160 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 1.2 M 2026-02-17T12:26:47.160 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 3.6 M 2026-02-17T12:26:47.160 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T12:26:47.277 INFO:teuthology.orchestra.run.trial176.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 9.8 MB/s | 1.2 MB 00:00 2026-02-17T12:26:47.277 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:26:47.277 INFO:teuthology.orchestra.run.trial176.stdout:Total 9.7 MB/s | 1.2 MB 00:00 2026-02-17T12:26:47.277 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T12:26:47.281 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T12:26:47.281 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T12:26:47.315 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T12:26:47.315 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T12:26:47.416 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T12:26:47.433 INFO:teuthology.orchestra.run.trial176.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:47.654 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:47.710 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:47.710 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:47.710 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T12:26:47.710 INFO:teuthology.orchestra.run.trial176.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:47.711 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:47.711 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:47.738 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install ceph-volume 2026-02-17T12:26:48.050 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:48.114 INFO:teuthology.orchestra.run.trial176.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:26:48.131 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:48.132 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:48.132 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:48.153 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install librados-devel 2026-02-17T12:26:48.463 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:48.545 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:48.545 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:48.545 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T12:26:48.545 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:48.545 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T12:26:48.545 INFO:teuthology.orchestra.run.trial176.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T12:26:48.545 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:48.545 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T12:26:48.546 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:48.546 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T12:26:48.546 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:48.546 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 127 k 2026-02-17T12:26:48.546 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 456 k 2026-02-17T12:26:48.546 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T12:26:48.889 INFO:teuthology.orchestra.run.trial176.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 369 kB/s | 127 kB 00:00 2026-02-17T12:26:48.889 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:26:48.889 INFO:teuthology.orchestra.run.trial176.stdout:Total 368 kB/s | 127 kB 00:00 2026-02-17T12:26:48.889 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T12:26:48.892 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T12:26:48.892 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T12:26:48.923 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T12:26:48.924 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T12:26:48.978 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T12:26:48.995 INFO:teuthology.orchestra.run.trial176.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:49.074 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:49.132 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:49.132 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:49.132 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T12:26:49.132 INFO:teuthology.orchestra.run.trial176.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:49.132 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:49.132 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:49.160 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install libcephfs2 2026-02-17T12:26:49.467 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:49.531 INFO:teuthology.orchestra.run.trial176.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:26:49.548 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:49.549 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:49.549 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:49.570 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install libcephfs-devel 2026-02-17T12:26:49.880 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:49.962 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:49.962 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:49.962 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T12:26:49.962 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:49.962 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T12:26:49.962 INFO:teuthology.orchestra.run.trial176.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T12:26:49.962 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:49.962 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T12:26:49.963 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:49.963 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T12:26:49.963 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:49.963 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 34 k 2026-02-17T12:26:49.963 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 153 k 2026-02-17T12:26:49.963 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T12:26:50.221 INFO:teuthology.orchestra.run.trial176.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 130 kB/s | 34 kB 00:00 2026-02-17T12:26:50.221 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:26:50.222 INFO:teuthology.orchestra.run.trial176.stdout:Total 129 kB/s | 34 kB 00:00 2026-02-17T12:26:50.222 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T12:26:50.223 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T12:26:50.224 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T12:26:50.226 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T12:26:50.226 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T12:26:50.246 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T12:26:50.262 INFO:teuthology.orchestra.run.trial176.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:50.319 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:50.375 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:50.375 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:50.375 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T12:26:50.375 INFO:teuthology.orchestra.run.trial176.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:50.375 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:50.375 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:50.403 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install librados2 2026-02-17T12:26:50.710 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:50.773 INFO:teuthology.orchestra.run.trial176.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:26:50.791 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:50.791 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:50.791 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:50.812 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install librbd1 2026-02-17T12:26:51.120 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:51.184 INFO:teuthology.orchestra.run.trial176.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:26:51.202 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:51.203 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:51.203 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:51.224 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install python3-rados 2026-02-17T12:26:51.532 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:51.596 INFO:teuthology.orchestra.run.trial176.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:26:51.613 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:51.614 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:51.614 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:51.635 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install python3-rgw 2026-02-17T12:26:51.942 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:52.006 INFO:teuthology.orchestra.run.trial176.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:26:52.023 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:52.024 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:52.024 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:52.045 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install python3-cephfs 2026-02-17T12:26:52.359 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:52.422 INFO:teuthology.orchestra.run.trial176.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:26:52.439 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:52.440 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:52.440 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:52.461 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install python3-rbd 2026-02-17T12:26:52.770 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:52.834 INFO:teuthology.orchestra.run.trial176.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:26:52.852 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:52.852 INFO:teuthology.orchestra.run.trial176.stdout:Nothing to do. 2026-02-17T12:26:52.852 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:52.874 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install rbd-fuse 2026-02-17T12:26:53.186 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:53.268 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:53.269 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:53.269 INFO:teuthology.orchestra.run.trial176.stdout: Package Architecture Version Repository Size 2026-02-17T12:26:53.269 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:53.269 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T12:26:53.270 INFO:teuthology.orchestra.run.trial176.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T12:26:53.270 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:53.270 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T12:26:53.270 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:53.270 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T12:26:53.270 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:53.270 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 85 k 2026-02-17T12:26:53.270 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 227 k 2026-02-17T12:26:53.270 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T12:26:53.343 INFO:teuthology.orchestra.run.trial176.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T12:26:53.344 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:26:53.344 INFO:teuthology.orchestra.run.trial176.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T12:26:53.344 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T12:26:53.347 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T12:26:53.347 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T12:26:53.379 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T12:26:53.379 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T12:26:53.432 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T12:26:53.449 INFO:teuthology.orchestra.run.trial176.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:53.531 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:53.588 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:53.588 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:53.589 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T12:26:53.589 INFO:teuthology.orchestra.run.trial176.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:53.589 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:53.589 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:53.615 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install rbd-mirror 2026-02-17T12:26:53.927 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:54.008 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:54.008 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:54.009 INFO:teuthology.orchestra.run.trial176.stdout: Package Arch Version Repo Size 2026-02-17T12:26:54.009 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:54.009 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T12:26:54.009 INFO:teuthology.orchestra.run.trial176.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T12:26:54.009 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:54.009 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T12:26:54.009 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:54.009 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T12:26:54.009 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:54.009 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 3.1 M 2026-02-17T12:26:54.010 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 13 M 2026-02-17T12:26:54.010 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T12:26:54.158 INFO:teuthology.orchestra.run.trial176.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T12:26:54.159 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:26:54.159 INFO:teuthology.orchestra.run.trial176.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T12:26:54.159 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T12:26:54.163 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T12:26:54.163 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T12:26:54.202 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T12:26:54.203 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T12:26:54.399 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T12:26:54.400 INFO:teuthology.orchestra.run.trial176.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:54.422 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:54.422 INFO:teuthology.orchestra.run.trial176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:26:54.423 INFO:teuthology.orchestra.run.trial176.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T12:26:54.423 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T12:26:54.423 INFO:teuthology.orchestra.run.trial176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T12:26:54.423 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:54.708 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:54.708 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:54.708 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T12:26:54.708 INFO:teuthology.orchestra.run.trial176.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:54.708 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:54.708 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:54.735 DEBUG:teuthology.orchestra.run.trial176:> sudo yum -y install rbd-nbd 2026-02-17T12:26:55.044 INFO:teuthology.orchestra.run.trial176.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 12:26:14 PM UTC. 2026-02-17T12:26:55.126 INFO:teuthology.orchestra.run.trial176.stdout:Dependencies resolved. 2026-02-17T12:26:55.126 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:55.127 INFO:teuthology.orchestra.run.trial176.stdout: Package Architecture Version Repository Size 2026-02-17T12:26:55.127 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:55.127 INFO:teuthology.orchestra.run.trial176.stdout:Installing: 2026-02-17T12:26:55.127 INFO:teuthology.orchestra.run.trial176.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T12:26:55.127 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:55.127 INFO:teuthology.orchestra.run.trial176.stdout:Transaction Summary 2026-02-17T12:26:55.127 INFO:teuthology.orchestra.run.trial176.stdout:================================================================================ 2026-02-17T12:26:55.127 INFO:teuthology.orchestra.run.trial176.stdout:Install 1 Package 2026-02-17T12:26:55.127 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:55.127 INFO:teuthology.orchestra.run.trial176.stdout:Total download size: 171 k 2026-02-17T12:26:55.128 INFO:teuthology.orchestra.run.trial176.stdout:Installed size: 490 k 2026-02-17T12:26:55.128 INFO:teuthology.orchestra.run.trial176.stdout:Downloading Packages: 2026-02-17T12:26:55.241 INFO:teuthology.orchestra.run.trial176.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2026-02-17T12:26:55.241 INFO:teuthology.orchestra.run.trial176.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:26:55.242 INFO:teuthology.orchestra.run.trial176.stdout:Total 1.5 MB/s | 171 kB 00:00 2026-02-17T12:26:55.242 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction check 2026-02-17T12:26:55.245 INFO:teuthology.orchestra.run.trial176.stdout:Transaction check succeeded. 2026-02-17T12:26:55.245 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction test 2026-02-17T12:26:55.276 INFO:teuthology.orchestra.run.trial176.stdout:Transaction test succeeded. 2026-02-17T12:26:55.276 INFO:teuthology.orchestra.run.trial176.stdout:Running transaction 2026-02-17T12:26:55.332 INFO:teuthology.orchestra.run.trial176.stdout: Preparing : 1/1 2026-02-17T12:26:55.349 INFO:teuthology.orchestra.run.trial176.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:55.435 INFO:teuthology.orchestra.run.trial176.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:55.492 INFO:teuthology.orchestra.run.trial176.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:26:55.493 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:55.493 INFO:teuthology.orchestra.run.trial176.stdout:Installed: 2026-02-17T12:26:55.493 INFO:teuthology.orchestra.run.trial176.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:26:55.493 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:55.493 INFO:teuthology.orchestra.run.trial176.stdout:Complete! 2026-02-17T12:26:55.524 DEBUG:teuthology.parallel:result is None 2026-02-17T12:26:55.524 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:26:55.687 DEBUG:teuthology.orchestra.run.trial176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T12:26:55.708 INFO:teuthology.orchestra.run.trial176.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T12:26:55.709 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T12:26:55.709 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T12:26:55.712 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T12:26:55.712 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:26:55.712 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T12:26:55.775 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T12:26:55.775 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:26:55.775 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T12:26:55.838 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T12:26:55.901 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T12:26:55.901 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:26:55.901 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T12:26:55.965 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T12:26:56.030 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T12:26:56.031 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:26:56.031 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T12:26:56.093 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T12:26:56.157 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T12:26:56.240 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T12:26:56.241 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod 777 /var/log/ceph 2026-02-17T12:26:56.265 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T12:26:56.265 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T12:26:56.329 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T12:26:56.329 DEBUG:teuthology.orchestra.run.trial176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T12:26:56.403 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T12:26:56.403 INFO:tasks.ceph:config {'conf': {'mon': {'debug auth': 30, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['no reply from', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(MGR_DOWN\\)', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T12:26:56.404 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51452', 'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'description': 'rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51452', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 4581, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'targets': {'trial176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHvYh5Fuq3YONo+q2fHCDh/FcY0bJSIJDjEQM2qfZdBuj2VaxRWI6lTBiLIvusQWhlGHssqjesuRQ3plgmMUhwA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'debug auth': 30, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'log-ignorelist': ['no reply from', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(MGR_DOWN\\)', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'cluster': 'ceph'}}, {'full_sequential': [{'radosbench': {'clients': ['client.0'], 'time': 30}}, {'rebuild_mondb': None}, {'radosbench': {'clients': ['client.0'], 'time': 30}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:10:36', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T12:26:56.404 DEBUG:teuthology.orchestra.run.trial176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T12:26:56.449 DEBUG:teuthology.orchestra.run.trial176:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T12:26:56.515 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:26:56.515 DEBUG:teuthology.orchestra.run.trial176:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T12:26:56.572 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T12:26:56.572 DEBUG:teuthology.orchestra.run.trial176:> stat /dev/vg_nvme/lv_1 2026-02-17T12:26:56.629 INFO:teuthology.orchestra.run.trial176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T12:26:56.630 INFO:teuthology.orchestra.run.trial176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:26:56.630 INFO:teuthology.orchestra.run.trial176.stdout:Device: 6h/6d Inode: 1292 Links: 1 2026-02-17T12:26:56.630 INFO:teuthology.orchestra.run.trial176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:26:56.630 INFO:teuthology.orchestra.run.trial176.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:26:56.630 INFO:teuthology.orchestra.run.trial176.stdout:Access: 2026-02-17 12:26:54.557542034 +0000 2026-02-17T12:26:56.630 INFO:teuthology.orchestra.run.trial176.stdout:Modify: 2026-02-17 12:26:19.198779647 +0000 2026-02-17T12:26:56.630 INFO:teuthology.orchestra.run.trial176.stdout:Change: 2026-02-17 12:26:19.198779647 +0000 2026-02-17T12:26:56.630 INFO:teuthology.orchestra.run.trial176.stdout: Birth: 2026-02-17 12:26:19.198779647 +0000 2026-02-17T12:26:56.631 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T12:26:56.693 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records in 2026-02-17T12:26:56.693 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records out 2026-02-17T12:26:56.693 INFO:teuthology.orchestra.run.trial176.stderr:512 bytes copied, 0.000151372 s, 3.4 MB/s 2026-02-17T12:26:56.694 DEBUG:teuthology.orchestra.run.trial176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T12:26:56.751 DEBUG:teuthology.orchestra.run.trial176:> stat /dev/vg_nvme/lv_2 2026-02-17T12:26:56.808 INFO:teuthology.orchestra.run.trial176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T12:26:56.808 INFO:teuthology.orchestra.run.trial176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:26:56.809 INFO:teuthology.orchestra.run.trial176.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-17T12:26:56.809 INFO:teuthology.orchestra.run.trial176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:26:56.809 INFO:teuthology.orchestra.run.trial176.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:26:56.809 INFO:teuthology.orchestra.run.trial176.stdout:Access: 2026-02-17 12:26:54.557542034 +0000 2026-02-17T12:26:56.809 INFO:teuthology.orchestra.run.trial176.stdout:Modify: 2026-02-17 12:26:19.198779647 +0000 2026-02-17T12:26:56.810 INFO:teuthology.orchestra.run.trial176.stdout:Change: 2026-02-17 12:26:19.198779647 +0000 2026-02-17T12:26:56.810 INFO:teuthology.orchestra.run.trial176.stdout: Birth: 2026-02-17 12:26:19.198779647 +0000 2026-02-17T12:26:56.810 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T12:26:56.870 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records in 2026-02-17T12:26:56.870 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records out 2026-02-17T12:26:56.870 INFO:teuthology.orchestra.run.trial176.stderr:512 bytes copied, 0.000142265 s, 3.6 MB/s 2026-02-17T12:26:56.871 DEBUG:teuthology.orchestra.run.trial176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T12:26:56.930 DEBUG:teuthology.orchestra.run.trial176:> stat /dev/vg_nvme/lv_3 2026-02-17T12:26:56.986 INFO:teuthology.orchestra.run.trial176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T12:26:56.986 INFO:teuthology.orchestra.run.trial176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:26:56.986 INFO:teuthology.orchestra.run.trial176.stdout:Device: 6h/6d Inode: 1315 Links: 1 2026-02-17T12:26:56.986 INFO:teuthology.orchestra.run.trial176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:26:56.986 INFO:teuthology.orchestra.run.trial176.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:26:56.986 INFO:teuthology.orchestra.run.trial176.stdout:Access: 2026-02-17 12:26:54.557542034 +0000 2026-02-17T12:26:56.986 INFO:teuthology.orchestra.run.trial176.stdout:Modify: 2026-02-17 12:26:19.199779628 +0000 2026-02-17T12:26:56.986 INFO:teuthology.orchestra.run.trial176.stdout:Change: 2026-02-17 12:26:19.199779628 +0000 2026-02-17T12:26:56.986 INFO:teuthology.orchestra.run.trial176.stdout: Birth: 2026-02-17 12:26:19.199779628 +0000 2026-02-17T12:26:56.986 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T12:26:57.048 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records in 2026-02-17T12:26:57.049 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records out 2026-02-17T12:26:57.049 INFO:teuthology.orchestra.run.trial176.stderr:512 bytes copied, 0.000166119 s, 3.1 MB/s 2026-02-17T12:26:57.050 DEBUG:teuthology.orchestra.run.trial176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T12:26:57.107 DEBUG:teuthology.orchestra.run.trial176:> stat /dev/vg_nvme/lv_4 2026-02-17T12:26:57.165 INFO:teuthology.orchestra.run.trial176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T12:26:57.166 INFO:teuthology.orchestra.run.trial176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:26:57.166 INFO:teuthology.orchestra.run.trial176.stdout:Device: 6h/6d Inode: 1313 Links: 1 2026-02-17T12:26:57.166 INFO:teuthology.orchestra.run.trial176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:26:57.166 INFO:teuthology.orchestra.run.trial176.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:26:57.166 INFO:teuthology.orchestra.run.trial176.stdout:Access: 2026-02-17 12:26:54.558541998 +0000 2026-02-17T12:26:57.167 INFO:teuthology.orchestra.run.trial176.stdout:Modify: 2026-02-17 12:26:19.199779628 +0000 2026-02-17T12:26:57.167 INFO:teuthology.orchestra.run.trial176.stdout:Change: 2026-02-17 12:26:19.199779628 +0000 2026-02-17T12:26:57.167 INFO:teuthology.orchestra.run.trial176.stdout: Birth: 2026-02-17 12:26:19.199779628 +0000 2026-02-17T12:26:57.167 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T12:26:57.229 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records in 2026-02-17T12:26:57.229 INFO:teuthology.orchestra.run.trial176.stderr:1+0 records out 2026-02-17T12:26:57.229 INFO:teuthology.orchestra.run.trial176.stderr:512 bytes copied, 0.000134821 s, 3.8 MB/s 2026-02-17T12:26:57.230 DEBUG:teuthology.orchestra.run.trial176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T12:26:57.289 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T12:26:57.289 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial176.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T12:26:57.289 INFO:tasks.ceph:Generating config... 2026-02-17T12:26:57.291 INFO:tasks.ceph:[mon] debug auth = 30 2026-02-17T12:26:57.291 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T12:26:57.292 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T12:26:57.292 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T12:26:57.292 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T12:26:57.292 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-17T12:26:57.292 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-17T12:26:57.292 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-17T12:26:57.292 INFO:tasks.ceph:[global] ms type = async 2026-02-17T12:26:57.292 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T12:26:57.292 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T12:26:57.292 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T12:26:57.293 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2026-02-17T12:26:57.293 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-17T12:26:57.293 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T12:26:57.293 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T12:26:57.293 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-17T12:26:57.293 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-17T12:26:57.293 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T12:26:57.293 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T12:26:57.293 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T12:26:57.293 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T12:26:57.293 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T12:26:57.293 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T12:26:57.294 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T12:26:57.294 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T12:26:57.294 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T12:26:57.294 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T12:26:57.294 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T12:26:57.294 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T12:26:57.294 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T12:26:57.294 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T12:26:57.294 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T12:26:57.294 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T12:26:57.365 INFO:teuthology.orchestra.run.trial176.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T12:26:57.367 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T12:26:57.443 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T12:26:57.508 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.176'), ('mon.b', '[v2:10.20.193.176:3301,v1:10.20.193.176:6790]'), ('mon.c', '[v2:10.20.193.176:3302,v1:10.20.193.176:6791]')] 2026-02-17T12:26:57.509 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.176,[v2:10.20.193.176:3301,v1:10.20.193.176:6790],[v2:10.20.193.176:3302,v1:10.20.193.176:6791]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': 30, 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-17T12:26:57.511 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:26:57.512 DEBUG:teuthology.orchestra.run.trial176:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T12:26:57.564 DEBUG:teuthology.orchestra.run.trial176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.176 --addv b '[v2:10.20.193.176:3301,v1:10.20.193.176:6790]' --addv c '[v2:10.20.193.176:3302,v1:10.20.193.176:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:26:57.638 INFO:teuthology.orchestra.run.trial176.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:26:57.638 INFO:teuthology.orchestra.run.trial176.stdout:monmaptool: generated fsid e548cc2f-381c-4b27-aafa-8f43f7965f54 2026-02-17T12:26:57.639 INFO:teuthology.orchestra.run.trial176.stdout:setting min_mon_release = quincy 2026-02-17T12:26:57.639 INFO:teuthology.orchestra.run.trial176.stdout:epoch 0 2026-02-17T12:26:57.639 INFO:teuthology.orchestra.run.trial176.stdout:fsid e548cc2f-381c-4b27-aafa-8f43f7965f54 2026-02-17T12:26:57.639 INFO:teuthology.orchestra.run.trial176.stdout:last_changed 2026-02-17T12:26:57.638151+0000 2026-02-17T12:26:57.639 INFO:teuthology.orchestra.run.trial176.stdout:created 2026-02-17T12:26:57.638151+0000 2026-02-17T12:26:57.639 INFO:teuthology.orchestra.run.trial176.stdout:min_mon_release 17 (quincy) 2026-02-17T12:26:57.639 INFO:teuthology.orchestra.run.trial176.stdout:election_strategy: 3 2026-02-17T12:26:57.639 INFO:teuthology.orchestra.run.trial176.stdout:0: [v2:10.20.193.176:3300/0,v1:10.20.193.176:6789/0] mon.a 2026-02-17T12:26:57.639 INFO:teuthology.orchestra.run.trial176.stdout:1: [v2:10.20.193.176:3301/0,v1:10.20.193.176:6790/0] mon.b 2026-02-17T12:26:57.639 INFO:teuthology.orchestra.run.trial176.stdout:2: [v2:10.20.193.176:3302/0,v1:10.20.193.176:6791/0] mon.c 2026-02-17T12:26:57.639 INFO:teuthology.orchestra.run.trial176.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-17T12:26:57.641 DEBUG:teuthology.orchestra.run.trial176:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T12:26:57.697 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e548cc2f-381c-4b27-aafa-8f43f7965f54... 2026-02-17T12:26:57.698 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T12:26:57.778 INFO:teuthology.orchestra.run.trial176.stdout:[global] 2026-02-17T12:26:57.778 INFO:teuthology.orchestra.run.trial176.stdout: chdir = "" 2026-02-17T12:26:57.778 INFO:teuthology.orchestra.run.trial176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T12:26:57.778 INFO:teuthology.orchestra.run.trial176.stdout: auth supported = cephx 2026-02-17T12:26:57.778 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.778 INFO:teuthology.orchestra.run.trial176.stdout: filestore xattr use omap = true 2026-02-17T12:26:57.778 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.778 INFO:teuthology.orchestra.run.trial176.stdout: mon clock drift allowed = 1.000 2026-02-17T12:26:57.779 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.779 INFO:teuthology.orchestra.run.trial176.stdout: osd crush chooseleaf type = 0 2026-02-17T12:26:57.779 INFO:teuthology.orchestra.run.trial176.stdout: auth debug = true 2026-02-17T12:26:57.779 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.779 INFO:teuthology.orchestra.run.trial176.stdout: ms die on old message = true 2026-02-17T12:26:57.779 INFO:teuthology.orchestra.run.trial176.stdout: ms die on bug = true 2026-02-17T12:26:57.779 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.779 INFO:teuthology.orchestra.run.trial176.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T12:26:57.779 INFO:teuthology.orchestra.run.trial176.stdout: mon pg warn max object skew = 0 2026-02-17T12:26:57.779 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.779 INFO:teuthology.orchestra.run.trial176.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T12:26:57.779 INFO:teuthology.orchestra.run.trial176.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T12:26:57.780 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.780 INFO:teuthology.orchestra.run.trial176.stdout: osd pool default size = 2 2026-02-17T12:26:57.780 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.780 INFO:teuthology.orchestra.run.trial176.stdout: mon osd allow primary affinity = true 2026-02-17T12:26:57.780 INFO:teuthology.orchestra.run.trial176.stdout: mon osd allow pg remap = true 2026-02-17T12:26:57.780 INFO:teuthology.orchestra.run.trial176.stdout: mon warn on legacy crush tunables = false 2026-02-17T12:26:57.780 INFO:teuthology.orchestra.run.trial176.stdout: mon warn on crush straw calc version zero = false 2026-02-17T12:26:57.780 INFO:teuthology.orchestra.run.trial176.stdout: mon warn on no sortbitwise = false 2026-02-17T12:26:57.780 INFO:teuthology.orchestra.run.trial176.stdout: mon warn on osd down out interval zero = false 2026-02-17T12:26:57.780 INFO:teuthology.orchestra.run.trial176.stdout: mon warn on too few osds = false 2026-02-17T12:26:57.780 INFO:teuthology.orchestra.run.trial176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T12:26:57.780 INFO:teuthology.orchestra.run.trial176.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T12:26:57.781 INFO:teuthology.orchestra.run.trial176.stdout: mon_allow_pool_size_one = true 2026-02-17T12:26:57.781 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.781 INFO:teuthology.orchestra.run.trial176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T12:26:57.781 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.781 INFO:teuthology.orchestra.run.trial176.stdout: osd default data pool replay window = 5 2026-02-17T12:26:57.781 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.781 INFO:teuthology.orchestra.run.trial176.stdout: mon allow pool delete = true 2026-02-17T12:26:57.781 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.781 INFO:teuthology.orchestra.run.trial176.stdout: mon cluster log file level = debug 2026-02-17T12:26:57.781 INFO:teuthology.orchestra.run.trial176.stdout: debug asserts on shutdown = true 2026-02-17T12:26:57.781 INFO:teuthology.orchestra.run.trial176.stdout: mon health detail to clog = false 2026-02-17T12:26:57.781 INFO:teuthology.orchestra.run.trial176.stdout: mon host = "10.20.193.176,[v2:10.20.193.176:3301,v1:10.20.193.176:6790],[v2:10.20.193.176:3302,v1:10.20.193.176:6791]" 2026-02-17T12:26:57.782 INFO:teuthology.orchestra.run.trial176.stdout: mon client directed command retry = 5 2026-02-17T12:26:57.782 INFO:teuthology.orchestra.run.trial176.stdout: mon election default strategy = 3 2026-02-17T12:26:57.782 INFO:teuthology.orchestra.run.trial176.stdout: ms inject socket failures = 5000 2026-02-17T12:26:57.782 INFO:teuthology.orchestra.run.trial176.stdout: ms type = async 2026-02-17T12:26:57.782 INFO:teuthology.orchestra.run.trial176.stdout: fsid = e548cc2f-381c-4b27-aafa-8f43f7965f54 2026-02-17T12:26:57.782 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.782 INFO:teuthology.orchestra.run.trial176.stdout:[osd] 2026-02-17T12:26:57.782 INFO:teuthology.orchestra.run.trial176.stdout: osd journal size = 100 2026-02-17T12:26:57.782 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.782 INFO:teuthology.orchestra.run.trial176.stdout: osd scrub load threshold = 5.0 2026-02-17T12:26:57.782 INFO:teuthology.orchestra.run.trial176.stdout: osd scrub max interval = 600 2026-02-17T12:26:57.782 INFO:teuthology.orchestra.run.trial176.stdout: osd mclock profile = high_recovery_ops 2026-02-17T12:26:57.783 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.783 INFO:teuthology.orchestra.run.trial176.stdout: osd recover clone overlap = true 2026-02-17T12:26:57.783 INFO:teuthology.orchestra.run.trial176.stdout: osd recovery max chunk = 1048576 2026-02-17T12:26:57.783 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.783 INFO:teuthology.orchestra.run.trial176.stdout: osd debug shutdown = true 2026-02-17T12:26:57.783 INFO:teuthology.orchestra.run.trial176.stdout: osd debug op order = true 2026-02-17T12:26:57.783 INFO:teuthology.orchestra.run.trial176.stdout: osd debug verify stray on activate = true 2026-02-17T12:26:57.783 INFO:teuthology.orchestra.run.trial176.stdout: osd debug trim objects = true 2026-02-17T12:26:57.783 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.783 INFO:teuthology.orchestra.run.trial176.stdout: osd open classes on start = true 2026-02-17T12:26:57.783 INFO:teuthology.orchestra.run.trial176.stdout: osd debug pg log writeout = true 2026-02-17T12:26:57.783 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.783 INFO:teuthology.orchestra.run.trial176.stdout: osd deep scrub update digest min age = 30 2026-02-17T12:26:57.784 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.784 INFO:teuthology.orchestra.run.trial176.stdout: osd map max advance = 10 2026-02-17T12:26:57.784 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.784 INFO:teuthology.orchestra.run.trial176.stdout: journal zero on create = true 2026-02-17T12:26:57.784 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.784 INFO:teuthology.orchestra.run.trial176.stdout: filestore ondisk finisher threads = 3 2026-02-17T12:26:57.784 INFO:teuthology.orchestra.run.trial176.stdout: filestore apply finisher threads = 3 2026-02-17T12:26:57.784 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.784 INFO:teuthology.orchestra.run.trial176.stdout: bdev debug aio = true 2026-02-17T12:26:57.784 INFO:teuthology.orchestra.run.trial176.stdout: osd debug misdirected ops = true 2026-02-17T12:26:57.784 INFO:teuthology.orchestra.run.trial176.stdout: bluestore block size = 96636764160 2026-02-17T12:26:57.784 INFO:teuthology.orchestra.run.trial176.stdout: bluestore compression algorithm = zstd 2026-02-17T12:26:57.785 INFO:teuthology.orchestra.run.trial176.stdout: bluestore compression mode = aggressive 2026-02-17T12:26:57.785 INFO:teuthology.orchestra.run.trial176.stdout: bluestore fsck on mount = True 2026-02-17T12:26:57.785 INFO:teuthology.orchestra.run.trial176.stdout: bluestore zero block detection = True 2026-02-17T12:26:57.785 INFO:teuthology.orchestra.run.trial176.stdout: debug bluefs = 20 2026-02-17T12:26:57.785 INFO:teuthology.orchestra.run.trial176.stdout: debug bluestore = 20 2026-02-17T12:26:57.785 INFO:teuthology.orchestra.run.trial176.stdout: debug ms = 1 2026-02-17T12:26:57.785 INFO:teuthology.orchestra.run.trial176.stdout: debug osd = 20 2026-02-17T12:26:57.785 INFO:teuthology.orchestra.run.trial176.stdout: debug rocksdb = 10 2026-02-17T12:26:57.785 INFO:teuthology.orchestra.run.trial176.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T12:26:57.785 INFO:teuthology.orchestra.run.trial176.stdout: mon osd full ratio = 0.9 2026-02-17T12:26:57.785 INFO:teuthology.orchestra.run.trial176.stdout: mon osd nearfull ratio = 0.8 2026-02-17T12:26:57.785 INFO:teuthology.orchestra.run.trial176.stdout: osd debug verify cached snaps = True 2026-02-17T12:26:57.785 INFO:teuthology.orchestra.run.trial176.stdout: osd debug verify missing on start = True 2026-02-17T12:26:57.786 INFO:teuthology.orchestra.run.trial176.stdout: osd failsafe full ratio = 0.95 2026-02-17T12:26:57.786 INFO:teuthology.orchestra.run.trial176.stdout: osd mclock override recovery settings = True 2026-02-17T12:26:57.786 INFO:teuthology.orchestra.run.trial176.stdout: osd objectstore = bluestore 2026-02-17T12:26:57.786 INFO:teuthology.orchestra.run.trial176.stdout: osd op queue = debug_random 2026-02-17T12:26:57.786 INFO:teuthology.orchestra.run.trial176.stdout: osd op queue cut off = debug_random 2026-02-17T12:26:57.786 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.786 INFO:teuthology.orchestra.run.trial176.stdout:[mgr] 2026-02-17T12:26:57.786 INFO:teuthology.orchestra.run.trial176.stdout: debug ms = 1 2026-02-17T12:26:57.787 INFO:teuthology.orchestra.run.trial176.stdout: debug mgr = 20 2026-02-17T12:26:57.787 INFO:teuthology.orchestra.run.trial176.stdout: debug mon = 20 2026-02-17T12:26:57.787 INFO:teuthology.orchestra.run.trial176.stdout: debug auth = 20 2026-02-17T12:26:57.787 INFO:teuthology.orchestra.run.trial176.stdout: mon reweight min pgs per osd = 4 2026-02-17T12:26:57.787 INFO:teuthology.orchestra.run.trial176.stdout: mon reweight min bytes per osd = 10 2026-02-17T12:26:57.787 INFO:teuthology.orchestra.run.trial176.stdout: mgr/telemetry/nag = false 2026-02-17T12:26:57.787 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.787 INFO:teuthology.orchestra.run.trial176.stdout:[mon] 2026-02-17T12:26:57.788 INFO:teuthology.orchestra.run.trial176.stdout: debug ms = 1 2026-02-17T12:26:57.788 INFO:teuthology.orchestra.run.trial176.stdout: debug mon = 20 2026-02-17T12:26:57.788 INFO:teuthology.orchestra.run.trial176.stdout: debug paxos = 20 2026-02-17T12:26:57.788 INFO:teuthology.orchestra.run.trial176.stdout: debug auth = 30 2026-02-17T12:26:57.788 INFO:teuthology.orchestra.run.trial176.stdout: mon data avail warn = 5 2026-02-17T12:26:57.788 INFO:teuthology.orchestra.run.trial176.stdout: mon mgr mkfs grace = 240 2026-02-17T12:26:57.788 INFO:teuthology.orchestra.run.trial176.stdout: mon reweight min pgs per osd = 4 2026-02-17T12:26:57.788 INFO:teuthology.orchestra.run.trial176.stdout: mon osd reporter subtree level = osd 2026-02-17T12:26:57.788 INFO:teuthology.orchestra.run.trial176.stdout: mon osd prime pg temp = true 2026-02-17T12:26:57.788 INFO:teuthology.orchestra.run.trial176.stdout: mon reweight min bytes per osd = 10 2026-02-17T12:26:57.788 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.788 INFO:teuthology.orchestra.run.trial176.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T12:26:57.788 INFO:teuthology.orchestra.run.trial176.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T12:26:57.789 INFO:teuthology.orchestra.run.trial176.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T12:26:57.789 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.789 INFO:teuthology.orchestra.run.trial176.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T12:26:57.789 INFO:teuthology.orchestra.run.trial176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T12:26:57.789 INFO:teuthology.orchestra.run.trial176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T12:26:57.789 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.789 INFO:teuthology.orchestra.run.trial176.stdout: # 1m isn't quite enough 2026-02-17T12:26:57.789 INFO:teuthology.orchestra.run.trial176.stdout: mon_down_mkfs_grace = 2m 2026-02-17T12:26:57.789 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.789 INFO:teuthology.orchestra.run.trial176.stdout: mon_warn_on_filestore_osds = false 2026-02-17T12:26:57.789 INFO:teuthology.orchestra.run.trial176.stdout: mon scrub interval = 300 2026-02-17T12:26:57.789 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:26:57.790 INFO:teuthology.orchestra.run.trial176.stdout:[client] 2026-02-17T12:26:57.790 INFO:teuthology.orchestra.run.trial176.stdout: rgw cache enabled = true 2026-02-17T12:26:57.790 INFO:teuthology.orchestra.run.trial176.stdout: rgw enable ops log = true 2026-02-17T12:26:57.790 INFO:teuthology.orchestra.run.trial176.stdout: rgw enable usage log = true 2026-02-17T12:26:57.790 INFO:teuthology.orchestra.run.trial176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T12:26:57.790 INFO:teuthology.orchestra.run.trial176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T12:26:57.790 INFO:teuthology.orchestra.run.trial176.stdout:[mon.a] 2026-02-17T12:26:57.790 INFO:teuthology.orchestra.run.trial176.stdout:[mon.b] 2026-02-17T12:26:57.790 INFO:teuthology.orchestra.run.trial176.stdout:[mon.c] 2026-02-17T12:26:57.792 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T12:26:57.792 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T12:26:57.875 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T12:26:57.875 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:26:57.875 DEBUG:teuthology.orchestra.run.trial176:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T12:26:57.931 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:26:57.931 DEBUG:teuthology.orchestra.run.trial176:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T12:26:57.987 INFO:tasks.ceph:Sending monmap to node ubuntu@trial176.front.sepia.ceph.com 2026-02-17T12:26:57.987 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:26:57.987 DEBUG:teuthology.orchestra.run.trial176:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T12:26:57.987 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T12:26:58.060 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:26:58.060 DEBUG:teuthology.orchestra.run.trial176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:26:58.116 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T12:26:58.117 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T12:26:58.117 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T12:26:58.200 INFO:teuthology.orchestra.run.trial176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T12:26:58.203 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T12:26:58.203 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T12:26:58.203 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T12:26:58.238 INFO:teuthology.orchestra.run.trial176.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T12:26:58.249 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T12:26:58.250 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial176.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T12:26:58.250 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T12:26:58.315 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T12:26:58.315 INFO:tasks.ceph:role: osd.0 2026-02-17T12:26:58.315 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T12:26:58.315 DEBUG:teuthology.orchestra.run.trial176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T12:26:58.383 INFO:teuthology.orchestra.run.trial176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T12:26:58.383 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T12:26:58.383 INFO:teuthology.orchestra.run.trial176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T12:26:58.383 INFO:teuthology.orchestra.run.trial176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T12:26:58.383 INFO:teuthology.orchestra.run.trial176.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T12:26:58.384 INFO:teuthology.orchestra.run.trial176.stdout: = sunit=0 swidth=0 blks 2026-02-17T12:26:58.384 INFO:teuthology.orchestra.run.trial176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T12:26:58.384 INFO:teuthology.orchestra.run.trial176.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T12:26:58.384 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T12:26:58.384 INFO:teuthology.orchestra.run.trial176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T12:26:58.952 INFO:teuthology.orchestra.run.trial176.stdout:Discarding blocks...Done. 2026-02-17T12:26:58.954 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial176.front.sepia.ceph.com -o noatime 2026-02-17T12:26:58.955 DEBUG:teuthology.orchestra.run.trial176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T12:26:59.023 DEBUG:teuthology.orchestra.run.trial176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T12:26:59.091 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T12:26:59.155 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T12:26:59.155 INFO:tasks.ceph:role: osd.1 2026-02-17T12:26:59.155 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T12:26:59.155 DEBUG:teuthology.orchestra.run.trial176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T12:26:59.221 INFO:teuthology.orchestra.run.trial176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T12:26:59.222 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T12:26:59.222 INFO:teuthology.orchestra.run.trial176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T12:26:59.222 INFO:teuthology.orchestra.run.trial176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T12:26:59.222 INFO:teuthology.orchestra.run.trial176.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T12:26:59.222 INFO:teuthology.orchestra.run.trial176.stdout: = sunit=0 swidth=0 blks 2026-02-17T12:26:59.222 INFO:teuthology.orchestra.run.trial176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T12:26:59.222 INFO:teuthology.orchestra.run.trial176.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T12:26:59.222 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T12:26:59.223 INFO:teuthology.orchestra.run.trial176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T12:26:59.780 INFO:teuthology.orchestra.run.trial176.stdout:Discarding blocks...Done. 2026-02-17T12:26:59.782 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial176.front.sepia.ceph.com -o noatime 2026-02-17T12:26:59.782 DEBUG:teuthology.orchestra.run.trial176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-17T12:26:59.851 DEBUG:teuthology.orchestra.run.trial176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T12:26:59.917 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T12:26:59.982 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T12:26:59.982 INFO:tasks.ceph:role: osd.2 2026-02-17T12:26:59.982 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T12:26:59.983 DEBUG:teuthology.orchestra.run.trial176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T12:27:00.048 INFO:teuthology.orchestra.run.trial176.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T12:27:00.048 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T12:27:00.048 INFO:teuthology.orchestra.run.trial176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T12:27:00.048 INFO:teuthology.orchestra.run.trial176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T12:27:00.048 INFO:teuthology.orchestra.run.trial176.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T12:27:00.048 INFO:teuthology.orchestra.run.trial176.stdout: = sunit=0 swidth=0 blks 2026-02-17T12:27:00.049 INFO:teuthology.orchestra.run.trial176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T12:27:00.049 INFO:teuthology.orchestra.run.trial176.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T12:27:00.049 INFO:teuthology.orchestra.run.trial176.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T12:27:00.049 INFO:teuthology.orchestra.run.trial176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T12:27:00.604 INFO:teuthology.orchestra.run.trial176.stdout:Discarding blocks...Done. 2026-02-17T12:27:00.606 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial176.front.sepia.ceph.com -o noatime 2026-02-17T12:27:00.606 DEBUG:teuthology.orchestra.run.trial176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-17T12:27:00.674 DEBUG:teuthology.orchestra.run.trial176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T12:27:00.740 DEBUG:teuthology.orchestra.run.trial176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:27:00.818 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:27:00.817+0000 7f61dacd0780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T12:27:00.818 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:27:00.817+0000 7f61dacd0780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T12:27:00.818 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:27:00.817+0000 7f61dacd0780 -1 bdev(0x55ba5c69b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T12:27:00.818 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:27:00.818+0000 7f61dacd0780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T12:27:03.725 DEBUG:teuthology.orchestra.run.trial176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T12:27:03.790 DEBUG:teuthology.orchestra.run.trial176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:27:03.870 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:27:03.868+0000 7f855ba0c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T12:27:03.870 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:27:03.869+0000 7f855ba0c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T12:27:03.870 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:27:03.869+0000 7f855ba0c780 -1 bdev(0x555d4bca7800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T12:27:03.870 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:27:03.869+0000 7f855ba0c780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T12:27:07.013 DEBUG:teuthology.orchestra.run.trial176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T12:27:07.078 DEBUG:teuthology.orchestra.run.trial176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:27:07.155 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:27:07.154+0000 7f0d3b60f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T12:27:07.156 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:27:07.154+0000 7f0d3b60f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T12:27:07.156 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:27:07.154+0000 7f0d3b60f780 -1 bdev(0x5647ebb93800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T12:27:07.156 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:27:07.154+0000 7f0d3b60f780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T12:27:10.053 DEBUG:teuthology.orchestra.run.trial176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T12:27:10.118 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T12:27:10.118 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:27:10.119 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T12:27:10.181 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:27:10.181 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T12:27:10.245 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:27:10.245 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T12:27:10.308 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:27:10.308 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T12:27:10.371 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:27:10.371 DEBUG:teuthology.orchestra.run.trial176:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T12:27:10.428 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T12:27:10.428 DEBUG:teuthology.orchestra.run.trial176:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T12:27:10.491 INFO:teuthology.orchestra.run.trial176.stdout:[mgr.x] 2026-02-17T12:27:10.491 INFO:teuthology.orchestra.run.trial176.stdout: key = AQCSXpRp4gvwCxAAvGUb4rCS4oIDhPVDQ377AQ== 2026-02-17T12:27:10.491 INFO:teuthology.orchestra.run.trial176.stdout:[osd.0] 2026-02-17T12:27:10.491 INFO:teuthology.orchestra.run.trial176.stdout: key = AQCUXpRpPL7LMBAAGIlaOdqcJKbW1CHtXvG82Q== 2026-02-17T12:27:10.491 INFO:teuthology.orchestra.run.trial176.stdout:[osd.1] 2026-02-17T12:27:10.491 INFO:teuthology.orchestra.run.trial176.stdout: key = AQCXXpRpzpvaMxAA5smpwwtuuzHv8iVcRhkLug== 2026-02-17T12:27:10.491 INFO:teuthology.orchestra.run.trial176.stdout:[osd.2] 2026-02-17T12:27:10.491 INFO:teuthology.orchestra.run.trial176.stdout: key = AQCbXpRp5EFDCRAAvrfn9YTGwAYe/2qiy6aEWA== 2026-02-17T12:27:10.492 INFO:teuthology.orchestra.run.trial176.stdout:[client.0] 2026-02-17T12:27:10.492 INFO:teuthology.orchestra.run.trial176.stdout: key = AQCSXpRpr9c2DhAA+YvQCqQeECdaQkIc5FvVeg== 2026-02-17T12:27:10.493 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T12:27:10.573 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:27:10.652 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:27:10.731 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T12:27:10.810 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T12:27:10.892 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T12:27:10.892 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T12:27:10.956 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T12:27:11.043 DEBUG:teuthology.orchestra.run.trial176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T12:27:11.068 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-17T12:27:11.132 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T12:27:11.217 DEBUG:teuthology.orchestra.run.trial176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-17T12:27:11.241 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-17T12:27:11.305 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T12:27:11.388 DEBUG:teuthology.orchestra.run.trial176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-17T12:27:11.452 DEBUG:teuthology.orchestra.run.trial176:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:27:11.508 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T12:27:11.509 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T12:27:11.509 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T12:27:11.551 INFO:tasks.ceph.mon.a:Started 2026-02-17T12:27:11.551 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T12:27:11.552 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T12:27:11.554 INFO:tasks.ceph.mon.b:Started 2026-02-17T12:27:11.554 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T12:27:11.554 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T12:27:11.556 INFO:tasks.ceph.mon.c:Started 2026-02-17T12:27:11.557 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph config set mgr mgr_pool false --force 2026-02-17T12:27:17.667 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T12:27:17.667 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T12:27:17.667 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T12:27:17.668 INFO:tasks.ceph.mgr.x:Started 2026-02-17T12:27:17.668 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T12:27:17.669 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T12:27:17.771 INFO:teuthology.orchestra.run.trial176.stderr:adjusted tunables profile to default 2026-02-17T12:27:17.777 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T12:27:17.778 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T12:27:17.778 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:27:17.778 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T12:27:17.803 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:27:17.803 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T12:27:17.866 DEBUG:teuthology.orchestra.run.trial176:> set -ex 2026-02-17T12:27:17.866 DEBUG:teuthology.orchestra.run.trial176:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T12:27:17.930 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new e5293a7e-2eff-48e4-bdb8-f0f5af0e5dc5 0 2026-02-17T12:27:18.071 INFO:teuthology.orchestra.run.trial176.stdout:0 2026-02-17T12:27:18.077 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new 8b915722-f2d9-47b1-bae5-d892719b3619 1 2026-02-17T12:27:18.089 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.088+0000 7f2ee0bce140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T12:27:18.179 INFO:teuthology.orchestra.run.trial176.stdout:1 2026-02-17T12:27:18.187 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd new 123abf21-71ed-4a75-a738-57b857e32044 2 2026-02-17T12:27:18.215 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.213+0000 7f2ee0bce140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T12:27:18.242 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.241+0000 7f2ee0bce140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T12:27:18.276 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.275+0000 7f2ee0bce140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T12:27:18.299 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.298+0000 7f2ee0bce140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T12:27:18.319 INFO:teuthology.orchestra.run.trial176.stdout:2 2026-02-17T12:27:18.326 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.325+0000 7f2ee0bce140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T12:27:18.327 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T12:27:18.327 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T12:27:18.370 INFO:tasks.ceph.osd.0:Started 2026-02-17T12:27:18.370 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T12:27:18.370 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T12:27:18.371 INFO:tasks.ceph.osd.1:Started 2026-02-17T12:27:18.371 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T12:27:18.371 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T12:27:18.373 INFO:tasks.ceph.osd.2:Started 2026-02-17T12:27:18.373 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T12:27:18.384 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.383+0000 7f2ee0bce140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T12:27:18.449 INFO:tasks.ceph.mgr.x.trial176.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T12:27:18.449 INFO:tasks.ceph.mgr.x.trial176.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T12:27:18.449 INFO:tasks.ceph.mgr.x.trial176.stderr: from numpy import show_config as show_numpy_config 2026-02-17T12:27:18.453 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.452+0000 7f2ee0bce140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T12:27:18.475 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:27:18.476 INFO:teuthology.orchestra.run.trial176.stdout:{"epoch":5,"fsid":"e548cc2f-381c-4b27-aafa-8f43f7965f54","created":"2026-02-17T12:27:16.823790+0000","modified":"2026-02-17T12:27:18.317784+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T12:27:18.317784+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e5293a7e-2eff-48e4-bdb8-f0f5af0e5dc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8b915722-f2d9-47b1-bae5-d892719b3619","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"123abf21-71ed-4a75-a738-57b857e32044","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:27:18.479 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.478+0000 7f2ee0bce140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T12:27:18.484 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T12:27:18.484 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T12:27:18.535 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.534+0000 7f2ee0bce140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T12:27:18.579 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.578+0000 7f2ee0bce140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T12:27:18.605 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.604+0000 7f2ee0bce140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T12:27:18.629 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.628+0000 7f2ee0bce140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T12:27:18.655 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.654+0000 7f2ee0bce140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T12:27:18.677 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.677+0000 7f2ee0bce140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T12:27:18.786 DEBUG:teuthology.orchestra.run.trial176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T12:27:18.877 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.876+0000 7f2ee0bce140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T12:27:18.878 INFO:teuthology.misc.health.trial176.stdout: 2026-02-17T12:27:18.878 INFO:teuthology.misc.health.trial176.stdout:{"epoch":5,"fsid":"e548cc2f-381c-4b27-aafa-8f43f7965f54","created":"2026-02-17T12:27:16.823790+0000","modified":"2026-02-17T12:27:18.317784+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T12:27:18.317784+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e5293a7e-2eff-48e4-bdb8-f0f5af0e5dc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8b915722-f2d9-47b1-bae5-d892719b3619","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"123abf21-71ed-4a75-a738-57b857e32044","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:27:18.885 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T12:27:18.933 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.932+0000 7f2ee0bce140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T12:27:18.956 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.955+0000 7f2ee0bce140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T12:27:18.979 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:18.978+0000 7f2ee0bce140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T12:27:19.033 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:19.032+0000 7f2ee0bce140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:27:19.054 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:19.053+0000 7f2ee0bce140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T12:27:19.107 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:19.105+0000 7f2ee0bce140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:27:19.501 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:19.500+0000 7f2ee0bce140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T12:27:19.523 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:19.522+0000 7f2ee0bce140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T12:27:19.819 INFO:tasks.ceph.osd.0.trial176.stderr:2026-02-17T12:27:19.818+0000 7fb26f227780 -1 Falling back to public interface 2026-02-17T12:27:19.867 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:19.866+0000 7f2ee0bce140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T12:27:20.047 INFO:tasks.ceph.osd.2.trial176.stderr:2026-02-17T12:27:20.046+0000 7f68b6c16780 -1 Falling back to public interface 2026-02-17T12:27:20.305 INFO:tasks.ceph.osd.1.trial176.stderr:2026-02-17T12:27:20.304+0000 7f6d2ceaf780 -1 Falling back to public interface 2026-02-17T12:27:20.875 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:20.873+0000 7f2dfd80f640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-17T12:27:20.875 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:27:20.873+0000 7f2dfd80f640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-17T12:27:23.574 INFO:tasks.ceph.osd.0.trial176.stderr:2026-02-17T12:27:23.573+0000 7fb26f227780 -1 osd.0 0 log_to_monitors true 2026-02-17T12:27:23.805 INFO:tasks.ceph.osd.2.trial176.stderr:2026-02-17T12:27:23.804+0000 7f68b6c16780 -1 osd.2 0 log_to_monitors true 2026-02-17T12:27:24.529 INFO:tasks.ceph.osd.1.trial176.stderr:2026-02-17T12:27:24.528+0000 7f6d2ceaf780 -1 osd.1 0 log_to_monitors true 2026-02-17T12:27:24.882 INFO:tasks.ceph.osd.2.trial176.stderr:2026-02-17T12:27:24.881+0000 7f68b2576640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T12:27:24.891 INFO:tasks.ceph.osd.0.trial176.stderr:2026-02-17T12:27:24.890+0000 7fb26b1b4640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T12:27:24.891 INFO:tasks.ceph.osd.2.trial176.stderr:2026-02-17T12:27:24.890+0000 7f68ae3a0640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:27:24.892 INFO:tasks.ceph.osd.0.trial176.stderr:2026-02-17T12:27:24.891+0000 7fb266fde640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:27:25.188 DEBUG:teuthology.orchestra.run.trial176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T12:27:25.340 INFO:teuthology.misc.health.trial176.stdout: 2026-02-17T12:27:25.340 INFO:teuthology.misc.health.trial176.stdout:{"epoch":7,"fsid":"e548cc2f-381c-4b27-aafa-8f43f7965f54","created":"2026-02-17T12:27:16.823790+0000","modified":"2026-02-17T12:27:24.878036+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T12:27:18.317784+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e5293a7e-2eff-48e4-bdb8-f0f5af0e5dc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8b915722-f2d9-47b1-bae5-d892719b3619","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"123abf21-71ed-4a75-a738-57b857e32044","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:27:25.347 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-17T12:27:25.898 INFO:tasks.ceph.osd.1.trial176.stderr:2026-02-17T12:27:25.897+0000 7f6d28e3c640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T12:27:25.900 INFO:tasks.ceph.osd.1.trial176.stderr:2026-02-17T12:27:25.899+0000 7f6d24c66640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:27:31.649 DEBUG:teuthology.orchestra.run.trial176:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T12:27:31.798 INFO:teuthology.misc.health.trial176.stdout: 2026-02-17T12:27:31.799 INFO:teuthology.misc.health.trial176.stdout:{"epoch":10,"fsid":"e548cc2f-381c-4b27-aafa-8f43f7965f54","created":"2026-02-17T12:27:16.823790+0000","modified":"2026-02-17T12:27:27.887397+0000","last_up_change":"2026-02-17T12:27:26.884168+0000","last_in_change":"2026-02-17T12:27:18.317784+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e5293a7e-2eff-48e4-bdb8-f0f5af0e5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6800","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6801","nonce":2401167178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6802","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6803","nonce":2401167178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6806","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6807","nonce":2401167178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6804","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6805","nonce":2401167178}]},"public_addr":"10.20.193.176:6801/2401167178","cluster_addr":"10.20.193.176:6803/2401167178","heartbeat_back_addr":"10.20.193.176:6807/2401167178","heartbeat_front_addr":"10.20.193.176:6805/2401167178","state":["exists","up"]},{"osd":1,"uuid":"8b915722-f2d9-47b1-bae5-d892719b3619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6818","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6819","nonce":439788868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6820","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6821","nonce":439788868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6824","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6825","nonce":439788868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6822","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6823","nonce":439788868}]},"public_addr":"10.20.193.176:6819/439788868","cluster_addr":"10.20.193.176:6821/439788868","heartbeat_back_addr":"10.20.193.176:6825/439788868","heartbeat_front_addr":"10.20.193.176:6823/439788868","state":["exists","up"]},{"osd":2,"uuid":"123abf21-71ed-4a75-a738-57b857e32044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6810","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6811","nonce":2390822115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6812","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6813","nonce":2390822115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6816","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6817","nonce":2390822115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6814","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6815","nonce":2390822115}]},"public_addr":"10.20.193.176:6811/2390822115","cluster_addr":"10.20.193.176:6813/2390822115","heartbeat_back_addr":"10.20.193.176:6817/2390822115","heartbeat_front_addr":"10.20.193.176:6815/2390822115","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:24.569394+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:25.557742+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:24.808240+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:27:31.806 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-17T12:27:31.806 INFO:tasks.ceph:Creating RBD pool 2026-02-17T12:27:31.806 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T12:27:32.894 INFO:teuthology.orchestra.run.trial176.stderr:pool 'rbd' created 2026-02-17T12:27:32.904 DEBUG:teuthology.orchestra.run.trial176:> rbd --cluster ceph pool init rbd 2026-02-17T12:27:35.907 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T12:27:35.907 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T12:27:35.908 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T12:27:35.908 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T12:27:35.908 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T12:27:36.093 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:27:36.100 INFO:teuthology.orchestra.run.trial176.stdout:{"epoch":4,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6808","nonce":3781834664},{"type":"v1","addr":"10.20.193.176:6809","nonce":3781834664}]},"active_addr":"10.20.193.176:6809/3781834664","active_change":"2026-02-17T12:27:19.869004+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.176:0","nonce":1965050826}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.176:0","nonce":2720038988}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.176:0","nonce":829402231}]}]} 2026-02-17T12:27:36.104 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T12:27:36.104 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T12:27:36.105 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T12:27:36.263 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:27:36.263 INFO:teuthology.orchestra.run.trial176.stdout:{"epoch":14,"fsid":"e548cc2f-381c-4b27-aafa-8f43f7965f54","created":"2026-02-17T12:27:16.823790+0000","modified":"2026-02-17T12:27:35.899761+0000","last_up_change":"2026-02-17T12:27:26.884168+0000","last_in_change":"2026-02-17T12:27:18.317784+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T12:27:31.962642+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5293a7e-2eff-48e4-bdb8-f0f5af0e5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6800","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6801","nonce":2401167178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6802","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6803","nonce":2401167178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6806","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6807","nonce":2401167178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6804","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6805","nonce":2401167178}]},"public_addr":"10.20.193.176:6801/2401167178","cluster_addr":"10.20.193.176:6803/2401167178","heartbeat_back_addr":"10.20.193.176:6807/2401167178","heartbeat_front_addr":"10.20.193.176:6805/2401167178","state":["exists","up"]},{"osd":1,"uuid":"8b915722-f2d9-47b1-bae5-d892719b3619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6818","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6819","nonce":439788868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6820","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6821","nonce":439788868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6824","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6825","nonce":439788868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6822","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6823","nonce":439788868}]},"public_addr":"10.20.193.176:6819/439788868","cluster_addr":"10.20.193.176:6821/439788868","heartbeat_back_addr":"10.20.193.176:6825/439788868","heartbeat_front_addr":"10.20.193.176:6823/439788868","state":["exists","up"]},{"osd":2,"uuid":"123abf21-71ed-4a75-a738-57b857e32044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6810","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6811","nonce":2390822115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6812","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6813","nonce":2390822115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6816","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6817","nonce":2390822115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6814","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6815","nonce":2390822115}]},"public_addr":"10.20.193.176:6811/2390822115","cluster_addr":"10.20.193.176:6813/2390822115","heartbeat_back_addr":"10.20.193.176:6817/2390822115","heartbeat_front_addr":"10.20.193.176:6815/2390822115","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:24.569394+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:25.557742+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:24.808240+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:27:36.272 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T12:27:36.272 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T12:27:36.428 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:27:36.428 INFO:teuthology.orchestra.run.trial176.stdout:{"epoch":14,"fsid":"e548cc2f-381c-4b27-aafa-8f43f7965f54","created":"2026-02-17T12:27:16.823790+0000","modified":"2026-02-17T12:27:35.899761+0000","last_up_change":"2026-02-17T12:27:26.884168+0000","last_in_change":"2026-02-17T12:27:18.317784+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T12:27:31.962642+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5293a7e-2eff-48e4-bdb8-f0f5af0e5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6800","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6801","nonce":2401167178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6802","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6803","nonce":2401167178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6806","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6807","nonce":2401167178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6804","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6805","nonce":2401167178}]},"public_addr":"10.20.193.176:6801/2401167178","cluster_addr":"10.20.193.176:6803/2401167178","heartbeat_back_addr":"10.20.193.176:6807/2401167178","heartbeat_front_addr":"10.20.193.176:6805/2401167178","state":["exists","up"]},{"osd":1,"uuid":"8b915722-f2d9-47b1-bae5-d892719b3619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6818","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6819","nonce":439788868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6820","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6821","nonce":439788868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6824","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6825","nonce":439788868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6822","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6823","nonce":439788868}]},"public_addr":"10.20.193.176:6819/439788868","cluster_addr":"10.20.193.176:6821/439788868","heartbeat_back_addr":"10.20.193.176:6825/439788868","heartbeat_front_addr":"10.20.193.176:6823/439788868","state":["exists","up"]},{"osd":2,"uuid":"123abf21-71ed-4a75-a738-57b857e32044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6810","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6811","nonce":2390822115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6812","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6813","nonce":2390822115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6816","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6817","nonce":2390822115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6814","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6815","nonce":2390822115}]},"public_addr":"10.20.193.176:6811/2390822115","cluster_addr":"10.20.193.176:6813/2390822115","heartbeat_back_addr":"10.20.193.176:6817/2390822115","heartbeat_front_addr":"10.20.193.176:6815/2390822115","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:24.569394+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:25.557742+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:24.808240+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:27:36.436 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T12:27:36.436 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T12:27:36.437 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T12:27:36.522 INFO:teuthology.orchestra.run.trial176.stdout:34359738373 2026-02-17T12:27:36.523 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T12:27:36.524 INFO:teuthology.orchestra.run.trial176.stdout:34359738372 2026-02-17T12:27:36.524 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T12:27:36.528 INFO:teuthology.orchestra.run.trial176.stdout:38654705669 2026-02-17T12:27:36.529 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T12:27:36.687 INFO:teuthology.orchestra.run.trial176.stdout:34359738371 2026-02-17T12:27:36.688 INFO:teuthology.orchestra.run.trial176.stdout:38654705668 2026-02-17T12:27:36.690 INFO:teuthology.orchestra.run.trial176.stdout:34359738372 2026-02-17T12:27:36.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2026-02-17T12:27:36.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2026-02-17T12:27:36.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.0 2026-02-17T12:27:37.698 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T12:27:37.699 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T12:27:37.700 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T12:27:37.861 INFO:teuthology.orchestra.run.trial176.stdout:38654705668 2026-02-17T12:27:37.865 INFO:teuthology.orchestra.run.trial176.stdout:34359738372 2026-02-17T12:27:37.866 INFO:teuthology.orchestra.run.trial176.stdout:34359738371 2026-02-17T12:27:37.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2026-02-17T12:27:37.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.0 2026-02-17T12:27:37.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2026-02-17T12:27:38.872 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T12:27:38.877 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T12:27:38.877 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T12:27:39.031 INFO:teuthology.orchestra.run.trial176.stdout:38654705669 2026-02-17T12:27:39.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2026-02-17T12:27:39.042 DEBUG:teuthology.parallel:result is None 2026-02-17T12:27:39.078 INFO:teuthology.orchestra.run.trial176.stdout:34359738374 2026-02-17T12:27:39.081 INFO:teuthology.orchestra.run.trial176.stdout:34359738373 2026-02-17T12:27:39.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738374 for osd.0 2026-02-17T12:27:39.088 DEBUG:teuthology.parallel:result is None 2026-02-17T12:27:39.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738373 for osd.2 2026-02-17T12:27:39.091 DEBUG:teuthology.parallel:result is None 2026-02-17T12:27:39.092 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T12:27:39.092 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:27:39.287 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:27:39.288 INFO:teuthology.orchestra.run.trial176.stderr:dumped all 2026-02-17T12:27:39.295 INFO:teuthology.orchestra.run.trial176.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-17T12:27:37.873564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81268,"kb_used_data":368,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283034252,"statfs":{"total":289910292480,"available":289827074048,"internally_reserved":0,"allocated":376832,"data_stored":97349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:35.902823+0000","last_change":"2026-02-17T12:27:35.902823+0000","last_active":"2026-02-17T12:27:35.902823+0000","last_peered":"2026-02-17T12:27:35.902823+0000","last_clean":"2026-02-17T12:27:35.902823+0000","last_became_active":"2026-02-17T12:27:33.900847+0000","last_became_peered":"2026-02-17T12:27:33.900847+0000","last_unstale":"2026-02-17T12:27:35.902823+0000","last_undegraded":"2026-02-17T12:27:35.902823+0000","last_fullsized":"2026-02-17T12:27:35.902823+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:55:42.615678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053492399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:35.902628+0000","last_change":"2026-02-17T12:27:35.902628+0000","last_active":"2026-02-17T12:27:35.902628+0000","last_peered":"2026-02-17T12:27:35.902628+0000","last_clean":"2026-02-17T12:27:35.902628+0000","last_became_active":"2026-02-17T12:27:33.900472+0000","last_became_peered":"2026-02-17T12:27:33.900472+0000","last_unstale":"2026-02-17T12:27:35.902628+0000","last_undegraded":"2026-02-17T12:27:35.902628+0000","last_fullsized":"2026-02-17T12:27:35.902628+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:21:57.647253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036008999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:36.477665+0000","last_change":"2026-02-17T12:27:36.477665+0000","last_active":"2026-02-17T12:27:36.477665+0000","last_peered":"2026-02-17T12:27:36.477665+0000","last_clean":"2026-02-17T12:27:36.477665+0000","last_became_active":"2026-02-17T12:27:33.899703+0000","last_became_peered":"2026-02-17T12:27:33.899703+0000","last_unstale":"2026-02-17T12:27:36.477665+0000","last_undegraded":"2026-02-17T12:27:36.477665+0000","last_fullsized":"2026-02-17T12:27:36.477665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:34:12.921578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000184573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:35.902494+0000","last_change":"2026-02-17T12:27:35.902494+0000","last_active":"2026-02-17T12:27:35.902494+0000","last_peered":"2026-02-17T12:27:35.902494+0000","last_clean":"2026-02-17T12:27:35.902494+0000","last_became_active":"2026-02-17T12:27:33.900464+0000","last_became_peered":"2026-02-17T12:27:33.900464+0000","last_unstale":"2026-02-17T12:27:35.902494+0000","last_undegraded":"2026-02-17T12:27:35.902494+0000","last_fullsized":"2026-02-17T12:27:35.902494+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:18:19.858979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023640999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"12'1","reported_seq":20,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:35.902638+0000","last_change":"2026-02-17T12:27:35.902638+0000","last_active":"2026-02-17T12:27:35.902638+0000","last_peered":"2026-02-17T12:27:35.902638+0000","last_clean":"2026-02-17T12:27:35.902638+0000","last_became_active":"2026-02-17T12:27:33.900506+0000","last_became_peered":"2026-02-17T12:27:33.900506+0000","last_unstale":"2026-02-17T12:27:35.902638+0000","last_undegraded":"2026-02-17T12:27:35.902638+0000","last_fullsized":"2026-02-17T12:27:35.902638+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:44:05.981344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371481,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"14'2","reported_seq":21,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:35.903260+0000","last_change":"2026-02-17T12:27:35.902435+0000","last_active":"2026-02-17T12:27:35.903260+0000","last_peered":"2026-02-17T12:27:35.903260+0000","last_clean":"2026-02-17T12:27:35.903260+0000","last_became_active":"2026-02-17T12:27:33.900327+0000","last_became_peered":"2026-02-17T12:27:33.900327+0000","last_unstale":"2026-02-17T12:27:35.903260+0000","last_undegraded":"2026-02-17T12:27:35.903260+0000","last_fullsized":"2026-02-17T12:27:35.903260+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:19:19.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024717000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:36.477663+0000","last_change":"2026-02-17T12:27:36.477663+0000","last_active":"2026-02-17T12:27:36.477663+0000","last_peered":"2026-02-17T12:27:36.477663+0000","last_clean":"2026-02-17T12:27:36.477663+0000","last_became_active":"2026-02-17T12:27:33.899666+0000","last_became_peered":"2026-02-17T12:27:33.899666+0000","last_unstale":"2026-02-17T12:27:36.477663+0000","last_undegraded":"2026-02-17T12:27:36.477663+0000","last_fullsized":"2026-02-17T12:27:36.477663+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:44:03.332431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00015219300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:35.902491+0000","last_change":"2026-02-17T12:27:35.902491+0000","last_active":"2026-02-17T12:27:35.902491+0000","last_peered":"2026-02-17T12:27:35.902491+0000","last_clean":"2026-02-17T12:27:35.902491+0000","last_became_active":"2026-02-17T12:27:33.900433+0000","last_became_peered":"2026-02-17T12:27:33.900433+0000","last_unstale":"2026-02-17T12:27:35.902491+0000","last_undegraded":"2026-02-17T12:27:35.902491+0000","last_fullsized":"2026-02-17T12:27:35.902491+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:31:12.170800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026836900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":126976,"data_stored":32456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27084,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344756,"statfs":{"total":96636764160,"available":96609030144,"internally_reserved":0,"allocated":122880,"data_stored":32437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27088,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344752,"statfs":{"total":96636764160,"available":96609026048,"internally_reserved":0,"allocated":126976,"data_stored":32456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:27:39.297 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:27:39.449 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:27:39.450 INFO:teuthology.orchestra.run.trial176.stderr:dumped all 2026-02-17T12:27:39.457 INFO:teuthology.orchestra.run.trial176.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-17T12:27:37.873564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81268,"kb_used_data":368,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":283034252,"statfs":{"total":289910292480,"available":289827074048,"internally_reserved":0,"allocated":376832,"data_stored":97349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:35.902823+0000","last_change":"2026-02-17T12:27:35.902823+0000","last_active":"2026-02-17T12:27:35.902823+0000","last_peered":"2026-02-17T12:27:35.902823+0000","last_clean":"2026-02-17T12:27:35.902823+0000","last_became_active":"2026-02-17T12:27:33.900847+0000","last_became_peered":"2026-02-17T12:27:33.900847+0000","last_unstale":"2026-02-17T12:27:35.902823+0000","last_undegraded":"2026-02-17T12:27:35.902823+0000","last_fullsized":"2026-02-17T12:27:35.902823+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:55:42.615678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053492399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:35.902628+0000","last_change":"2026-02-17T12:27:35.902628+0000","last_active":"2026-02-17T12:27:35.902628+0000","last_peered":"2026-02-17T12:27:35.902628+0000","last_clean":"2026-02-17T12:27:35.902628+0000","last_became_active":"2026-02-17T12:27:33.900472+0000","last_became_peered":"2026-02-17T12:27:33.900472+0000","last_unstale":"2026-02-17T12:27:35.902628+0000","last_undegraded":"2026-02-17T12:27:35.902628+0000","last_fullsized":"2026-02-17T12:27:35.902628+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:21:57.647253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036008999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:36.477665+0000","last_change":"2026-02-17T12:27:36.477665+0000","last_active":"2026-02-17T12:27:36.477665+0000","last_peered":"2026-02-17T12:27:36.477665+0000","last_clean":"2026-02-17T12:27:36.477665+0000","last_became_active":"2026-02-17T12:27:33.899703+0000","last_became_peered":"2026-02-17T12:27:33.899703+0000","last_unstale":"2026-02-17T12:27:36.477665+0000","last_undegraded":"2026-02-17T12:27:36.477665+0000","last_fullsized":"2026-02-17T12:27:36.477665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:34:12.921578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000184573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:35.902494+0000","last_change":"2026-02-17T12:27:35.902494+0000","last_active":"2026-02-17T12:27:35.902494+0000","last_peered":"2026-02-17T12:27:35.902494+0000","last_clean":"2026-02-17T12:27:35.902494+0000","last_became_active":"2026-02-17T12:27:33.900464+0000","last_became_peered":"2026-02-17T12:27:33.900464+0000","last_unstale":"2026-02-17T12:27:35.902494+0000","last_undegraded":"2026-02-17T12:27:35.902494+0000","last_fullsized":"2026-02-17T12:27:35.902494+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T16:18:19.858979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023640999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"12'1","reported_seq":20,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:35.902638+0000","last_change":"2026-02-17T12:27:35.902638+0000","last_active":"2026-02-17T12:27:35.902638+0000","last_peered":"2026-02-17T12:27:35.902638+0000","last_clean":"2026-02-17T12:27:35.902638+0000","last_became_active":"2026-02-17T12:27:33.900506+0000","last_became_peered":"2026-02-17T12:27:33.900506+0000","last_unstale":"2026-02-17T12:27:35.902638+0000","last_undegraded":"2026-02-17T12:27:35.902638+0000","last_fullsized":"2026-02-17T12:27:35.902638+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:44:05.981344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371481,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"14'2","reported_seq":21,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:35.903260+0000","last_change":"2026-02-17T12:27:35.902435+0000","last_active":"2026-02-17T12:27:35.903260+0000","last_peered":"2026-02-17T12:27:35.903260+0000","last_clean":"2026-02-17T12:27:35.903260+0000","last_became_active":"2026-02-17T12:27:33.900327+0000","last_became_peered":"2026-02-17T12:27:33.900327+0000","last_unstale":"2026-02-17T12:27:35.903260+0000","last_undegraded":"2026-02-17T12:27:35.903260+0000","last_fullsized":"2026-02-17T12:27:35.903260+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:19:19.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024717000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:36.477663+0000","last_change":"2026-02-17T12:27:36.477663+0000","last_active":"2026-02-17T12:27:36.477663+0000","last_peered":"2026-02-17T12:27:36.477663+0000","last_clean":"2026-02-17T12:27:36.477663+0000","last_became_active":"2026-02-17T12:27:33.899666+0000","last_became_peered":"2026-02-17T12:27:33.899666+0000","last_unstale":"2026-02-17T12:27:36.477663+0000","last_undegraded":"2026-02-17T12:27:36.477663+0000","last_fullsized":"2026-02-17T12:27:36.477663+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T17:44:03.332431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00015219300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-17T12:27:35.902491+0000","last_change":"2026-02-17T12:27:35.902491+0000","last_active":"2026-02-17T12:27:35.902491+0000","last_peered":"2026-02-17T12:27:35.902491+0000","last_clean":"2026-02-17T12:27:35.902491+0000","last_became_active":"2026-02-17T12:27:33.900433+0000","last_became_peered":"2026-02-17T12:27:33.900433+0000","last_unstale":"2026-02-17T12:27:35.902491+0000","last_undegraded":"2026-02-17T12:27:35.902491+0000","last_fullsized":"2026-02-17T12:27:35.902491+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:31:12.170800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026836900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27096,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344744,"statfs":{"total":96636764160,"available":96609017856,"internally_reserved":0,"allocated":126976,"data_stored":32456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27084,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344756,"statfs":{"total":96636764160,"available":96609030144,"internally_reserved":0,"allocated":122880,"data_stored":32437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27088,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344752,"statfs":{"total":96636764160,"available":96609026048,"internally_reserved":0,"allocated":126976,"data_stored":32456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:27:39.458 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T12:27:39.458 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T12:27:39.458 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T12:27:39.458 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T12:27:39.630 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:27:39.630 INFO:teuthology.orchestra.run.trial176.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T12:27:39.639 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-17T12:27:39.639 INFO:teuthology.run_tasks:Running task full_sequential... 2026-02-17T12:27:39.651 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-17T12:27:39.655 INFO:tasks.radosbench:Beginning radosbench... 2026-02-17T12:27:39.656 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-17T12:27:39.656 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-17T12:27:39.908 INFO:teuthology.orchestra.run.trial176.stderr:pool 'unique_pool_0' created 2026-02-17T12:27:39.920 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-17T12:27:40.912 INFO:teuthology.orchestra.run.trial176.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-17T12:27:41.927 DEBUG:teuthology.orchestra.run.trial176:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 30 write' 2026-02-17T12:27:41.929 INFO:tasks.radosbench:joining radosbench (timing out after 1200s) 2026-02-17T12:27:41.929 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:27:41.966 INFO:tasks.radosbench.radosbench.0.trial176.stdout:hints = 1 2026-02-17T12:27:41.966 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 30 seconds or 0 objects 2026-02-17T12:27:41.966 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Object prefix: benchmark_data_trial176_46910 2026-02-17T12:27:41.966 INFO:tasks.radosbench.radosbench.0.trial176.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T12:27:41.966 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 0 0 0 0 0 0 - 0 2026-02-17T12:27:42.966 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 1 16 9307 9291 580.64 580.688 0.00276649 0.00171944 2026-02-17T12:27:43.966 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 2 16 18127 18111 565.926 551.25 0.00183224 0.00176482 2026-02-17T12:27:44.966 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 3 16 24642 24626 513.003 407.188 0.00175654 0.00194738 2026-02-17T12:27:45.966 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 4 16 30677 30661 479.042 377.188 0.0017701 0.00208533 2026-02-17T12:27:46.966 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 5 16 37749 37733 471.627 442 0.00199942 0.00211815 2026-02-17T12:27:47.966 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 6 16 42970 42954 447.404 326.312 0.00189361 0.00223327 2026-02-17T12:27:48.967 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 7 15 49184 49169 438.976 388.438 0.00265876 0.00227613 2026-02-17T12:27:49.967 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 8 16 54952 54936 429.156 360.438 0.00191939 0.00232817 2026-02-17T12:27:50.967 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 9 16 60423 60407 419.462 341.938 0.00404815 0.00238207 2026-02-17T12:27:51.967 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 10 16 65459 65443 408.988 314.75 0.00457244 0.00244328 2026-02-17T12:27:52.967 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 11 15 69274 69259 393.488 238.5 0.00374915 0.00253939 2026-02-17T12:27:53.967 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 12 16 73797 73781 384.247 282.625 0.00578892 0.00260066 2026-02-17T12:27:54.967 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 13 16 78031 78015 375.044 264.625 0.00338702 0.0026647 2026-02-17T12:27:55.967 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 14 16 82172 82156 366.741 258.812 0.00433224 0.0027248 2026-02-17T12:27:56.967 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 15 16 86168 86152 358.94 249.75 0.0039669 0.0027842 2026-02-17T12:27:57.967 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 16 16 90020 90004 351.552 240.75 0.00298365 0.00284275 2026-02-17T12:27:58.967 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 17 16 93718 93702 344.467 231.125 0.00423074 0.00290114 2026-02-17T12:27:59.968 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 18 15 97342 97327 337.916 226.562 0.00302815 0.00295754 2026-02-17T12:28:00.967 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 19 16 100719 100703 331.235 211 0.00423082 0.00301715 2026-02-17T12:28:01.968 INFO:tasks.radosbench.radosbench.0.trial176.stdout:2026-02-17T12:28:01.967884+0000 min lat: 0.000722091 max lat: 0.207484 avg lat: 0.0030728 2026-02-17T12:28:01.968 INFO:tasks.radosbench.radosbench.0.trial176.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T12:28:01.968 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 20 16 104104 104088 325.251 211.562 0.0043386 0.0030728 2026-02-17T12:28:02.968 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 21 16 107311 107295 319.307 200.438 0.00263486 0.0031297 2026-02-17T12:28:03.967 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 22 16 110463 110447 313.747 197 0.00315903 0.00318547 2026-02-17T12:28:04.968 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 23 16 113490 113474 308.331 189.188 0.0050853 0.00324151 2026-02-17T12:28:05.968 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 24 16 116438 116422 303.16 184.25 0.00524665 0.00329665 2026-02-17T12:28:06.968 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 25 16 119365 119349 298.351 182.938 0.00574433 0.00334983 2026-02-17T12:28:07.968 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 26 16 122200 122184 293.69 177.188 0.0061477 0.00340308 2026-02-17T12:28:08.968 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 27 16 124990 124974 289.271 174.375 0.00419244 0.00345519 2026-02-17T12:28:09.968 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 28 16 127708 127692 285.006 169.875 0.00367394 0.00350701 2026-02-17T12:28:10.968 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 29 16 130345 130329 280.861 164.812 0.00557577 0.00355852 2026-02-17T12:28:11.968 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 30 8 132939 132931 276.919 162.625 0.00390321 0.00360924 2026-02-17T12:28:12.969 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Total time run: 30.0036 2026-02-17T12:28:12.969 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Total writes made: 132939 2026-02-17T12:28:12.969 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Write size: 65536 2026-02-17T12:28:12.969 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Object size: 65536 2026-02-17T12:28:12.969 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Bandwidth (MB/sec): 276.923 2026-02-17T12:28:12.970 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Stddev Bandwidth: 111.65 2026-02-17T12:28:12.970 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Max bandwidth (MB/sec): 580.688 2026-02-17T12:28:12.970 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Min bandwidth (MB/sec): 162.625 2026-02-17T12:28:12.970 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Average IOPS: 4430 2026-02-17T12:28:12.970 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Stddev IOPS: 1786.4 2026-02-17T12:28:12.970 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Max IOPS: 9291 2026-02-17T12:28:12.970 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Min IOPS: 2602 2026-02-17T12:28:12.971 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Average Latency(s): 0.00360953 2026-02-17T12:28:12.971 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Stddev Latency(s): 0.00484538 2026-02-17T12:28:12.971 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Max latency(s): 0.207484 2026-02-17T12:28:12.971 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Min latency(s): 0.000722091 2026-02-17T12:28:12.972 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Cleaning up (deleting benchmark objects) 2026-02-17T12:29:11.403 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Removed 132939 objects 2026-02-17T12:29:11.403 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Clean up completed and total clean up time :58.4313 2026-02-17T12:29:13.446 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-17T12:29:13.446 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-17T12:29:13.700 INFO:teuthology.orchestra.run.trial176.stderr:pool 'unique_pool_0' removed 2026-02-17T12:29:13.714 INFO:teuthology.task.full_sequential:In full_sequential, running task rebuild_mondb... 2026-02-17T12:29:13.719 DEBUG:teuthology.orchestra.run.trial176:> ceph mon getmap -o /tmp/monmap 2026-02-17T12:29:13.912 INFO:teuthology.orchestra.run.trial176.stderr:got monmap epoch 1 2026-02-17T12:29:13.920 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T12:29:14.079 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:29:14.079 INFO:teuthology.orchestra.run.trial176.stdout:{"epoch":18,"fsid":"e548cc2f-381c-4b27-aafa-8f43f7965f54","created":"2026-02-17T12:27:16.823790+0000","modified":"2026-02-17T12:29:13.696313+0000","last_up_change":"2026-02-17T12:27:26.884168+0000","last_in_change":"2026-02-17T12:27:18.317784+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T12:27:31.962642+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5293a7e-2eff-48e4-bdb8-f0f5af0e5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6800","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6801","nonce":2401167178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6802","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6803","nonce":2401167178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6806","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6807","nonce":2401167178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6804","nonce":2401167178},{"type":"v1","addr":"10.20.193.176:6805","nonce":2401167178}]},"public_addr":"10.20.193.176:6801/2401167178","cluster_addr":"10.20.193.176:6803/2401167178","heartbeat_back_addr":"10.20.193.176:6807/2401167178","heartbeat_front_addr":"10.20.193.176:6805/2401167178","state":["exists","up"]},{"osd":1,"uuid":"8b915722-f2d9-47b1-bae5-d892719b3619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6818","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6819","nonce":439788868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6820","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6821","nonce":439788868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6824","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6825","nonce":439788868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6822","nonce":439788868},{"type":"v1","addr":"10.20.193.176:6823","nonce":439788868}]},"public_addr":"10.20.193.176:6819/439788868","cluster_addr":"10.20.193.176:6821/439788868","heartbeat_back_addr":"10.20.193.176:6825/439788868","heartbeat_front_addr":"10.20.193.176:6823/439788868","state":["exists","up"]},{"osd":2,"uuid":"123abf21-71ed-4a75-a738-57b857e32044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6810","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6811","nonce":2390822115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6812","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6813","nonce":2390822115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6816","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6817","nonce":2390822115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6814","nonce":2390822115},{"type":"v1","addr":"10.20.193.176:6815","nonce":2390822115}]},"public_addr":"10.20.193.176:6811/2390822115","cluster_addr":"10.20.193.176:6813/2390822115","heartbeat_back_addr":"10.20.193.176:6817/2390822115","heartbeat_front_addr":"10.20.193.176:6815/2390822115","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:24.569394+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:25.557742+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:24.808240+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:29:14.089 INFO:tasks.rebuild_mondb.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2026-02-17T12:27:31.962642+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 14, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-17T12:29:14.090 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2026-02-17T12:29:14.254 INFO:teuthology.orchestra.run.trial176.stdout:pg_num: 8 2026-02-17T12:29:14.264 INFO:tasks.rebuild_mondb:killing ceph:mon.a 2026-02-17T12:29:14.264 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T12:29:14.265 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:29:14.274 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T12:29:14.274 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -r /var/lib/ceph/mon/ceph-a/store.db 2026-02-17T12:29:14.340 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -r /var/lib/ceph/mon/ceph-a/external_log_to 2026-02-17T12:29:14.404 INFO:tasks.rebuild_mondb:killing ceph:mon.b 2026-02-17T12:29:14.404 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T12:29:14.404 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:29:14.453 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T12:29:14.454 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -r /var/lib/ceph/mon/ceph-b 2026-02-17T12:29:14.518 INFO:tasks.rebuild_mondb:killing ceph:mon.c 2026-02-17T12:29:14.519 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T12:29:14.519 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:29:14.568 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T12:29:14.568 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -r /var/lib/ceph/mon/ceph-c 2026-02-17T12:29:14.632 INFO:tasks.rebuild_mondb:collecting maps from ceph:osd.0 2026-02-17T12:29:14.632 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -m o+x -p /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:14.695 DEBUG:teuthology.misc::sh: tar cz -f /tmp/rebuild_mondb-53q8pyhx.tgz -C /tmp/tmp7qmgt20i -- . 2026-02-17T12:29:14.752 DEBUG:teuthology.orchestra.run.trial176:> sudo tar xz -C /home/ubuntu/cephtest/mon-store -f /tmp/rebuild_mondb-_5gr8tt7.tgz 2026-02-17T12:29:14.780 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -fr /tmp/rebuild_mondb-_5gr8tt7.tgz 2026-02-17T12:29:14.843 INFO:tasks.rebuild_mondb:rm -rf /tmp/tmp7qmgt20i 2026-02-17T12:29:14.843 INFO:tasks.rebuild_mondb:cot /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:14.844 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T12:29:14.844 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:29:14.936 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T12:29:14.936 INFO:tasks.rebuild_mondb.ceph_manager:sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --no-mon-config --op update-mon-db --mon-store-path /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:14.936 DEBUG:teuthology.orchestra.run.trial176:> bash -e -x -c 'sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --no-mon-config --op update-mon-db --mon-store-path /home/ubuntu/cephtest/mon-store ' 2026-02-17T12:29:14.951 INFO:teuthology.orchestra.run.trial176.stderr:+ '[' -f /etc/bashrc ']' 2026-02-17T12:29:14.951 INFO:teuthology.orchestra.run.trial176.stderr:+ . /etc/bashrc 2026-02-17T12:29:14.951 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -z '' ']' 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:++ BASHRCSOURCED=Y 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:++ shopt -q login_shell 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:+++ umask 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' 0022 -eq 0 ']' 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:++ SHELL=/bin/bash 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-17T12:29:14.952 INFO:teuthology.orchestra.run.trial176.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'grep=grep --color=auto' 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorls.sh 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' '!' -t 0 ']' 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:+++ return 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:+++ export S_COLORS=auto 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:+++ S_COLORS=auto 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-17T12:29:14.954 INFO:teuthology.orchestra.run.trial176.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-17T12:29:14.956 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-17T12:29:14.956 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-17T12:29:14.956 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-17T12:29:14.956 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:14.956 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-17T12:29:14.956 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:14.956 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-17T12:29:14.956 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-17T12:29:14.956 INFO:teuthology.orchestra.run.trial176.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:+++ prefix=/usr 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:+++ unset prefix 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/gawk.sh 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/lang.sh 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:+++ unset LANG_backup 2026-02-17T12:29:14.958 INFO:teuthology.orchestra.run.trial176.stderr:++++ /usr/bin/locale 2026-02-17T12:29:14.959 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -n '' ']' 2026-02-17T12:29:14.959 INFO:teuthology.orchestra.run.trial176.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-17T12:29:14.959 INFO:teuthology.orchestra.run.trial176.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-17T12:29:14.959 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-17T12:29:14.959 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-17T12:29:14.959 INFO:teuthology.orchestra.run.trial176.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:++++ export LANG=en_US.UTF-8 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:++++ LANG=en_US.UTF-8 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:+++ LANG=en_US.UTF-8 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:+++ unset LANG_backup config 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -n '' ']' 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' dumb = linux ']' 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:14.960 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/less.sh 2026-02-17T12:29:14.961 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-17T12:29:14.961 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:14.961 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-17T12:29:14.961 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:14.961 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/which2.sh 2026-02-17T12:29:14.961 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -r /proc/47353/exe ']' 2026-02-17T12:29:14.961 INFO:teuthology.orchestra.run.trial176.stderr:+++++ readlink /proc/47353/exe 2026-02-17T12:29:14.961 INFO:teuthology.orchestra.run.trial176.stderr:++++ basename /usr/bin/bash 2026-02-17T12:29:14.962 INFO:teuthology.orchestra.run.trial176.stderr:+++ SHELLNAME=bash 2026-02-17T12:29:14.962 INFO:teuthology.orchestra.run.trial176.stderr:+++ case "$SHELLNAME" in 2026-02-17T12:29:14.962 INFO:teuthology.orchestra.run.trial176.stderr:+++ which_declare='declare -f' 2026-02-17T12:29:14.962 INFO:teuthology.orchestra.run.trial176.stderr:+++ which_opt=-f 2026-02-17T12:29:14.962 INFO:teuthology.orchestra.run.trial176.stderr:+++ export which_declare 2026-02-17T12:29:14.962 INFO:teuthology.orchestra.run.trial176.stderr:+++ export -f which 2026-02-17T12:29:14.962 INFO:teuthology.orchestra.run.trial176.stderr:++ unset i 2026-02-17T12:29:14.962 INFO:teuthology.orchestra.run.trial176.stderr:++ unset -f pathmunge 2026-02-17T12:29:14.962 INFO:teuthology.orchestra.run.trial176.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-17T12:29:14.962 INFO:teuthology.orchestra.run.trial176.stderr:+ export PATH 2026-02-17T12:29:14.962 INFO:teuthology.orchestra.run.trial176.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-17T12:29:14.962 INFO:teuthology.orchestra.run.trial176.stderr:+ unset rc 2026-02-17T12:29:14.962 INFO:teuthology.orchestra.run.trial176.stderr:+ sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --no-mon-config --op update-mon-db --mon-store-path /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:18.656 INFO:teuthology.orchestra.run.trial176.stdout:osd.0 : 0 osdmaps trimmed, 18 osdmaps added. 2026-02-17T12:29:19.175 INFO:tasks.rebuild_mondb:pull dir /home/ubuntu/cephtest/mon-store -> /tmp/tmp7qmgt20i 2026-02-17T12:29:19.175 DEBUG:teuthology.misc:Transferring archived files from trial176:/home/ubuntu/cephtest/mon-store to /tmp/tmprs8vko_m 2026-02-17T12:29:19.175 DEBUG:teuthology.orchestra.run.trial176:> sudo tar c -f - -C /home/ubuntu/cephtest/mon-store -- . 2026-02-17T12:29:19.239 INFO:tasks.rebuild_mondb:rm -rf osd:/home/ubuntu/cephtest/mon-store 2026-02-17T12:29:19.240 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -fr /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:19.306 INFO:tasks.rebuild_mondb:collecting maps from ceph:osd.1 2026-02-17T12:29:19.306 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -m o+x -p /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:19.371 DEBUG:teuthology.misc::sh: tar cz -f /tmp/rebuild_mondb-wcyfsch3.tgz -C /tmp/tmprs8vko_m -- . 2026-02-17T12:29:19.427 DEBUG:teuthology.orchestra.run.trial176:> sudo tar xz -C /home/ubuntu/cephtest/mon-store -f /tmp/rebuild_mondb-1dv03nbp.tgz 2026-02-17T12:29:19.453 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -fr /tmp/rebuild_mondb-1dv03nbp.tgz 2026-02-17T12:29:19.516 INFO:tasks.rebuild_mondb:rm -rf /tmp/tmprs8vko_m 2026-02-17T12:29:19.517 INFO:tasks.rebuild_mondb:cot /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:19.517 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T12:29:19.518 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:29:19.607 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T12:29:19.608 INFO:tasks.rebuild_mondb.ceph_manager:sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --no-mon-config --op update-mon-db --mon-store-path /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:19.608 DEBUG:teuthology.orchestra.run.trial176:> bash -e -x -c 'sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --no-mon-config --op update-mon-db --mon-store-path /home/ubuntu/cephtest/mon-store ' 2026-02-17T12:29:19.626 INFO:teuthology.orchestra.run.trial176.stderr:+ '[' -f /etc/bashrc ']' 2026-02-17T12:29:19.626 INFO:teuthology.orchestra.run.trial176.stderr:+ . /etc/bashrc 2026-02-17T12:29:19.627 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -z '' ']' 2026-02-17T12:29:19.627 INFO:teuthology.orchestra.run.trial176.stderr:++ BASHRCSOURCED=Y 2026-02-17T12:29:19.627 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:19.627 INFO:teuthology.orchestra.run.trial176.stderr:++ shopt -q login_shell 2026-02-17T12:29:19.627 INFO:teuthology.orchestra.run.trial176.stderr:+++ umask 2026-02-17T12:29:19.627 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' 0022 -eq 0 ']' 2026-02-17T12:29:19.627 INFO:teuthology.orchestra.run.trial176.stderr:++ SHELL=/bin/bash 2026-02-17T12:29:19.627 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:19.627 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-17T12:29:19.627 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:19.628 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-17T12:29:19.628 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-17T12:29:19.628 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:19.628 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-17T12:29:19.628 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:19.628 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-17T12:29:19.628 INFO:teuthology.orchestra.run.trial176.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-17T12:29:19.630 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'grep=grep --color=auto' 2026-02-17T12:29:19.631 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-17T12:29:19.631 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-17T12:29:19.631 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:19.631 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-17T12:29:19.631 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:19.631 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorls.sh 2026-02-17T12:29:19.631 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' '!' -t 0 ']' 2026-02-17T12:29:19.631 INFO:teuthology.orchestra.run.trial176.stderr:+++ return 2026-02-17T12:29:19.631 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:19.631 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-17T12:29:19.631 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:19.632 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-17T12:29:19.632 INFO:teuthology.orchestra.run.trial176.stderr:+++ export S_COLORS=auto 2026-02-17T12:29:19.632 INFO:teuthology.orchestra.run.trial176.stderr:+++ S_COLORS=auto 2026-02-17T12:29:19.632 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:19.632 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-17T12:29:19.632 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:19.632 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-17T12:29:19.632 INFO:teuthology.orchestra.run.trial176.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-17T12:29:19.632 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-17T12:29:19.632 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-17T12:29:19.632 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-17T12:29:19.632 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:19.633 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-17T12:29:19.633 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:19.633 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-17T12:29:19.633 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-17T12:29:19.633 INFO:teuthology.orchestra.run.trial176.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-17T12:29:19.638 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-17T12:29:19.638 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-17T12:29:19.638 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-17T12:29:19.638 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:19.638 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-17T12:29:19.639 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:19.639 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-17T12:29:19.639 INFO:teuthology.orchestra.run.trial176.stderr:+++ prefix=/usr 2026-02-17T12:29:19.639 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-17T12:29:19.639 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-17T12:29:19.639 INFO:teuthology.orchestra.run.trial176.stderr:+++ unset prefix 2026-02-17T12:29:19.639 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:19.639 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-17T12:29:19.639 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:19.639 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/gawk.sh 2026-02-17T12:29:19.639 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:19.639 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-17T12:29:19.640 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:19.640 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/lang.sh 2026-02-17T12:29:19.640 INFO:teuthology.orchestra.run.trial176.stderr:+++ unset LANG_backup 2026-02-17T12:29:19.640 INFO:teuthology.orchestra.run.trial176.stderr:++++ /usr/bin/locale 2026-02-17T12:29:19.640 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -n '' ']' 2026-02-17T12:29:19.640 INFO:teuthology.orchestra.run.trial176.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-17T12:29:19.640 INFO:teuthology.orchestra.run.trial176.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-17T12:29:19.640 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-17T12:29:19.640 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-17T12:29:19.640 INFO:teuthology.orchestra.run.trial176.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-17T12:29:19.640 INFO:teuthology.orchestra.run.trial176.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-17T12:29:19.640 INFO:teuthology.orchestra.run.trial176.stderr:++++ export LANG=en_US.UTF-8 2026-02-17T12:29:19.640 INFO:teuthology.orchestra.run.trial176.stderr:++++ LANG=en_US.UTF-8 2026-02-17T12:29:19.641 INFO:teuthology.orchestra.run.trial176.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-17T12:29:19.641 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-17T12:29:19.641 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-17T12:29:19.641 INFO:teuthology.orchestra.run.trial176.stderr:+++ LANG=en_US.UTF-8 2026-02-17T12:29:19.641 INFO:teuthology.orchestra.run.trial176.stderr:+++ unset LANG_backup config 2026-02-17T12:29:19.641 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -n '' ']' 2026-02-17T12:29:19.641 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-17T12:29:19.641 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' dumb = linux ']' 2026-02-17T12:29:19.641 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:19.641 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-17T12:29:19.641 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:19.641 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/less.sh 2026-02-17T12:29:19.641 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-17T12:29:19.642 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:19.642 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-17T12:29:19.642 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:19.642 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/which2.sh 2026-02-17T12:29:19.642 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -r /proc/48297/exe ']' 2026-02-17T12:29:19.642 INFO:teuthology.orchestra.run.trial176.stderr:+++++ readlink /proc/48297/exe 2026-02-17T12:29:19.642 INFO:teuthology.orchestra.run.trial176.stderr:++++ basename /usr/bin/bash 2026-02-17T12:29:19.642 INFO:teuthology.orchestra.run.trial176.stderr:+++ SHELLNAME=bash 2026-02-17T12:29:19.642 INFO:teuthology.orchestra.run.trial176.stderr:+++ case "$SHELLNAME" in 2026-02-17T12:29:19.642 INFO:teuthology.orchestra.run.trial176.stderr:+++ which_declare='declare -f' 2026-02-17T12:29:19.642 INFO:teuthology.orchestra.run.trial176.stderr:+++ which_opt=-f 2026-02-17T12:29:19.642 INFO:teuthology.orchestra.run.trial176.stderr:+++ export which_declare 2026-02-17T12:29:19.642 INFO:teuthology.orchestra.run.trial176.stderr:+++ export -f which 2026-02-17T12:29:19.643 INFO:teuthology.orchestra.run.trial176.stderr:++ unset i 2026-02-17T12:29:19.643 INFO:teuthology.orchestra.run.trial176.stderr:++ unset -f pathmunge 2026-02-17T12:29:19.643 INFO:teuthology.orchestra.run.trial176.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-17T12:29:19.643 INFO:teuthology.orchestra.run.trial176.stderr:+ export PATH 2026-02-17T12:29:19.643 INFO:teuthology.orchestra.run.trial176.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-17T12:29:19.643 INFO:teuthology.orchestra.run.trial176.stderr:+ unset rc 2026-02-17T12:29:19.643 INFO:teuthology.orchestra.run.trial176.stderr:+ sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --no-mon-config --op update-mon-db --mon-store-path /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:23.323 INFO:teuthology.orchestra.run.trial176.stdout:osd.1 : 0 osdmaps trimmed, 0 osdmaps added. 2026-02-17T12:29:23.816 INFO:tasks.rebuild_mondb:pull dir /home/ubuntu/cephtest/mon-store -> /tmp/tmprs8vko_m 2026-02-17T12:29:23.816 DEBUG:teuthology.misc:Transferring archived files from trial176:/home/ubuntu/cephtest/mon-store to /tmp/tmpfa20uqrf 2026-02-17T12:29:23.817 DEBUG:teuthology.orchestra.run.trial176:> sudo tar c -f - -C /home/ubuntu/cephtest/mon-store -- . 2026-02-17T12:29:23.885 INFO:tasks.rebuild_mondb:rm -rf osd:/home/ubuntu/cephtest/mon-store 2026-02-17T12:29:23.885 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -fr /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:23.946 INFO:tasks.rebuild_mondb:collecting maps from ceph:osd.2 2026-02-17T12:29:23.947 DEBUG:teuthology.orchestra.run.trial176:> sudo mkdir -m o+x -p /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:24.011 DEBUG:teuthology.misc::sh: tar cz -f /tmp/rebuild_mondb-4p5o11f8.tgz -C /tmp/tmpfa20uqrf -- . 2026-02-17T12:29:24.069 DEBUG:teuthology.orchestra.run.trial176:> sudo tar xz -C /home/ubuntu/cephtest/mon-store -f /tmp/rebuild_mondb-8incr33f.tgz 2026-02-17T12:29:24.096 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -fr /tmp/rebuild_mondb-8incr33f.tgz 2026-02-17T12:29:24.159 INFO:tasks.rebuild_mondb:rm -rf /tmp/tmpfa20uqrf 2026-02-17T12:29:24.160 INFO:tasks.rebuild_mondb:cot /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:24.160 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T12:29:24.161 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:29:24.244 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T12:29:24.244 INFO:tasks.rebuild_mondb.ceph_manager:sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --no-mon-config --op update-mon-db --mon-store-path /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:24.244 DEBUG:teuthology.orchestra.run.trial176:> bash -e -x -c 'sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --no-mon-config --op update-mon-db --mon-store-path /home/ubuntu/cephtest/mon-store ' 2026-02-17T12:29:24.260 INFO:teuthology.orchestra.run.trial176.stderr:+ '[' -f /etc/bashrc ']' 2026-02-17T12:29:24.260 INFO:teuthology.orchestra.run.trial176.stderr:+ . /etc/bashrc 2026-02-17T12:29:24.260 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -z '' ']' 2026-02-17T12:29:24.260 INFO:teuthology.orchestra.run.trial176.stderr:++ BASHRCSOURCED=Y 2026-02-17T12:29:24.260 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:24.260 INFO:teuthology.orchestra.run.trial176.stderr:++ shopt -q login_shell 2026-02-17T12:29:24.261 INFO:teuthology.orchestra.run.trial176.stderr:+++ umask 2026-02-17T12:29:24.261 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' 0022 -eq 0 ']' 2026-02-17T12:29:24.261 INFO:teuthology.orchestra.run.trial176.stderr:++ SHELL=/bin/bash 2026-02-17T12:29:24.261 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:24.261 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-17T12:29:24.261 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:24.261 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-17T12:29:24.261 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-17T12:29:24.261 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:24.261 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-17T12:29:24.261 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:24.261 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-17T12:29:24.261 INFO:teuthology.orchestra.run.trial176.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'grep=grep --color=auto' 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorls.sh 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' '!' -t 0 ']' 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:+++ return 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:+++ export S_COLORS=auto 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:+++ S_COLORS=auto 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-17T12:29:24.263 INFO:teuthology.orchestra.run.trial176.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-17T12:29:24.264 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-17T12:29:24.265 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-17T12:29:24.265 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-17T12:29:24.265 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:24.265 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-17T12:29:24.265 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:24.265 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-17T12:29:24.265 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-17T12:29:24.265 INFO:teuthology.orchestra.run.trial176.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:+++ prefix=/usr 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:+++ unset prefix 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/gawk.sh 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/lang.sh 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:+++ unset LANG_backup 2026-02-17T12:29:24.267 INFO:teuthology.orchestra.run.trial176.stderr:++++ /usr/bin/locale 2026-02-17T12:29:24.268 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -n '' ']' 2026-02-17T12:29:24.268 INFO:teuthology.orchestra.run.trial176.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-17T12:29:24.268 INFO:teuthology.orchestra.run.trial176.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-17T12:29:24.268 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-17T12:29:24.268 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-17T12:29:24.268 INFO:teuthology.orchestra.run.trial176.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-17T12:29:24.269 INFO:teuthology.orchestra.run.trial176.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-17T12:29:24.269 INFO:teuthology.orchestra.run.trial176.stderr:++++ export LANG=en_US.UTF-8 2026-02-17T12:29:24.269 INFO:teuthology.orchestra.run.trial176.stderr:++++ LANG=en_US.UTF-8 2026-02-17T12:29:24.269 INFO:teuthology.orchestra.run.trial176.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-17T12:29:24.269 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-17T12:29:24.269 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-17T12:29:24.269 INFO:teuthology.orchestra.run.trial176.stderr:+++ LANG=en_US.UTF-8 2026-02-17T12:29:24.269 INFO:teuthology.orchestra.run.trial176.stderr:+++ unset LANG_backup config 2026-02-17T12:29:24.269 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -n '' ']' 2026-02-17T12:29:24.269 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-17T12:29:24.269 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' dumb = linux ']' 2026-02-17T12:29:24.269 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:24.269 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-17T12:29:24.270 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:24.270 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/less.sh 2026-02-17T12:29:24.270 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-17T12:29:24.270 INFO:teuthology.orchestra.run.trial176.stderr:++ for i in /etc/profile.d/*.sh 2026-02-17T12:29:24.270 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-17T12:29:24.270 INFO:teuthology.orchestra.run.trial176.stderr:++ '[' '' ']' 2026-02-17T12:29:24.270 INFO:teuthology.orchestra.run.trial176.stderr:++ . /etc/profile.d/which2.sh 2026-02-17T12:29:24.270 INFO:teuthology.orchestra.run.trial176.stderr:+++ '[' -r /proc/49241/exe ']' 2026-02-17T12:29:24.270 INFO:teuthology.orchestra.run.trial176.stderr:+++++ readlink /proc/49241/exe 2026-02-17T12:29:24.270 INFO:teuthology.orchestra.run.trial176.stderr:++++ basename /usr/bin/bash 2026-02-17T12:29:24.271 INFO:teuthology.orchestra.run.trial176.stderr:+++ SHELLNAME=bash 2026-02-17T12:29:24.271 INFO:teuthology.orchestra.run.trial176.stderr:+++ case "$SHELLNAME" in 2026-02-17T12:29:24.271 INFO:teuthology.orchestra.run.trial176.stderr:+++ which_declare='declare -f' 2026-02-17T12:29:24.271 INFO:teuthology.orchestra.run.trial176.stderr:+++ which_opt=-f 2026-02-17T12:29:24.271 INFO:teuthology.orchestra.run.trial176.stderr:+++ export which_declare 2026-02-17T12:29:24.271 INFO:teuthology.orchestra.run.trial176.stderr:+++ export -f which 2026-02-17T12:29:24.271 INFO:teuthology.orchestra.run.trial176.stderr:++ unset i 2026-02-17T12:29:24.271 INFO:teuthology.orchestra.run.trial176.stderr:++ unset -f pathmunge 2026-02-17T12:29:24.271 INFO:teuthology.orchestra.run.trial176.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-17T12:29:24.271 INFO:teuthology.orchestra.run.trial176.stderr:+ export PATH 2026-02-17T12:29:24.271 INFO:teuthology.orchestra.run.trial176.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-17T12:29:24.271 INFO:teuthology.orchestra.run.trial176.stderr:+ unset rc 2026-02-17T12:29:24.271 INFO:teuthology.orchestra.run.trial176.stderr:+ sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --no-mon-config --op update-mon-db --mon-store-path /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:26.970 INFO:teuthology.orchestra.run.trial176.stdout:osd.2 : 0 osdmaps trimmed, 0 osdmaps added. 2026-02-17T12:29:27.470 INFO:tasks.rebuild_mondb:pull dir /home/ubuntu/cephtest/mon-store -> /tmp/tmpfa20uqrf 2026-02-17T12:29:27.470 DEBUG:teuthology.misc:Transferring archived files from trial176:/home/ubuntu/cephtest/mon-store to /tmp/tmp1c0pw8vg 2026-02-17T12:29:27.470 DEBUG:teuthology.orchestra.run.trial176:> sudo tar c -f - -C /home/ubuntu/cephtest/mon-store -- . 2026-02-17T12:29:27.538 INFO:tasks.rebuild_mondb:rm -rf osd:/home/ubuntu/cephtest/mon-store 2026-02-17T12:29:27.539 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -fr /home/ubuntu/cephtest/mon-store 2026-02-17T12:29:27.601 DEBUG:teuthology.misc::sh: tar cz -f /tmp/rebuild_mondb-3ya1gy7d.tgz -C /tmp/tmp1c0pw8vg -- . 2026-02-17T12:29:27.660 DEBUG:teuthology.orchestra.run.trial176:> sudo tar xz -C /var/lib/ceph/mon/ceph-a -f /tmp/rebuild_mondb-3rfsd1g3.tgz 2026-02-17T12:29:27.688 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -fr /tmp/rebuild_mondb-3rfsd1g3.tgz 2026-02-17T12:29:27.752 DEBUG:teuthology.orchestra.run.trial176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T12:29:27.818 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph-authtool /etc/ceph/ceph.keyring -n mon. --cap mon 'allow *' 2026-02-17T12:29:27.892 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph-authtool /etc/ceph/ceph.keyring -n client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' 2026-02-17T12:29:27.969 DEBUG:teuthology.orchestra.run.trial176:> sudo -u ceph CEPH_ARGS=--no-mon-config ceph-monstore-tool /var/lib/ceph/mon/ceph-a rebuild -- --keyring /etc/ceph/ceph.keyring --monmap /tmp/monmap 2026-02-17T12:29:28.044 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: RocksDB version: 7.9.2 2026-02-17T12:29:28.044 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.044 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Git sha 0 2026-02-17T12:29:28.044 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Compile date 2026-02-13 11:06:07 2026-02-17T12:29:28.044 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: DB SUMMARY 2026-02-17T12:29:28.044 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.044 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: DB Session ID: V4K89DHI53RG7TEZO84K 2026-02-17T12:29:28.044 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.044 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: CURRENT file: CURRENT 2026-02-17T12:29:28.044 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.044 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: IDENTITY file: IDENTITY 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: MANIFEST file: MANIFEST-000015 size: 287 Bytes 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000008.sst 000013.sst 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000014.log size: 243 ; 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.error_if_exists: 0 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.create_if_missing: 0 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.paranoid_checks: 1 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.flush_verify_memtable_count: 1 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.env: 0x55fac91b9f80 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.fs: PosixFileSystem 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.info_log: 0x55fac9efb2c0 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_file_opening_threads: 16 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.statistics: (nil) 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.use_fsync: 0 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_log_file_size: 0 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.log_file_time_to_roll: 0 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.keep_log_file_num: 1000 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.recycle_log_file_num: 0 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.allow_fallocate: 1 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.allow_mmap_reads: 0 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.allow_mmap_writes: 0 2026-02-17T12:29:28.045 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.use_direct_reads: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.create_missing_column_families: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.db_log_dir: 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.wal_dir: 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.table_cache_numshardbits: 6 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.WAL_ttl_seconds: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.WAL_size_limit_MB: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.is_fd_close_on_exec: 1 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.advise_random_on_open: 1 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.db_write_buffer_size: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.write_buffer_manager: 0x55fac9e57040 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.use_adaptive_mutex: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.rate_limiter: (nil) 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.wal_recovery_mode: 2 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.enable_thread_tracking: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.enable_pipelined_write: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.unordered_write: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.row_cache: None 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.wal_filter: None 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.allow_ingest_behind: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.two_write_queues: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.manual_wal_flush: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.wal_compression: 0 2026-02-17T12:29:28.046 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.atomic_flush: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.persist_stats_to_disk: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.write_dbid_to_manifest: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.log_readahead_size: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.best_efforts_recovery: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.allow_data_in_errors: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.db_host_id: __hostname__ 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.enforce_single_del_contracts: true 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_background_jobs: 2 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_background_compactions: -1 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_subcompactions: 1 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.delayed_write_rate : 16777216 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_total_wal_size: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.stats_dump_period_sec: 600 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.stats_persist_period_sec: 600 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_open_files: -1 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.bytes_per_sync: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.wal_bytes_per_sync: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.strict_bytes_per_sync: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compaction_readahead_size: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_background_flushes: -1 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Compression algorithms supported: 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: kZSTD supported: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: kXpressCompression supported: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: kBZip2Compression supported: 0 2026-02-17T12:29:28.047 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: kLZ4Compression supported: 1 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: kZlibCompression supported: 1 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: kLZ4HCCompression supported: 1 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: kSnappyCompression supported: 1 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Fast CRC32 supported: Supported on x86 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: DMutex implementation: pthread_mutex_t 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.merge_operator: 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compaction_filter: None 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compaction_filter_factory: None 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.sst_partitioner_factory: None 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.memtable_factory: SkipListFactory 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.table_factory: BlockBasedTable 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fac9efb520) 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: cache_index_and_filter_blocks: 1 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: pin_top_level_index_and_filter: 1 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: index_type: 0 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: data_block_index_type: 0 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: index_shortening: 1 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: data_block_hash_table_util_ratio: 0.750000 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: checksum: 4 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: no_block_cache: 0 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: block_cache: 0x55fac9e77770 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: block_cache_name: BinnedLRUCache 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: block_cache_options: 2026-02-17T12:29:28.048 INFO:teuthology.orchestra.run.trial176.stderr: capacity : 536870912 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: num_shard_bits : 4 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: strict_capacity_limit : 0 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: high_pri_pool_ratio: 0.000 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: block_cache_compressed: (nil) 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: persistent_cache: (nil) 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: block_size: 4096 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: block_size_deviation: 10 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: block_restart_interval: 16 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: index_block_restart_interval: 1 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: metadata_block_size: 4096 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: partition_filters: 0 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: use_delta_encoding: 1 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: filter_policy: bloomfilter 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: whole_key_filtering: 1 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: verify_compression: 0 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: read_amp_bytes_per_bit: 0 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: format_version: 5 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: enable_index_compression: 1 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: block_align: 0 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: max_auto_readahead_size: 262144 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: prepopulate_block_cache: 0 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: initial_auto_readahead_size: 8192 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: num_file_reads_for_auto_readahead: 2 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.write_buffer_size: 33554432 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_write_buffer_number: 2 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compression: NoCompression 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.bottommost_compression: Disabled 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.prefix_extractor: nullptr 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.num_levels: 7 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-17T12:29:28.049 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compression_opts.window_bits: -14 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compression_opts.level: 32767 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compression_opts.strategy: 0 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compression_opts.enabled: false 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.target_file_size_base: 67108864 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.target_file_size_multiplier: 1 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-17T12:29:28.050 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.arena_block_size: 1048576 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.disable_auto_compactions: 0 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.inplace_update_support: 0 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.inplace_update_num_locks: 10000 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.memtable_huge_page_size: 0 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.bloom_locality: 0 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.max_successive_merges: 0 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.optimize_filters_for_hits: 0 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.paranoid_file_checks: 0 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.force_consistency_checks: 1 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.report_bg_io_stats: 0 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.ttl: 2592000 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.periodic_compaction_seconds: 0 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-17T12:29:28.051 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.enable_blob_files: false 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.min_blob_size: 0 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.blob_file_size: 268435456 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.blob_compression_type: NoCompression 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.enable_blob_garbage_collection: false 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.blob_file_starting_level: 0 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.042+0000 7fead0bc5880 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.043+0000 7fead0bc5880 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 17, last_sequence is 80, log_number is 10,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 10 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.043+0000 7fead0bc5880 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 10 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.043+0000 7fead0bc5880 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5a6a2e33-45da-4396-8f1f-52eb317e027e 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.043+0000 7fead0bc5880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1771331368044257, "job": 1, "event": "recovery_started", "wal_files": [14]} 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.043+0000 7fead0bc5880 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #14 mode 2 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.043+0000 7fead0bc5880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1771331368044545, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 18, "file_size": 1370, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 81, "largest_seqno": 83, "table_properties": {"data_size": 237, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 71, "raw_average_key_size": 23, "raw_value_size": 148, "raw_average_value_size": 49, "num_data_blocks": 1, "num_entries": 3, "num_filter_entries": 3, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771331368, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5a6a2e33-45da-4396-8f1f-52eb317e027e", "db_session_id": "V4K89DHI53RG7TEZO84K", "orig_file_number": 18, "seqno_to_time_mapping": "N/A"}} 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.043+0000 7fead0bc5880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1771331368044634, "job": 1, "event": "recovery_finished"} 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.043+0000 7fead0bc5880 4 rocksdb: [db/version_set.cc:5047] Creating manifest 20 2026-02-17T12:29:28.052 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000014.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fac9e78e00 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 4 rocksdb: DB pointer 0x55facabd2000 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7feac6fd6640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7feac6fd6640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:** DB Stats ** 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:** Compaction Stats [default] ** 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr: L0 3/0 49.17 KB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr: Sum 3/0 49.17 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:** Compaction Stats [default] ** 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.053 INFO:teuthology.orchestra.run.trial176.stderr:Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr:Flush(GB): cumulative 0.000, interval 0.000 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr:AddFile(GB): cumulative 0.000, interval 0.000 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr:AddFile(Total Files): cumulative 0, interval 0 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr:AddFile(L0 Files): cumulative 0, interval 0 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr:AddFile(Keys): cumulative 0, interval 0 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr:Cumulative compaction: 0.00 GB write, 0.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr:Interval compaction: 0.00 GB write, 0.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr:Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr:Block cache BinnedLRUCache@0x55fac9e77770#50263 capacity: 512.00 MB usage: 1.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr:Block cache entry stats(count,size,portion): FilterBlock(3,0.39 KB,7.45058e-05%) IndexBlock(3,0.61 KB,0.000116229%) Misc(1,0.00 KB,0%) 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr:** File Read Latency Histogram By Level [default] ** 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stdout:adding auth for 'mon.': auth(key=AQCRXpRpyT4+GhAAkdS05JYhMprWNL+9YtyXUw==) with caps({mon=allow *}) 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stdout:adding auth for 'osd.0': auth(key=AQCUXpRpPL7LMBAAGIlaOdqcJKbW1CHtXvG82Q==) with caps({mgr=allow profile osd,mon=allow profile osd,osd=allow *}) 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stdout:adding auth for 'osd.1': auth(key=AQCXXpRpzpvaMxAA5smpwwtuuzHv8iVcRhkLug==) with caps({mgr=allow profile osd,mon=allow profile osd,osd=allow *}) 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stdout:adding auth for 'osd.2': auth(key=AQCbXpRp5EFDCRAAvrfn9YTGwAYe/2qiy6aEWA==) with caps({mgr=allow profile osd,mon=allow profile osd,osd=allow *}) 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2026-02-17T12:29:28.054 INFO:teuthology.orchestra.run.trial176.stdout:adding auth for 'client.0': auth(key=AQCSXpRpr9c2DhAA+YvQCqQeECdaQkIc5FvVeg==) with caps({mds=allow,mgr=allow r,mon=allow rw,osd=allow rwx}) 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stdout:adding auth for 'client.admin': auth(key=AQCRXpRpnpn8MxAApzdSqiF8MncZnTA+ZMRmjg==) with caps({mds=allow *,mgr=allow *,mon=allow *,osd=allow *}) 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stdout:adding auth for 'mgr.x': auth(key=AQCSXpRp4gvwCxAAvGUb4rCS4oIDhPVDQ377AQ==) with caps({mds=allow *,mon=allow profile mgr,osd=allow *}) 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 20 cephx keyserver: prepare_rotating_update before: data.rotating_ver=0 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding auth 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding auth id 1 AQAoX5RpWdq4AhAAx3DzD5UTrVlbkWG4288MjQ== expires 2026-02-17T12:40:28.045667+0000 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding auth 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding auth id 2 AQAoX5RpnfK4AhAAUbzZl+1eH1DA7wDJaSZhLA== expires 2026-02-17T12:51:28.045667+0000 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding auth 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding auth id 3 AQAoX5Rpkv24AhAAGtw9mnJamYaxdXiR5cn9uw== expires 2026-02-17T13:02:28.045667+0000 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding mon 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding mon id 1 AQAoX5RptQe5AhAAXRddV+ZjCBtNn846BA391A== expires 2026-02-17T12:33:28.045680+0000 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding mon 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding mon id 2 AQAoX5Rp5xC5AhAAmH/Lh+FeWfywRV0YiBeOJQ== expires 2026-02-17T12:37:28.045680+0000 2026-02-17T12:29:28.055 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding mon 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding mon id 3 AQAoX5RpQhq5AhAARSw+H2TvtKSLgkcI93miGw== expires 2026-02-17T12:41:28.045680+0000 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding osd 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding osd id 1 AQAoX5RpZCS5AhAAnVSEyU1NmemQYTHKUZtiyw== expires 2026-02-17T12:33:28.045687+0000 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding osd 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding osd id 2 AQAoX5RpjS25AhAAuEWjlWBPt7mjpkB6OCqDPg== expires 2026-02-17T12:37:28.045687+0000 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding osd 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding osd id 3 AQAoX5RpfTe5AhAAollRLLL8SdMt5OdnEILU0w== expires 2026-02-17T12:41:28.045687+0000 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding mds 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding mds id 1 AQAoX5Rp50q5AhAAKBB/w6/R7SF7sdeEH9obLQ== expires 2026-02-17T12:33:28.045696+0000 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding mds 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding mds id 2 AQAoX5Rpr1S5AhAAkJ5P7kCiDYU24REMJzMmCA== expires 2026-02-17T12:37:28.045696+0000 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding mds 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding mds id 3 AQAoX5RpWWC5AhAAzKcum2agTrlnJDahDDBiAQ== expires 2026-02-17T12:41:28.045696+0000 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding mgr 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding mgr id 1 AQAoX5RpRWm5AhAAVx5Obm6HUGSCbQ4tCN9kzQ== expires 2026-02-17T12:33:28.045705+0000 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding mgr 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding mgr id 2 AQAoX5Rp0XS5AhAA05tTjisBPPD8XWLU63owvQ== expires 2026-02-17T12:37:28.045705+0000 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 10 cephx keyserver: _rotate_secret adding mgr 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 30 cephx keyserver: _rotate_secret adding mgr id 3 AQAoX5Rpi325AhAAf5Qy8GBNR66e/yIEPlKDLA== expires 2026-02-17T12:41:28.045705+0000 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.044+0000 7fead0bc5880 20 cephx keyserver: prepare_rotating_update after: pending_data.rotating_ver=1 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stdout:update_mkfs pulling initial monmap from /tmp/monmap 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.045+0000 7fead0bc5880 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2026-02-17T12:29:28.056 INFO:teuthology.orchestra.run.trial176.stderr:2026-02-17T12:29:28.045+0000 7fead0bc5880 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2026-02-17T12:29:28.057 INFO:teuthology.orchestra.run.trial176.stdout:epoch 1 2026-02-17T12:29:28.057 INFO:teuthology.orchestra.run.trial176.stdout:fsid e548cc2f-381c-4b27-aafa-8f43f7965f54 2026-02-17T12:29:28.057 INFO:teuthology.orchestra.run.trial176.stdout:last_changed 2026-02-17T12:26:57.638151+0000 2026-02-17T12:29:28.057 INFO:teuthology.orchestra.run.trial176.stdout:created 2026-02-17T12:26:57.638151+0000 2026-02-17T12:29:28.057 INFO:teuthology.orchestra.run.trial176.stdout:min_mon_release 19 (squid) 2026-02-17T12:29:28.057 INFO:teuthology.orchestra.run.trial176.stdout:election_strategy: 3 2026-02-17T12:29:28.057 INFO:teuthology.orchestra.run.trial176.stdout:0: [v2:10.20.193.176:3300/0,v1:10.20.193.176:6789/0] mon.a 2026-02-17T12:29:28.057 INFO:teuthology.orchestra.run.trial176.stdout:1: [v2:10.20.193.176:3301/0,v1:10.20.193.176:6790/0] mon.b 2026-02-17T12:29:28.057 INFO:teuthology.orchestra.run.trial176.stdout:2: [v2:10.20.193.176:3302/0,v1:10.20.193.176:6791/0] mon.c 2026-02-17T12:29:28.057 INFO:tasks.rebuild_mondb:reviving mon.a 2026-02-17T12:29:28.057 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T12:29:28.057 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-17T12:29:28.099 INFO:tasks.ceph.mon.a:Started 2026-02-17T12:29:28.099 INFO:tasks.rebuild_mondb:running mkfs on ceph:mon.b 2026-02-17T12:29:28.099 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph-mon --cluster ceph --mkfs -i b --keyring /etc/ceph/ceph.keyring --monmap /tmp/monmap 2026-02-17T12:29:28.145 INFO:tasks.rebuild_mondb:reviving mon.b 2026-02-17T12:29:28.145 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T12:29:28.145 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-17T12:29:28.147 INFO:tasks.ceph.mon.b:Started 2026-02-17T12:29:28.147 INFO:tasks.rebuild_mondb:running mkfs on ceph:mon.c 2026-02-17T12:29:28.148 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph-mon --cluster ceph --mkfs -i c --keyring /etc/ceph/ceph.keyring --monmap /tmp/monmap 2026-02-17T12:29:28.194 INFO:tasks.rebuild_mondb:reviving mon.c 2026-02-17T12:29:28.194 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T12:29:28.194 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-17T12:29:28.196 INFO:tasks.ceph.mon.c:Started 2026-02-17T12:29:28.196 INFO:tasks.rebuild_mondb.ceph_manager:waiting for quorum size 3 2026-02-17T12:29:28.197 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-17T12:29:31.613 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:31.612+0000 7f2ede7fd640 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] 2026-02-17T12:29:31.614 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:31.612+0000 7f2eddffc640 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] 2026-02-17T12:29:31.614 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:31.612+0000 7f2ede7fd640 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] 2026-02-17T12:29:31.760 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:31.759+0000 7f2ede7fd640 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] 2026-02-17T12:29:31.760 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:31.759+0000 7f2ede7fd640 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] 2026-02-17T12:29:31.761 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:31.759+0000 7f2edeffe640 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] 2026-02-17T12:29:31.769 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:31.769+0000 7f2ede7fd640 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] 2026-02-17T12:29:31.769 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:31.769+0000 7f2eddffc640 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] 2026-02-17T12:29:31.769 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:31.769+0000 7f2edeffe640 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] 2026-02-17T12:29:39.683 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:39.682+0000 7f2eddffc640 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] 2026-02-17T12:29:39.683 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:39.682+0000 7f2ede7fd640 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] 2026-02-17T12:29:39.683 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:39.682+0000 7f2eddffc640 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] 2026-02-17T12:29:46.303 INFO:teuthology.orchestra.run.trial176.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e548cc2f-381c-4b27-aafa-8f43f7965f54","modified":"2026-02-17T12:26:57.638151Z","created":"2026-02-17T12:26:57.638151Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:3300","nonce":0},{"type":"v1","addr":"10.20.193.176:6789","nonce":0}]},"addr":"10.20.193.176:6789/0","public_addr":"10.20.193.176:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:3301","nonce":0},{"type":"v1","addr":"10.20.193.176:6790","nonce":0}]},"addr":"10.20.193.176:6790/0","public_addr":"10.20.193.176:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:3302","nonce":0},{"type":"v1","addr":"10.20.193.176:6791","nonce":0}]},"addr":"10.20.193.176:6791/0","public_addr":"10.20.193.176:6791/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-17T12:29:46.311 INFO:tasks.rebuild_mondb.ceph_manager:quorum is size 3 2026-02-17T12:29:46.311 INFO:tasks.rebuild_mondb:reviving mgr.x 2026-02-17T12:29:46.312 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T12:29:46.312 INFO:tasks.ceph.mgr.x:Stopping old one... 2026-02-17T12:29:46.312 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T12:29:46.312 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:29:46.341 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T12:29:46.341 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-17T12:29:46.383 INFO:tasks.ceph.mgr.x:Started 2026-02-17T12:29:46.383 INFO:tasks.rebuild_mondb:reviving osd.0 2026-02-17T12:29:46.383 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T12:29:46.384 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-17T12:29:46.386 INFO:tasks.ceph.osd.0:Started 2026-02-17T12:29:46.386 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-17T12:29:46.456 INFO:teuthology.orchestra.run.trial176.stderr:no valid command found; 10 closest matches: 2026-02-17T12:29:46.457 INFO:teuthology.orchestra.run.trial176.stderr:0 2026-02-17T12:29:46.457 INFO:teuthology.orchestra.run.trial176.stderr:1 2026-02-17T12:29:46.457 INFO:teuthology.orchestra.run.trial176.stderr:2 2026-02-17T12:29:46.457 INFO:teuthology.orchestra.run.trial176.stderr:abort 2026-02-17T12:29:46.457 INFO:teuthology.orchestra.run.trial176.stderr:assert 2026-02-17T12:29:46.457 INFO:teuthology.orchestra.run.trial176.stderr:config diff 2026-02-17T12:29:46.457 INFO:teuthology.orchestra.run.trial176.stderr:config diff get 2026-02-17T12:29:46.457 INFO:teuthology.orchestra.run.trial176.stderr:config get 2026-02-17T12:29:46.457 INFO:teuthology.orchestra.run.trial176.stderr:config help [] 2026-02-17T12:29:46.457 INFO:teuthology.orchestra.run.trial176.stderr:config set ... 2026-02-17T12:29:46.457 INFO:teuthology.orchestra.run.trial176.stderr:admin_socket: invalid command 2026-02-17T12:29:46.459 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T12:29:46.459 INFO:tasks.rebuild_mondb.ceph_manager:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2026-02-17T12:29:46.694 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:46.693+0000 7f83d53db140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T12:29:46.812 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:46.812+0000 7f83d53db140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T12:29:46.835 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:46.834+0000 7f83d53db140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T12:29:46.861 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:46.860+0000 7f83d53db140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T12:29:46.882 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:46.881+0000 7f83d53db140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T12:29:46.908 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:46.907+0000 7f83d53db140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T12:29:46.960 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:46.959+0000 7f83d53db140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T12:29:47.020 INFO:tasks.ceph.mgr.x.trial176.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T12:29:47.021 INFO:tasks.ceph.mgr.x.trial176.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T12:29:47.021 INFO:tasks.ceph.mgr.x.trial176.stderr: from numpy import show_config as show_numpy_config 2026-02-17T12:29:47.023 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.022+0000 7f83d53db140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T12:29:47.048 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.047+0000 7f83d53db140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T12:29:47.102 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.101+0000 7f83d53db140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T12:29:47.144 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.143+0000 7f83d53db140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T12:29:47.168 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.167+0000 7f83d53db140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T12:29:47.192 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.191+0000 7f83d53db140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T12:29:47.217 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.216+0000 7f83d53db140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T12:29:47.237 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.237+0000 7f83d53db140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T12:29:47.395 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.394+0000 7f83d53db140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T12:29:47.451 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.450+0000 7f83d53db140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T12:29:47.472 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.471+0000 7f83d53db140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T12:29:47.494 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.493+0000 7f83d53db140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T12:29:47.547 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.546+0000 7f83d53db140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:29:47.568 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.567+0000 7f83d53db140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T12:29:47.621 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.620+0000 7f83d53db140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:29:47.961 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.960+0000 7f83d53db140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T12:29:47.982 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:47.981+0000 7f83d53db140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T12:29:48.318 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:48.317+0000 7f83d53db140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T12:29:48.326 INFO:tasks.ceph.osd.0.trial176.stderr:2026-02-17T12:29:48.325+0000 7f66dfe14780 -1 Falling back to public interface 2026-02-17T12:29:50.265 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:50.264+0000 7f82f206b640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-17T12:29:50.265 INFO:tasks.ceph.mgr.x.trial176.stderr:2026-02-17T12:29:50.264+0000 7f82f206b640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-17T12:29:51.460 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-17T12:29:51.528 INFO:teuthology.orchestra.run.trial176.stderr:no valid command found; 10 closest matches: 2026-02-17T12:29:51.529 INFO:teuthology.orchestra.run.trial176.stderr:0 2026-02-17T12:29:51.529 INFO:teuthology.orchestra.run.trial176.stderr:1 2026-02-17T12:29:51.529 INFO:teuthology.orchestra.run.trial176.stderr:2 2026-02-17T12:29:51.529 INFO:teuthology.orchestra.run.trial176.stderr:abort 2026-02-17T12:29:51.529 INFO:teuthology.orchestra.run.trial176.stderr:assert 2026-02-17T12:29:51.529 INFO:teuthology.orchestra.run.trial176.stderr:config diff 2026-02-17T12:29:51.529 INFO:teuthology.orchestra.run.trial176.stderr:config diff get 2026-02-17T12:29:51.529 INFO:teuthology.orchestra.run.trial176.stderr:config get 2026-02-17T12:29:51.529 INFO:teuthology.orchestra.run.trial176.stderr:config help [] 2026-02-17T12:29:51.530 INFO:teuthology.orchestra.run.trial176.stderr:config set ... 2026-02-17T12:29:51.530 INFO:teuthology.orchestra.run.trial176.stderr:admin_socket: invalid command 2026-02-17T12:29:51.530 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T12:29:51.531 INFO:tasks.rebuild_mondb.ceph_manager:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2026-02-17T12:29:52.073 INFO:tasks.ceph.osd.0.trial176.stderr:2026-02-17T12:29:52.072+0000 7f66dfe14780 -1 osd.0 18 log_to_monitors true 2026-02-17T12:29:52.292 INFO:tasks.ceph.osd.0.trial176.stderr:2026-02-17T12:29:52.291+0000 7f66d74fe640 -1 osd.0 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:29:56.532 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-17T12:29:56.603 INFO:teuthology.orchestra.run.trial176.stdout:{ 2026-02-17T12:29:56.603 INFO:teuthology.orchestra.run.trial176.stdout: "ops": [], 2026-02-17T12:29:56.604 INFO:teuthology.orchestra.run.trial176.stdout: "num_ops": 0 2026-02-17T12:29:56.604 INFO:teuthology.orchestra.run.trial176.stdout:} 2026-02-17T12:29:56.608 INFO:tasks.rebuild_mondb:reviving osd.1 2026-02-17T12:29:56.608 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T12:29:56.609 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-17T12:29:56.611 INFO:tasks.ceph.osd.1:Started 2026-02-17T12:29:56.611 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2026-02-17T12:29:56.677 INFO:teuthology.orchestra.run.trial176.stderr:no valid command found; 10 closest matches: 2026-02-17T12:29:56.677 INFO:teuthology.orchestra.run.trial176.stderr:0 2026-02-17T12:29:56.677 INFO:teuthology.orchestra.run.trial176.stderr:1 2026-02-17T12:29:56.678 INFO:teuthology.orchestra.run.trial176.stderr:2 2026-02-17T12:29:56.678 INFO:teuthology.orchestra.run.trial176.stderr:abort 2026-02-17T12:29:56.678 INFO:teuthology.orchestra.run.trial176.stderr:assert 2026-02-17T12:29:56.678 INFO:teuthology.orchestra.run.trial176.stderr:config diff 2026-02-17T12:29:56.678 INFO:teuthology.orchestra.run.trial176.stderr:config diff get 2026-02-17T12:29:56.678 INFO:teuthology.orchestra.run.trial176.stderr:config get 2026-02-17T12:29:56.678 INFO:teuthology.orchestra.run.trial176.stderr:config help [] 2026-02-17T12:29:56.678 INFO:teuthology.orchestra.run.trial176.stderr:config set ... 2026-02-17T12:29:56.678 INFO:teuthology.orchestra.run.trial176.stderr:admin_socket: invalid command 2026-02-17T12:29:56.679 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T12:29:56.680 INFO:tasks.rebuild_mondb.ceph_manager:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2026-02-17T12:29:57.761 INFO:tasks.ceph.osd.1.trial176.stderr:2026-02-17T12:29:57.760+0000 7f6365e18780 -1 Falling back to public interface 2026-02-17T12:30:01.246 INFO:tasks.ceph.osd.1.trial176.stderr:2026-02-17T12:30:01.245+0000 7f6365e18780 -1 osd.1 18 log_to_monitors true 2026-02-17T12:30:01.312 INFO:tasks.ceph.osd.1.trial176.stderr:2026-02-17T12:30:01.311+0000 7f635d57b640 -1 osd.1 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:30:01.680 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2026-02-17T12:30:01.757 INFO:teuthology.orchestra.run.trial176.stdout:{ 2026-02-17T12:30:01.758 INFO:teuthology.orchestra.run.trial176.stdout: "ops": [], 2026-02-17T12:30:01.758 INFO:teuthology.orchestra.run.trial176.stdout: "num_ops": 0 2026-02-17T12:30:01.758 INFO:teuthology.orchestra.run.trial176.stdout:} 2026-02-17T12:30:01.764 INFO:tasks.rebuild_mondb:reviving osd.2 2026-02-17T12:30:01.764 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T12:30:01.764 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-17T12:30:01.766 INFO:tasks.ceph.osd.2:Started 2026-02-17T12:30:01.766 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-17T12:30:01.833 INFO:teuthology.orchestra.run.trial176.stderr:no valid command found; 10 closest matches: 2026-02-17T12:30:01.834 INFO:teuthology.orchestra.run.trial176.stderr:0 2026-02-17T12:30:01.834 INFO:teuthology.orchestra.run.trial176.stderr:1 2026-02-17T12:30:01.834 INFO:teuthology.orchestra.run.trial176.stderr:2 2026-02-17T12:30:01.834 INFO:teuthology.orchestra.run.trial176.stderr:abort 2026-02-17T12:30:01.834 INFO:teuthology.orchestra.run.trial176.stderr:assert 2026-02-17T12:30:01.834 INFO:teuthology.orchestra.run.trial176.stderr:config diff 2026-02-17T12:30:01.834 INFO:teuthology.orchestra.run.trial176.stderr:config diff get 2026-02-17T12:30:01.834 INFO:teuthology.orchestra.run.trial176.stderr:config get 2026-02-17T12:30:01.834 INFO:teuthology.orchestra.run.trial176.stderr:config help [] 2026-02-17T12:30:01.834 INFO:teuthology.orchestra.run.trial176.stderr:config set ... 2026-02-17T12:30:01.834 INFO:teuthology.orchestra.run.trial176.stderr:admin_socket: invalid command 2026-02-17T12:30:01.836 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T12:30:01.836 INFO:tasks.rebuild_mondb.ceph_manager:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-17T12:30:03.413 INFO:tasks.ceph.osd.2.trial176.stderr:2026-02-17T12:30:03.412+0000 7efdd51d4780 -1 Falling back to public interface 2026-02-17T12:30:06.837 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-17T12:30:06.907 INFO:teuthology.orchestra.run.trial176.stderr:no valid command found; 10 closest matches: 2026-02-17T12:30:06.907 INFO:teuthology.orchestra.run.trial176.stderr:0 2026-02-17T12:30:06.907 INFO:teuthology.orchestra.run.trial176.stderr:1 2026-02-17T12:30:06.907 INFO:teuthology.orchestra.run.trial176.stderr:2 2026-02-17T12:30:06.907 INFO:teuthology.orchestra.run.trial176.stderr:abort 2026-02-17T12:30:06.907 INFO:teuthology.orchestra.run.trial176.stderr:assert 2026-02-17T12:30:06.907 INFO:teuthology.orchestra.run.trial176.stderr:bluestore allocator dump block 2026-02-17T12:30:06.907 INFO:teuthology.orchestra.run.trial176.stderr:bluestore allocator fragmentation block 2026-02-17T12:30:06.907 INFO:teuthology.orchestra.run.trial176.stderr:bluestore allocator fragmentation histogram block [] [] 2026-02-17T12:30:06.907 INFO:teuthology.orchestra.run.trial176.stderr:bluestore allocator score block 2026-02-17T12:30:06.907 INFO:teuthology.orchestra.run.trial176.stderr:config diff 2026-02-17T12:30:06.907 INFO:teuthology.orchestra.run.trial176.stderr:admin_socket: invalid command 2026-02-17T12:30:06.909 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-17T12:30:06.909 INFO:tasks.rebuild_mondb.ceph_manager:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-17T12:30:06.944 INFO:tasks.ceph.osd.2.trial176.stderr:2026-02-17T12:30:06.944+0000 7efdd51d4780 -1 osd.2 18 log_to_monitors true 2026-02-17T12:30:07.332 INFO:tasks.ceph.osd.2.trial176.stderr:2026-02-17T12:30:07.331+0000 7efdccf8b640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:30:11.910 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-17T12:30:11.983 INFO:teuthology.orchestra.run.trial176.stdout:{ 2026-02-17T12:30:11.983 INFO:teuthology.orchestra.run.trial176.stdout: "ops": [], 2026-02-17T12:30:11.983 INFO:teuthology.orchestra.run.trial176.stdout: "num_ops": 0 2026-02-17T12:30:11.983 INFO:teuthology.orchestra.run.trial176.stdout:} 2026-02-17T12:30:11.988 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-17T12:30:11.988 INFO:tasks.radosbench:Beginning radosbench... 2026-02-17T12:30:11.989 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2026-02-17T12:30:11.989 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 16 2026-02-17T12:30:12.325 INFO:teuthology.orchestra.run.trial176.stderr:pool 'unique_pool_1' created 2026-02-17T12:30:12.336 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2026-02-17T12:30:13.329 INFO:teuthology.orchestra.run.trial176.stderr:enabled application 'rados' on pool 'unique_pool_1' 2026-02-17T12:30:14.342 DEBUG:teuthology.orchestra.run.trial176:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_1 bench 30 write' 2026-02-17T12:30:14.345 INFO:tasks.radosbench:joining radosbench (timing out after 1200s) 2026-02-17T12:30:14.345 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T12:30:14.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout:hints = 1 2026-02-17T12:30:14.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 30 seconds or 0 objects 2026-02-17T12:30:14.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Object prefix: benchmark_data_trial176_53673 2026-02-17T12:30:14.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T12:30:14.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 0 0 0 0 0 0 - 0 2026-02-17T12:30:15.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 1 16 7580 7564 472.716 472.75 0.00134103 0.00211184 2026-02-17T12:30:16.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 2 15 16757 16742 523.148 573.625 0.00307277 0.00190927 2026-02-17T12:30:17.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 3 16 21713 21697 451.987 309.688 0.000952979 0.00188904 2026-02-17T12:30:18.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 4 16 28587 28571 446.389 429.625 0.00216119 0.00223822 2026-02-17T12:30:19.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 5 16 36182 36166 452.042 474.688 0.00189661 0.00221035 2026-02-17T12:30:20.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 6 16 43262 43246 450.446 442.5 0.00188563 0.00221805 2026-02-17T12:30:21.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 7 16 48415 48399 432.102 322.062 0.00169458 0.00231223 2026-02-17T12:30:22.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 8 16 54516 54500 425.75 381.312 0.00229397 0.00234696 2026-02-17T12:30:23.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 9 16 59229 59213 411.172 294.562 0.00248823 0.0024302 2026-02-17T12:30:24.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 10 16 64585 64569 403.528 334.75 0.00177727 0.0024763 2026-02-17T12:30:25.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 11 16 69771 69755 396.307 324.125 0.00234658 0.00252154 2026-02-17T12:30:26.383 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 12 16 74384 74368 387.306 288.312 0.0052097 0.00258014 2026-02-17T12:30:27.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 13 16 78768 78752 378.588 274 0.00544335 0.00263605 2026-02-17T12:30:28.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 14 16 82159 82143 366.684 211.938 0.00263703 0.00272547 2026-02-17T12:30:29.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 15 16 86329 86313 359.612 260.625 0.00534971 0.00277904 2026-02-17T12:30:30.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 16 16 90382 90366 352.967 253.312 0.00222041 0.00283124 2026-02-17T12:30:31.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 17 16 94272 94256 346.504 243.125 0.0057178 0.00288402 2026-02-17T12:30:32.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 18 16 97913 97897 339.895 227.562 0.00217857 0.00294024 2026-02-17T12:30:33.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 19 16 101500 101484 333.805 224.188 0.00411773 0.00299384 2026-02-17T12:30:34.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout:2026-02-17T12:30:34.384805+0000 min lat: 0.000573195 max lat: 0.604991 avg lat: 0.003047 2026-02-17T12:30:34.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T12:30:34.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 20 16 104974 104958 327.97 217.125 0.00411481 0.003047 2026-02-17T12:30:35.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 21 16 107647 107631 320.307 167.062 0.0043989 0.00312026 2026-02-17T12:30:36.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 22 16 110951 110935 315.133 206.5 0.00233911 0.00317132 2026-02-17T12:30:37.384 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 23 16 114108 114092 310.011 197.312 0.00476084 0.0032239 2026-02-17T12:30:38.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 24 16 116837 116821 304.2 170.562 0.00238935 0.00326907 2026-02-17T12:30:39.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 25 16 119565 119549 298.851 170.5 0.00475111 0.00334429 2026-02-17T12:30:40.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 26 16 122522 122506 294.465 184.812 0.00307755 0.00339425 2026-02-17T12:30:41.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 27 15 125396 125381 290.213 179.688 0.00489322 0.00344408 2026-02-17T12:30:42.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 28 16 128175 128159 286.049 173.625 0.0037246 0.00349421 2026-02-17T12:30:43.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 29 16 130928 130912 282.118 172.062 0.00581635 0.0035429 2026-02-17T12:30:44.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout: 30 5 133043 133038 277.143 132.875 0.00427251 0.00360654 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Total time run: 30.0058 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Total writes made: 133043 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Write size: 65536 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Object size: 65536 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Bandwidth (MB/sec): 277.119 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Stddev Bandwidth: 111.044 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Max bandwidth (MB/sec): 573.625 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Min bandwidth (MB/sec): 132.875 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Average IOPS: 4433 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Stddev IOPS: 1776.71 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Max IOPS: 9178 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Min IOPS: 2126 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Average Latency(s): 0.00360674 2026-02-17T12:30:45.385 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Stddev Latency(s): 0.00901526 2026-02-17T12:30:45.386 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Max latency(s): 0.604991 2026-02-17T12:30:45.386 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Min latency(s): 0.000573195 2026-02-17T12:30:45.391 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Cleaning up (deleting benchmark objects) 2026-02-17T12:31:42.613 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Removed 133043 objects 2026-02-17T12:31:42.613 INFO:tasks.radosbench.radosbench.0.trial176.stdout:Clean up completed and total clean up time :57.2223 2026-02-17T12:31:45.864 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2026-02-17T12:31:45.865 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2026-02-17T12:31:46.412 INFO:teuthology.orchestra.run.trial176.stderr:pool 'unique_pool_1' removed 2026-02-17T12:31:46.428 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T12:31:46.442 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T12:31:46.442 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:31:46.608 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:31:46.609 INFO:teuthology.orchestra.run.trial176.stderr:dumped all 2026-02-17T12:31:46.617 INFO:teuthology.orchestra.run.trial176.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2026-02-17T12:31:46.411659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":646800,"kb_used_data":928,"kb_used_omap":13,"kb_used_meta":645810,"kb_avail":282468720,"statfs":{"total":289910292480,"available":289247969280,"internally_reserved":0,"allocated":950272,"data_stored":1234856,"data_compressed":6741,"data_compressed_allocated":57344,"data_compressed_original":905216,"omap_allocated":13319,"internal_metadata":661310457},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4,2,10],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1275068440,"num_objects":-19457,"num_object_clones":0,"num_object_copies":-38914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19457,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-246631,"num_write_kb":-8514753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.136987"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329357+0000","last_change":"2026-02-17T12:30:03.307882+0000","last_active":"2026-02-17T12:30:14.329357+0000","last_peered":"2026-02-17T12:30:14.329357+0000","last_clean":"2026-02-17T12:30:14.329357+0000","last_became_active":"2026-02-17T12:30:03.307684+0000","last_became_peered":"2026-02-17T12:30:03.307684+0000","last_unstale":"2026-02-17T12:30:14.329357+0000","last_undegraded":"2026-02-17T12:30:14.329357+0000","last_fullsized":"2026-02-17T12:30:14.329357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:05:26.670861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.328464+0000","last_change":"2026-02-17T12:30:09.319925+0000","last_active":"2026-02-17T12:30:14.328464+0000","last_peered":"2026-02-17T12:30:14.328464+0000","last_clean":"2026-02-17T12:30:14.328464+0000","last_became_active":"2026-02-17T12:30:09.319691+0000","last_became_peered":"2026-02-17T12:30:09.319691+0000","last_unstale":"2026-02-17T12:30:14.328464+0000","last_undegraded":"2026-02-17T12:30:14.328464+0000","last_fullsized":"2026-02-17T12:30:14.328464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:00:42.166469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329414+0000","last_change":"2026-02-17T12:30:03.307350+0000","last_active":"2026-02-17T12:30:14.329414+0000","last_peered":"2026-02-17T12:30:14.329414+0000","last_clean":"2026-02-17T12:30:14.329414+0000","last_became_active":"2026-02-17T12:30:03.307174+0000","last_became_peered":"2026-02-17T12:30:03.307174+0000","last_unstale":"2026-02-17T12:30:14.329414+0000","last_undegraded":"2026-02-17T12:30:14.329414+0000","last_fullsized":"2026-02-17T12:30:14.329414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:13:36.432682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024717000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"27'52","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329236+0000","last_change":"2026-02-17T12:30:09.323621+0000","last_active":"2026-02-17T12:30:14.329236+0000","last_peered":"2026-02-17T12:30:14.329236+0000","last_clean":"2026-02-17T12:30:14.329236+0000","last_became_active":"2026-02-17T12:30:09.320319+0000","last_became_peered":"2026-02-17T12:30:09.320319+0000","last_unstale":"2026-02-17T12:30:14.329236+0000","last_undegraded":"2026-02-17T12:30:14.329236+0000","last_fullsized":"2026-02-17T12:30:14.329236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:29:52.272115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:29:52.272115+0000","last_clean_scrub_stamp":"2026-02-17T12:29:52.272115+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:19:55.214940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329303+0000","last_change":"2026-02-17T12:30:09.319853+0000","last_active":"2026-02-17T12:30:14.329303+0000","last_peered":"2026-02-17T12:30:14.329303+0000","last_clean":"2026-02-17T12:30:14.329303+0000","last_became_active":"2026-02-17T12:30:09.319691+0000","last_became_peered":"2026-02-17T12:30:09.319691+0000","last_unstale":"2026-02-17T12:30:14.329303+0000","last_undegraded":"2026-02-17T12:30:14.329303+0000","last_fullsized":"2026-02-17T12:30:14.329303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:56:52.652393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371481,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329497+0000","last_change":"2026-02-17T12:30:03.307859+0000","last_active":"2026-02-17T12:30:14.329497+0000","last_peered":"2026-02-17T12:30:14.329497+0000","last_clean":"2026-02-17T12:30:14.329497+0000","last_became_active":"2026-02-17T12:30:03.307642+0000","last_became_peered":"2026-02-17T12:30:03.307642+0000","last_unstale":"2026-02-17T12:30:14.329497+0000","last_undegraded":"2026-02-17T12:30:14.329497+0000","last_fullsized":"2026-02-17T12:30:14.329497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:18:50.326894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.328573+0000","last_change":"2026-02-17T12:30:09.319651+0000","last_active":"2026-02-17T12:30:14.328573+0000","last_peered":"2026-02-17T12:30:14.328573+0000","last_clean":"2026-02-17T12:30:14.328573+0000","last_became_active":"2026-02-17T12:30:09.319432+0000","last_became_peered":"2026-02-17T12:30:09.319432+0000","last_unstale":"2026-02-17T12:30:14.328573+0000","last_undegraded":"2026-02-17T12:30:14.328573+0000","last_fullsized":"2026-02-17T12:30:14.328573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:16:00.974434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329592+0000","last_change":"2026-02-17T12:30:03.307505+0000","last_active":"2026-02-17T12:30:14.329592+0000","last_peered":"2026-02-17T12:30:14.329592+0000","last_clean":"2026-02-17T12:30:14.329592+0000","last_became_active":"2026-02-17T12:30:03.307311+0000","last_became_peered":"2026-02-17T12:30:03.307311+0000","last_unstale":"2026-02-17T12:30:14.329592+0000","last_undegraded":"2026-02-17T12:30:14.329592+0000","last_fullsized":"2026-02-17T12:30:14.329592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:47:58.124626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329660+0000","last_change":"2026-02-17T12:30:09.319493+0000","last_active":"2026-02-17T12:30:14.329660+0000","last_peered":"2026-02-17T12:30:14.329660+0000","last_clean":"2026-02-17T12:30:14.329660+0000","last_became_active":"2026-02-17T12:30:09.319328+0000","last_became_peered":"2026-02-17T12:30:09.319328+0000","last_unstale":"2026-02-17T12:30:14.329660+0000","last_undegraded":"2026-02-17T12:30:14.329660+0000","last_fullsized":"2026-02-17T12:30:14.329660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:17:53.529004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053492399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":933912,"data_compressed":6741,"data_compressed_allocated":57344,"data_compressed_original":905216,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":29,"seq":124554051605,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181584,"kb_used_data":320,"kb_used_omap":4,"kb_used_meta":181243,"kb_avail":94190256,"statfs":{"total":96636764160,"available":96450822144,"internally_reserved":0,"allocated":327680,"data_stored":567258,"data_compressed":3414,"data_compressed_allocated":28672,"data_compressed_original":454656,"omap_allocated":4438,"internal_metadata":185593514},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,2,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":25,"seq":107374182423,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280536,"kb_used_data":328,"kb_used_omap":4,"kb_used_meta":280187,"kb_avail":94091304,"statfs":{"total":96636764160,"available":96349495296,"internally_reserved":0,"allocated":335872,"data_stored":567277,"data_compressed":3327,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":4440,"internal_metadata":286912168},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,0,7],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313241,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":184680,"kb_used_data":280,"kb_used_omap":4,"kb_used_meta":184379,"kb_avail":94187160,"statfs":{"total":96636764160,"available":96447651840,"internally_reserved":0,"allocated":286720,"data_stored":100321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4441,"internal_metadata":188804775},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":466956,"data_compressed":3327,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":466956,"data_compressed":3414,"data_compressed_allocated":28672,"data_compressed_original":454656,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:31:46.619 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:31:46.781 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:31:46.782 INFO:teuthology.orchestra.run.trial176.stderr:dumped all 2026-02-17T12:31:46.790 INFO:teuthology.orchestra.run.trial176.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2026-02-17T12:31:46.411659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":646800,"kb_used_data":928,"kb_used_omap":13,"kb_used_meta":645810,"kb_avail":282468720,"statfs":{"total":289910292480,"available":289247969280,"internally_reserved":0,"allocated":950272,"data_stored":1234856,"data_compressed":6741,"data_compressed_allocated":57344,"data_compressed_original":905216,"omap_allocated":13319,"internal_metadata":661310457},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4,2,10],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1275068440,"num_objects":-19457,"num_object_clones":0,"num_object_copies":-38914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19457,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-246631,"num_write_kb":-8514753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.136987"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329357+0000","last_change":"2026-02-17T12:30:03.307882+0000","last_active":"2026-02-17T12:30:14.329357+0000","last_peered":"2026-02-17T12:30:14.329357+0000","last_clean":"2026-02-17T12:30:14.329357+0000","last_became_active":"2026-02-17T12:30:03.307684+0000","last_became_peered":"2026-02-17T12:30:03.307684+0000","last_unstale":"2026-02-17T12:30:14.329357+0000","last_undegraded":"2026-02-17T12:30:14.329357+0000","last_fullsized":"2026-02-17T12:30:14.329357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:05:26.670861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.328464+0000","last_change":"2026-02-17T12:30:09.319925+0000","last_active":"2026-02-17T12:30:14.328464+0000","last_peered":"2026-02-17T12:30:14.328464+0000","last_clean":"2026-02-17T12:30:14.328464+0000","last_became_active":"2026-02-17T12:30:09.319691+0000","last_became_peered":"2026-02-17T12:30:09.319691+0000","last_unstale":"2026-02-17T12:30:14.328464+0000","last_undegraded":"2026-02-17T12:30:14.328464+0000","last_fullsized":"2026-02-17T12:30:14.328464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:00:42.166469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329414+0000","last_change":"2026-02-17T12:30:03.307350+0000","last_active":"2026-02-17T12:30:14.329414+0000","last_peered":"2026-02-17T12:30:14.329414+0000","last_clean":"2026-02-17T12:30:14.329414+0000","last_became_active":"2026-02-17T12:30:03.307174+0000","last_became_peered":"2026-02-17T12:30:03.307174+0000","last_unstale":"2026-02-17T12:30:14.329414+0000","last_undegraded":"2026-02-17T12:30:14.329414+0000","last_fullsized":"2026-02-17T12:30:14.329414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:13:36.432682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024717000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"27'52","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329236+0000","last_change":"2026-02-17T12:30:09.323621+0000","last_active":"2026-02-17T12:30:14.329236+0000","last_peered":"2026-02-17T12:30:14.329236+0000","last_clean":"2026-02-17T12:30:14.329236+0000","last_became_active":"2026-02-17T12:30:09.320319+0000","last_became_peered":"2026-02-17T12:30:09.320319+0000","last_unstale":"2026-02-17T12:30:14.329236+0000","last_undegraded":"2026-02-17T12:30:14.329236+0000","last_fullsized":"2026-02-17T12:30:14.329236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:29:52.272115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:29:52.272115+0000","last_clean_scrub_stamp":"2026-02-17T12:29:52.272115+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:19:55.214940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329303+0000","last_change":"2026-02-17T12:30:09.319853+0000","last_active":"2026-02-17T12:30:14.329303+0000","last_peered":"2026-02-17T12:30:14.329303+0000","last_clean":"2026-02-17T12:30:14.329303+0000","last_became_active":"2026-02-17T12:30:09.319691+0000","last_became_peered":"2026-02-17T12:30:09.319691+0000","last_unstale":"2026-02-17T12:30:14.329303+0000","last_undegraded":"2026-02-17T12:30:14.329303+0000","last_fullsized":"2026-02-17T12:30:14.329303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:56:52.652393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371481,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329497+0000","last_change":"2026-02-17T12:30:03.307859+0000","last_active":"2026-02-17T12:30:14.329497+0000","last_peered":"2026-02-17T12:30:14.329497+0000","last_clean":"2026-02-17T12:30:14.329497+0000","last_became_active":"2026-02-17T12:30:03.307642+0000","last_became_peered":"2026-02-17T12:30:03.307642+0000","last_unstale":"2026-02-17T12:30:14.329497+0000","last_undegraded":"2026-02-17T12:30:14.329497+0000","last_fullsized":"2026-02-17T12:30:14.329497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:18:50.326894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.328573+0000","last_change":"2026-02-17T12:30:09.319651+0000","last_active":"2026-02-17T12:30:14.328573+0000","last_peered":"2026-02-17T12:30:14.328573+0000","last_clean":"2026-02-17T12:30:14.328573+0000","last_became_active":"2026-02-17T12:30:09.319432+0000","last_became_peered":"2026-02-17T12:30:09.319432+0000","last_unstale":"2026-02-17T12:30:14.328573+0000","last_undegraded":"2026-02-17T12:30:14.328573+0000","last_fullsized":"2026-02-17T12:30:14.328573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:16:00.974434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329592+0000","last_change":"2026-02-17T12:30:03.307505+0000","last_active":"2026-02-17T12:30:14.329592+0000","last_peered":"2026-02-17T12:30:14.329592+0000","last_clean":"2026-02-17T12:30:14.329592+0000","last_became_active":"2026-02-17T12:30:03.307311+0000","last_became_peered":"2026-02-17T12:30:03.307311+0000","last_unstale":"2026-02-17T12:30:14.329592+0000","last_undegraded":"2026-02-17T12:30:14.329592+0000","last_fullsized":"2026-02-17T12:30:14.329592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:47:58.124626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329660+0000","last_change":"2026-02-17T12:30:09.319493+0000","last_active":"2026-02-17T12:30:14.329660+0000","last_peered":"2026-02-17T12:30:14.329660+0000","last_clean":"2026-02-17T12:30:14.329660+0000","last_became_active":"2026-02-17T12:30:09.319328+0000","last_became_peered":"2026-02-17T12:30:09.319328+0000","last_unstale":"2026-02-17T12:30:14.329660+0000","last_undegraded":"2026-02-17T12:30:14.329660+0000","last_fullsized":"2026-02-17T12:30:14.329660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:17:53.529004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053492399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":933912,"data_compressed":6741,"data_compressed_allocated":57344,"data_compressed_original":905216,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":29,"seq":124554051605,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181584,"kb_used_data":320,"kb_used_omap":4,"kb_used_meta":181243,"kb_avail":94190256,"statfs":{"total":96636764160,"available":96450822144,"internally_reserved":0,"allocated":327680,"data_stored":567258,"data_compressed":3414,"data_compressed_allocated":28672,"data_compressed_original":454656,"omap_allocated":4438,"internal_metadata":185593514},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,2,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":25,"seq":107374182423,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280536,"kb_used_data":328,"kb_used_omap":4,"kb_used_meta":280187,"kb_avail":94091304,"statfs":{"total":96636764160,"available":96349495296,"internally_reserved":0,"allocated":335872,"data_stored":567277,"data_compressed":3327,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":4440,"internal_metadata":286912168},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,0,7],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313241,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":184680,"kb_used_data":280,"kb_used_omap":4,"kb_used_meta":184379,"kb_avail":94187160,"statfs":{"total":96636764160,"available":96447651840,"internally_reserved":0,"allocated":286720,"data_stored":100321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4441,"internal_metadata":188804775},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":466956,"data_compressed":3327,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":466956,"data_compressed":3414,"data_compressed_allocated":28672,"data_compressed_original":454656,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:31:46.792 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T12:31:46.792 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:31:46.948 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:31:46.949 INFO:teuthology.orchestra.run.trial176.stderr:dumped all 2026-02-17T12:31:46.956 INFO:teuthology.orchestra.run.trial176.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2026-02-17T12:31:46.411659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":646800,"kb_used_data":928,"kb_used_omap":13,"kb_used_meta":645810,"kb_avail":282468720,"statfs":{"total":289910292480,"available":289247969280,"internally_reserved":0,"allocated":950272,"data_stored":1234856,"data_compressed":6741,"data_compressed_allocated":57344,"data_compressed_original":905216,"omap_allocated":13319,"internal_metadata":661310457},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4,2,10],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1275068440,"num_objects":-19457,"num_object_clones":0,"num_object_copies":-38914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19457,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-246631,"num_write_kb":-8514753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.136987"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329357+0000","last_change":"2026-02-17T12:30:03.307882+0000","last_active":"2026-02-17T12:30:14.329357+0000","last_peered":"2026-02-17T12:30:14.329357+0000","last_clean":"2026-02-17T12:30:14.329357+0000","last_became_active":"2026-02-17T12:30:03.307684+0000","last_became_peered":"2026-02-17T12:30:03.307684+0000","last_unstale":"2026-02-17T12:30:14.329357+0000","last_undegraded":"2026-02-17T12:30:14.329357+0000","last_fullsized":"2026-02-17T12:30:14.329357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:05:26.670861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.328464+0000","last_change":"2026-02-17T12:30:09.319925+0000","last_active":"2026-02-17T12:30:14.328464+0000","last_peered":"2026-02-17T12:30:14.328464+0000","last_clean":"2026-02-17T12:30:14.328464+0000","last_became_active":"2026-02-17T12:30:09.319691+0000","last_became_peered":"2026-02-17T12:30:09.319691+0000","last_unstale":"2026-02-17T12:30:14.328464+0000","last_undegraded":"2026-02-17T12:30:14.328464+0000","last_fullsized":"2026-02-17T12:30:14.328464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:00:42.166469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329414+0000","last_change":"2026-02-17T12:30:03.307350+0000","last_active":"2026-02-17T12:30:14.329414+0000","last_peered":"2026-02-17T12:30:14.329414+0000","last_clean":"2026-02-17T12:30:14.329414+0000","last_became_active":"2026-02-17T12:30:03.307174+0000","last_became_peered":"2026-02-17T12:30:03.307174+0000","last_unstale":"2026-02-17T12:30:14.329414+0000","last_undegraded":"2026-02-17T12:30:14.329414+0000","last_fullsized":"2026-02-17T12:30:14.329414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:13:36.432682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024717000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"27'52","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329236+0000","last_change":"2026-02-17T12:30:09.323621+0000","last_active":"2026-02-17T12:30:14.329236+0000","last_peered":"2026-02-17T12:30:14.329236+0000","last_clean":"2026-02-17T12:30:14.329236+0000","last_became_active":"2026-02-17T12:30:09.320319+0000","last_became_peered":"2026-02-17T12:30:09.320319+0000","last_unstale":"2026-02-17T12:30:14.329236+0000","last_undegraded":"2026-02-17T12:30:14.329236+0000","last_fullsized":"2026-02-17T12:30:14.329236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:29:52.272115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:29:52.272115+0000","last_clean_scrub_stamp":"2026-02-17T12:29:52.272115+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:19:55.214940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329303+0000","last_change":"2026-02-17T12:30:09.319853+0000","last_active":"2026-02-17T12:30:14.329303+0000","last_peered":"2026-02-17T12:30:14.329303+0000","last_clean":"2026-02-17T12:30:14.329303+0000","last_became_active":"2026-02-17T12:30:09.319691+0000","last_became_peered":"2026-02-17T12:30:09.319691+0000","last_unstale":"2026-02-17T12:30:14.329303+0000","last_undegraded":"2026-02-17T12:30:14.329303+0000","last_fullsized":"2026-02-17T12:30:14.329303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:56:52.652393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371481,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329497+0000","last_change":"2026-02-17T12:30:03.307859+0000","last_active":"2026-02-17T12:30:14.329497+0000","last_peered":"2026-02-17T12:30:14.329497+0000","last_clean":"2026-02-17T12:30:14.329497+0000","last_became_active":"2026-02-17T12:30:03.307642+0000","last_became_peered":"2026-02-17T12:30:03.307642+0000","last_unstale":"2026-02-17T12:30:14.329497+0000","last_undegraded":"2026-02-17T12:30:14.329497+0000","last_fullsized":"2026-02-17T12:30:14.329497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:18:50.326894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.328573+0000","last_change":"2026-02-17T12:30:09.319651+0000","last_active":"2026-02-17T12:30:14.328573+0000","last_peered":"2026-02-17T12:30:14.328573+0000","last_clean":"2026-02-17T12:30:14.328573+0000","last_became_active":"2026-02-17T12:30:09.319432+0000","last_became_peered":"2026-02-17T12:30:09.319432+0000","last_unstale":"2026-02-17T12:30:14.328573+0000","last_undegraded":"2026-02-17T12:30:14.328573+0000","last_fullsized":"2026-02-17T12:30:14.328573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:16:00.974434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329592+0000","last_change":"2026-02-17T12:30:03.307505+0000","last_active":"2026-02-17T12:30:14.329592+0000","last_peered":"2026-02-17T12:30:14.329592+0000","last_clean":"2026-02-17T12:30:14.329592+0000","last_became_active":"2026-02-17T12:30:03.307311+0000","last_became_peered":"2026-02-17T12:30:03.307311+0000","last_unstale":"2026-02-17T12:30:14.329592+0000","last_undegraded":"2026-02-17T12:30:14.329592+0000","last_fullsized":"2026-02-17T12:30:14.329592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:47:58.124626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329660+0000","last_change":"2026-02-17T12:30:09.319493+0000","last_active":"2026-02-17T12:30:14.329660+0000","last_peered":"2026-02-17T12:30:14.329660+0000","last_clean":"2026-02-17T12:30:14.329660+0000","last_became_active":"2026-02-17T12:30:09.319328+0000","last_became_peered":"2026-02-17T12:30:09.319328+0000","last_unstale":"2026-02-17T12:30:14.329660+0000","last_undegraded":"2026-02-17T12:30:14.329660+0000","last_fullsized":"2026-02-17T12:30:14.329660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:17:53.529004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053492399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":933912,"data_compressed":6741,"data_compressed_allocated":57344,"data_compressed_original":905216,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":29,"seq":124554051605,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181584,"kb_used_data":320,"kb_used_omap":4,"kb_used_meta":181243,"kb_avail":94190256,"statfs":{"total":96636764160,"available":96450822144,"internally_reserved":0,"allocated":327680,"data_stored":567258,"data_compressed":3414,"data_compressed_allocated":28672,"data_compressed_original":454656,"omap_allocated":4438,"internal_metadata":185593514},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,2,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":25,"seq":107374182423,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280536,"kb_used_data":328,"kb_used_omap":4,"kb_used_meta":280187,"kb_avail":94091304,"statfs":{"total":96636764160,"available":96349495296,"internally_reserved":0,"allocated":335872,"data_stored":567277,"data_compressed":3327,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":4440,"internal_metadata":286912168},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,0,7],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313241,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":184680,"kb_used_data":280,"kb_used_omap":4,"kb_used_meta":184379,"kb_avail":94187160,"statfs":{"total":96636764160,"available":96447651840,"internally_reserved":0,"allocated":286720,"data_stored":100321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4441,"internal_metadata":188804775},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":466956,"data_compressed":3327,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":466956,"data_compressed":3414,"data_compressed_allocated":28672,"data_compressed_original":454656,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:31:46.957 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T12:31:47.116 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:31:47.116 INFO:teuthology.orchestra.run.trial176.stdout:{"epoch":34,"fsid":"e548cc2f-381c-4b27-aafa-8f43f7965f54","created":"2026-02-17T12:27:16.823790+0000","modified":"2026-02-17T12:31:46.407553+0000","last_up_change":"2026-02-17T12:30:08.316205+0000","last_in_change":"2026-02-17T12:27:18.317784+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-17T12:27:31.962642+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":".mgr","create_time":"2026-02-17T12:29:51.277660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e5293a7e-2eff-48e4-bdb8-f0f5af0e5dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":18,"up_from":21,"up_thru":31,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6800","nonce":3786434826},{"type":"v1","addr":"10.20.193.176:6801","nonce":3786434826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6802","nonce":3786434826},{"type":"v1","addr":"10.20.193.176:6803","nonce":3786434826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6806","nonce":3786434826},{"type":"v1","addr":"10.20.193.176:6807","nonce":3786434826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6804","nonce":3786434826},{"type":"v1","addr":"10.20.193.176:6805","nonce":3786434826}]},"public_addr":"10.20.193.176:6801/3786434826","cluster_addr":"10.20.193.176:6803/3786434826","heartbeat_back_addr":"10.20.193.176:6807/3786434826","heartbeat_front_addr":"10.20.193.176:6805/3786434826","state":["exists","up"]},{"osd":1,"uuid":"8b915722-f2d9-47b1-bae5-d892719b3619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":25,"up_thru":31,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6810","nonce":2864768832},{"type":"v1","addr":"10.20.193.176:6811","nonce":2864768832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6812","nonce":2864768832},{"type":"v1","addr":"10.20.193.176:6813","nonce":2864768832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6816","nonce":2864768832},{"type":"v1","addr":"10.20.193.176:6817","nonce":2864768832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6814","nonce":2864768832},{"type":"v1","addr":"10.20.193.176:6815","nonce":2864768832}]},"public_addr":"10.20.193.176:6811/2864768832","cluster_addr":"10.20.193.176:6813/2864768832","heartbeat_back_addr":"10.20.193.176:6817/2864768832","heartbeat_front_addr":"10.20.193.176:6815/2864768832","state":["exists","up"]},{"osd":2,"uuid":"123abf21-71ed-4a75-a738-57b857e32044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":18,"up_from":29,"up_thru":31,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6818","nonce":2631520484},{"type":"v1","addr":"10.20.193.176:6819","nonce":2631520484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6820","nonce":2631520484},{"type":"v1","addr":"10.20.193.176:6821","nonce":2631520484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6824","nonce":2631520484},{"type":"v1","addr":"10.20.193.176:6825","nonce":2631520484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.176:6822","nonce":2631520484},{"type":"v1","addr":"10.20.193.176:6823","nonce":2631520484}]},"public_addr":"10.20.193.176:6819/2631520484","cluster_addr":"10.20.193.176:6821/2631520484","heartbeat_back_addr":"10.20.193.176:6825/2631520484","heartbeat_front_addr":"10.20.193.176:6823/2631520484","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2026-02-17T12:29:53.275746+0000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:24.569394+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:25.557742+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:27:24.808240+0000","dead_epoch":22}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:31:48.125 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T12:31:48.125 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:31:48.207 INFO:teuthology.orchestra.run.trial176.stdout:{ 2026-02-17T12:31:48.207 INFO:teuthology.orchestra.run.trial176.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:31:48.207 INFO:teuthology.orchestra.run.trial176.stdout:} 2026-02-17T12:31:48.212 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T12:31:48.376 INFO:teuthology.orchestra.run.trial176.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T12:31:48.385 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T12:31:48.385 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:31:48.466 INFO:teuthology.orchestra.run.trial176.stdout:{ 2026-02-17T12:31:48.466 INFO:teuthology.orchestra.run.trial176.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:31:48.466 INFO:teuthology.orchestra.run.trial176.stdout:} 2026-02-17T12:31:48.471 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T12:31:48.628 INFO:teuthology.orchestra.run.trial176.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T12:31:48.637 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T12:31:48.638 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T12:31:48.718 INFO:teuthology.orchestra.run.trial176.stdout:{ 2026-02-17T12:31:48.719 INFO:teuthology.orchestra.run.trial176.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T12:31:48.719 INFO:teuthology.orchestra.run.trial176.stdout:} 2026-02-17T12:31:48.725 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T12:31:48.883 INFO:teuthology.orchestra.run.trial176.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T12:31:48.892 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:31:49.056 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:31:49.056 INFO:teuthology.orchestra.run.trial176.stderr:dumped all 2026-02-17T12:31:49.064 INFO:teuthology.orchestra.run.trial176.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2026-02-17T12:31:47.276410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":646800,"kb_used_data":928,"kb_used_omap":13,"kb_used_meta":645810,"kb_avail":282468720,"statfs":{"total":289910292480,"available":289247969280,"internally_reserved":0,"allocated":950272,"data_stored":1234856,"data_compressed":6741,"data_compressed_allocated":57344,"data_compressed_original":905216,"omap_allocated":13319,"internal_metadata":661310457},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,4,2,10],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1275068440,"num_objects":-19457,"num_object_clones":0,"num_object_copies":-38914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19457,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-246631,"num_write_kb":-8514753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001441"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329357+0000","last_change":"2026-02-17T12:30:03.307882+0000","last_active":"2026-02-17T12:30:14.329357+0000","last_peered":"2026-02-17T12:30:14.329357+0000","last_clean":"2026-02-17T12:30:14.329357+0000","last_became_active":"2026-02-17T12:30:03.307684+0000","last_became_peered":"2026-02-17T12:30:03.307684+0000","last_unstale":"2026-02-17T12:30:14.329357+0000","last_undegraded":"2026-02-17T12:30:14.329357+0000","last_fullsized":"2026-02-17T12:30:14.329357+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:05:26.670861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.328464+0000","last_change":"2026-02-17T12:30:09.319925+0000","last_active":"2026-02-17T12:30:14.328464+0000","last_peered":"2026-02-17T12:30:14.328464+0000","last_clean":"2026-02-17T12:30:14.328464+0000","last_became_active":"2026-02-17T12:30:09.319691+0000","last_became_peered":"2026-02-17T12:30:09.319691+0000","last_unstale":"2026-02-17T12:30:14.328464+0000","last_undegraded":"2026-02-17T12:30:14.328464+0000","last_fullsized":"2026-02-17T12:30:14.328464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:00:42.166469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329414+0000","last_change":"2026-02-17T12:30:03.307350+0000","last_active":"2026-02-17T12:30:14.329414+0000","last_peered":"2026-02-17T12:30:14.329414+0000","last_clean":"2026-02-17T12:30:14.329414+0000","last_became_active":"2026-02-17T12:30:03.307174+0000","last_became_peered":"2026-02-17T12:30:03.307174+0000","last_unstale":"2026-02-17T12:30:14.329414+0000","last_undegraded":"2026-02-17T12:30:14.329414+0000","last_fullsized":"2026-02-17T12:30:14.329414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:13:36.432682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024717000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"27'52","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329236+0000","last_change":"2026-02-17T12:30:09.323621+0000","last_active":"2026-02-17T12:30:14.329236+0000","last_peered":"2026-02-17T12:30:14.329236+0000","last_clean":"2026-02-17T12:30:14.329236+0000","last_became_active":"2026-02-17T12:30:09.320319+0000","last_became_peered":"2026-02-17T12:30:09.320319+0000","last_unstale":"2026-02-17T12:30:14.329236+0000","last_undegraded":"2026-02-17T12:30:14.329236+0000","last_fullsized":"2026-02-17T12:30:14.329236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:29:52.272115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:29:52.272115+0000","last_clean_scrub_stamp":"2026-02-17T12:29:52.272115+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:19:55.214940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329303+0000","last_change":"2026-02-17T12:30:09.319853+0000","last_active":"2026-02-17T12:30:14.329303+0000","last_peered":"2026-02-17T12:30:14.329303+0000","last_clean":"2026-02-17T12:30:14.329303+0000","last_became_active":"2026-02-17T12:30:09.319691+0000","last_became_peered":"2026-02-17T12:30:09.319691+0000","last_unstale":"2026-02-17T12:30:14.329303+0000","last_undegraded":"2026-02-17T12:30:14.329303+0000","last_fullsized":"2026-02-17T12:30:14.329303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T14:56:52.652393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000371481,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329497+0000","last_change":"2026-02-17T12:30:03.307859+0000","last_active":"2026-02-17T12:30:14.329497+0000","last_peered":"2026-02-17T12:30:14.329497+0000","last_clean":"2026-02-17T12:30:14.329497+0000","last_became_active":"2026-02-17T12:30:03.307642+0000","last_became_peered":"2026-02-17T12:30:03.307642+0000","last_unstale":"2026-02-17T12:30:14.329497+0000","last_undegraded":"2026-02-17T12:30:14.329497+0000","last_fullsized":"2026-02-17T12:30:14.329497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:18:50.326894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.328573+0000","last_change":"2026-02-17T12:30:09.319651+0000","last_active":"2026-02-17T12:30:14.328573+0000","last_peered":"2026-02-17T12:30:14.328573+0000","last_clean":"2026-02-17T12:30:14.328573+0000","last_became_active":"2026-02-17T12:30:09.319432+0000","last_became_peered":"2026-02-17T12:30:09.319432+0000","last_unstale":"2026-02-17T12:30:14.328573+0000","last_undegraded":"2026-02-17T12:30:14.328573+0000","last_fullsized":"2026-02-17T12:30:14.328573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:16:00.974434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329592+0000","last_change":"2026-02-17T12:30:03.307505+0000","last_active":"2026-02-17T12:30:14.329592+0000","last_peered":"2026-02-17T12:30:14.329592+0000","last_clean":"2026-02-17T12:30:14.329592+0000","last_became_active":"2026-02-17T12:30:03.307311+0000","last_became_peered":"2026-02-17T12:30:03.307311+0000","last_unstale":"2026-02-17T12:30:14.329592+0000","last_undegraded":"2026-02-17T12:30:14.329592+0000","last_fullsized":"2026-02-17T12:30:14.329592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T13:47:58.124626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T12:30:14.329660+0000","last_change":"2026-02-17T12:30:09.319493+0000","last_active":"2026-02-17T12:30:14.329660+0000","last_peered":"2026-02-17T12:30:14.329660+0000","last_clean":"2026-02-17T12:30:14.329660+0000","last_became_active":"2026-02-17T12:30:09.319328+0000","last_became_peered":"2026-02-17T12:30:09.319328+0000","last_unstale":"2026-02-17T12:30:14.329660+0000","last_undegraded":"2026-02-17T12:30:14.329660+0000","last_fullsized":"2026-02-17T12:30:14.329660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:27:32.892679+0000","last_clean_scrub_stamp":"2026-02-17T12:27:32.892679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:17:53.529004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053492399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":933912,"data_compressed":6741,"data_compressed_allocated":57344,"data_compressed_original":905216,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":29,"seq":124554051605,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181584,"kb_used_data":320,"kb_used_omap":4,"kb_used_meta":181243,"kb_avail":94190256,"statfs":{"total":96636764160,"available":96450822144,"internally_reserved":0,"allocated":327680,"data_stored":567258,"data_compressed":3414,"data_compressed_allocated":28672,"data_compressed_original":454656,"omap_allocated":4438,"internal_metadata":185593514},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,2,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":25,"seq":107374182423,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280536,"kb_used_data":328,"kb_used_omap":4,"kb_used_meta":280187,"kb_avail":94091304,"statfs":{"total":96636764160,"available":96349495296,"internally_reserved":0,"allocated":335872,"data_stored":567277,"data_compressed":3327,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":4440,"internal_metadata":286912168},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,0,7],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313241,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":184680,"kb_used_data":280,"kb_used_omap":4,"kb_used_meta":184379,"kb_avail":94187160,"statfs":{"total":96636764160,"available":96447651840,"internally_reserved":0,"allocated":286720,"data_stored":100321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4441,"internal_metadata":188804775},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":466956,"data_compressed":3327,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":466956,"data_compressed":3414,"data_compressed_allocated":28672,"data_compressed_original":454656,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:31:49.069 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T12:27:32.892679+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=27, tm_sec=32, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=31, tm_sec=47, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:31:49.069 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-17T12:27:32.892679+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=27, tm_sec=32, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=31, tm_sec=47, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:31:49.070 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-17T12:27:32.892679+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=27, tm_sec=32, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=31, tm_sec=47, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:31:49.070 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2026-02-17T12:29:52.272115+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=29, tm_sec=52, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=31, tm_sec=47, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:31:49.070 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-17T12:27:32.892679+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=27, tm_sec=32, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=31, tm_sec=47, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:31:49.070 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-17T12:27:32.892679+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=27, tm_sec=32, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=31, tm_sec=47, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:31:49.070 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-17T12:27:32.892679+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=27, tm_sec=32, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=31, tm_sec=47, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:31:49.070 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-17T12:27:32.892679+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=27, tm_sec=32, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=31, tm_sec=47, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:31:49.071 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-17T12:27:32.892679+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=27, tm_sec=32, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=12, tm_min=31, tm_sec=47, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T12:31:49.071 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T12:32:09.072 DEBUG:teuthology.orchestra.run.trial176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T12:32:09.230 INFO:teuthology.orchestra.run.trial176.stdout: 2026-02-17T12:32:09.231 INFO:teuthology.orchestra.run.trial176.stderr:dumped all 2026-02-17T12:32:09.239 INFO:teuthology.orchestra.run.trial176.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2026-02-17T12:32:07.278293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59,"ondisk_log_size":59,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":587444,"kb_used_data":964,"kb_used_omap":13,"kb_used_meta":586418,"kb_avail":282528076,"statfs":{"total":289910292480,"available":289308749824,"internally_reserved":0,"allocated":987136,"data_stored":1245389,"data_compressed":6741,"data_compressed_allocated":57344,"data_compressed_original":905216,"omap_allocated":13319,"internal_metadata":600493049},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000985"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T12:31:50.976729+0000","last_change":"2026-02-17T12:31:50.976729+0000","last_active":"2026-02-17T12:31:50.976729+0000","last_peered":"2026-02-17T12:31:50.976729+0000","last_clean":"2026-02-17T12:31:50.976729+0000","last_became_active":"2026-02-17T12:30:03.307684+0000","last_became_peered":"2026-02-17T12:30:03.307684+0000","last_unstale":"2026-02-17T12:31:50.976729+0000","last_undegraded":"2026-02-17T12:31:50.976729+0000","last_fullsized":"2026-02-17T12:31:50.976729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:31:50.976209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:31:50.976209+0000","last_clean_scrub_stamp":"2026-02-17T12:31:50.976209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T18:06:27.926060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T12:31:50.320867+0000","last_change":"2026-02-17T12:31:50.320878+0000","last_active":"2026-02-17T12:31:50.320867+0000","last_peered":"2026-02-17T12:31:50.320867+0000","last_clean":"2026-02-17T12:31:50.320867+0000","last_became_active":"2026-02-17T12:30:09.319691+0000","last_became_peered":"2026-02-17T12:30:09.319691+0000","last_unstale":"2026-02-17T12:31:50.320867+0000","last_undegraded":"2026-02-17T12:31:50.320867+0000","last_fullsized":"2026-02-17T12:31:50.320867+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:31:50.320815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:31:50.320815+0000","last_clean_scrub_stamp":"2026-02-17T12:31:50.320815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T20:31:59.515541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"34'3","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T12:31:48.863186+0000","last_change":"2026-02-17T12:31:48.863186+0000","last_active":"2026-02-17T12:31:48.863186+0000","last_peered":"2026-02-17T12:31:48.863186+0000","last_clean":"2026-02-17T12:31:48.863186+0000","last_became_active":"2026-02-17T12:30:03.307174+0000","last_became_peered":"2026-02-17T12:30:03.307174+0000","last_unstale":"2026-02-17T12:31:48.863186+0000","last_undegraded":"2026-02-17T12:31:48.863186+0000","last_fullsized":"2026-02-17T12:31:48.863186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2026-02-17T12:31:48.863107+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2026-02-17T12:31:48.863107+0000","last_clean_scrub_stamp":"2026-02-17T12:31:48.863107+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:01:58.540512+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00024717000000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"34'54","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T12:31:53.937678+0000","last_change":"2026-02-17T12:31:53.937678+0000","last_active":"2026-02-17T12:31:53.937678+0000","last_peered":"2026-02-17T12:31:53.937678+0000","last_clean":"2026-02-17T12:31:53.937678+0000","last_became_active":"2026-02-17T12:30:09.320319+0000","last_became_peered":"2026-02-17T12:30:09.320319+0000","last_unstale":"2026-02-17T12:31:53.937678+0000","last_undegraded":"2026-02-17T12:31:53.937678+0000","last_fullsized":"2026-02-17T12:31:53.937678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'54","last_scrub_stamp":"2026-02-17T12:31:53.937635+0000","last_deep_scrub":"34'54","last_deep_scrub_stamp":"2026-02-17T12:31:53.937635+0000","last_clean_scrub_stamp":"2026-02-17T12:31:53.937635+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:21:26.661298+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T12:31:52.914251+0000","last_change":"2026-02-17T12:31:52.914262+0000","last_active":"2026-02-17T12:31:52.914251+0000","last_peered":"2026-02-17T12:31:52.914251+0000","last_clean":"2026-02-17T12:31:52.914251+0000","last_became_active":"2026-02-17T12:30:09.319691+0000","last_became_peered":"2026-02-17T12:30:09.319691+0000","last_unstale":"2026-02-17T12:31:52.914251+0000","last_undegraded":"2026-02-17T12:31:52.914251+0000","last_fullsized":"2026-02-17T12:31:52.914251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2026-02-17T12:31:52.914222+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2026-02-17T12:31:52.914222+0000","last_clean_scrub_stamp":"2026-02-17T12:31:52.914222+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:21:31.319927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000371481,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T12:31:49.989339+0000","last_change":"2026-02-17T12:31:49.989348+0000","last_active":"2026-02-17T12:31:49.989339+0000","last_peered":"2026-02-17T12:31:49.989339+0000","last_clean":"2026-02-17T12:31:49.989339+0000","last_became_active":"2026-02-17T12:30:03.307642+0000","last_became_peered":"2026-02-17T12:30:03.307642+0000","last_unstale":"2026-02-17T12:31:49.989339+0000","last_undegraded":"2026-02-17T12:31:49.989339+0000","last_fullsized":"2026-02-17T12:31:49.989339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:31:49.989303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:31:49.989303+0000","last_clean_scrub_stamp":"2026-02-17T12:31:49.989303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T19:15:59.360239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T12:31:49.302279+0000","last_change":"2026-02-17T12:31:49.302289+0000","last_active":"2026-02-17T12:31:49.302279+0000","last_peered":"2026-02-17T12:31:49.302279+0000","last_clean":"2026-02-17T12:31:49.302279+0000","last_became_active":"2026-02-17T12:30:09.319432+0000","last_became_peered":"2026-02-17T12:30:09.319432+0000","last_unstale":"2026-02-17T12:31:49.302279+0000","last_undegraded":"2026-02-17T12:31:49.302279+0000","last_fullsized":"2026-02-17T12:31:49.302279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:31:49.302233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:31:49.302233+0000","last_clean_scrub_stamp":"2026-02-17T12:31:49.302233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:26:16.766209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T12:31:48.994494+0000","last_change":"2026-02-17T12:31:48.994503+0000","last_active":"2026-02-17T12:31:48.994494+0000","last_peered":"2026-02-17T12:31:48.994494+0000","last_clean":"2026-02-17T12:31:48.994494+0000","last_became_active":"2026-02-17T12:30:03.307311+0000","last_became_peered":"2026-02-17T12:30:03.307311+0000","last_unstale":"2026-02-17T12:31:48.994494+0000","last_undegraded":"2026-02-17T12:31:48.994494+0000","last_fullsized":"2026-02-17T12:31:48.994494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:31:48.993834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:31:48.993834+0000","last_clean_scrub_stamp":"2026-02-17T12:31:48.993834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T21:31:46.369764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2026-02-17T12:31:51.941936+0000","last_change":"2026-02-17T12:31:51.941944+0000","last_active":"2026-02-17T12:31:51.941936+0000","last_peered":"2026-02-17T12:31:51.941936+0000","last_clean":"2026-02-17T12:31:51.941936+0000","last_became_active":"2026-02-17T12:30:09.319328+0000","last_became_peered":"2026-02-17T12:30:09.319328+0000","last_unstale":"2026-02-17T12:31:51.941936+0000","last_undegraded":"2026-02-17T12:31:51.941936+0000","last_fullsized":"2026-02-17T12:31:51.941936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:31:51.941898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:31:51.941898+0000","last_clean_scrub_stamp":"2026-02-17T12:31:51.941898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T15:38:31.024611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053492399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":466956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":933912,"data_compressed":6741,"data_compressed_allocated":57344,"data_compressed_original":905216,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":29,"seq":124554051609,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185756,"kb_used_data":332,"kb_used_omap":4,"kb_used_meta":185403,"kb_avail":94186084,"statfs":{"total":96636764160,"available":96446550016,"internally_reserved":0,"allocated":339968,"data_stored":570769,"data_compressed":3414,"data_compressed_allocated":28672,"data_compressed_original":454656,"omap_allocated":4438,"internal_metadata":189853354},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":25,"seq":107374182427,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216996,"kb_used_data":340,"kb_used_omap":4,"kb_used_meta":216635,"kb_avail":94154844,"statfs":{"total":96636764160,"available":96414560256,"internally_reserved":0,"allocated":348160,"data_stored":570788,"data_compressed":3327,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":4440,"internal_metadata":221834920},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313245,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":184692,"kb_used_data":292,"kb_used_omap":4,"kb_used_meta":184379,"kb_avail":94187148,"statfs":{"total":96636764160,"available":96447639552,"internally_reserved":0,"allocated":299008,"data_stored":103832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4441,"internal_metadata":188804775},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":466956,"data_compressed":3327,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":466956,"data_compressed":3414,"data_compressed_allocated":28672,"data_compressed_original":454656,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:32:09.241 DEBUG:teuthology.orchestra.run.trial176:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T12:32:09.407 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T12:32:09.407 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T12:32:09.407 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T12:32:09.407 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:32:09.457 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T12:32:09.458 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T12:32:09.458 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:32:09.513 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T12:32:09.514 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T12:32:09.514 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:32:09.564 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T12:32:09.564 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T12:32:09.565 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T12:32:09.565 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:32:09.606 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T12:32:09.606 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T12:32:09.606 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T12:32:09.606 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:32:09.655 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T12:32:09.656 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T12:32:09.656 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:32:09.706 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T12:32:09.706 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T12:32:09.706 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T12:32:09.756 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T12:32:09.756 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T12:32:09.757 DEBUG:teuthology.orchestra.run.trial176:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'no reply from' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v '\(MON_DOWN\)' | head -n 1 2026-02-17T12:32:09.824 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T12:32:09.824 DEBUG:teuthology.orchestra.run.trial176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T12:32:09.973 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T12:32:09.973 DEBUG:teuthology.orchestra.run.trial176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T12:32:10.039 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial176.front.sepia.ceph.com 2026-02-17T12:32:10.040 DEBUG:teuthology.orchestra.run.trial176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T12:32:10.089 INFO:tasks.ceph:Archiving mon data... 2026-02-17T12:32:10.090 DEBUG:teuthology.misc:Transferring archived files from trial176:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51452/data/mon.a.tgz 2026-02-17T12:32:10.091 DEBUG:teuthology.orchestra.run.trial176:> mktemp 2026-02-17T12:32:10.107 INFO:teuthology.orchestra.run.trial176.stdout:/tmp/tmp.Cmg2QYwEbv 2026-02-17T12:32:10.108 DEBUG:teuthology.orchestra.run.trial176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Cmg2QYwEbv 2026-02-17T12:32:10.196 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod 0666 /tmp/tmp.Cmg2QYwEbv 2026-02-17T12:32:10.279 DEBUG:teuthology.orchestra.remote:trial176:/tmp/tmp.Cmg2QYwEbv is 191KB 2026-02-17T12:32:10.331 DEBUG:teuthology.orchestra.run.trial176:> rm -fr /tmp/tmp.Cmg2QYwEbv 2026-02-17T12:32:10.347 DEBUG:teuthology.misc:Transferring archived files from trial176:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51452/data/mon.b.tgz 2026-02-17T12:32:10.348 DEBUG:teuthology.orchestra.run.trial176:> mktemp 2026-02-17T12:32:10.403 INFO:teuthology.orchestra.run.trial176.stdout:/tmp/tmp.xbQdpdKfPg 2026-02-17T12:32:10.403 DEBUG:teuthology.orchestra.run.trial176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.xbQdpdKfPg 2026-02-17T12:32:10.497 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod 0666 /tmp/tmp.xbQdpdKfPg 2026-02-17T12:32:10.579 DEBUG:teuthology.orchestra.remote:trial176:/tmp/tmp.xbQdpdKfPg is 256KB 2026-02-17T12:32:10.683 DEBUG:teuthology.orchestra.run.trial176:> rm -fr /tmp/tmp.xbQdpdKfPg 2026-02-17T12:32:10.707 DEBUG:teuthology.misc:Transferring archived files from trial176:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51452/data/mon.c.tgz 2026-02-17T12:32:10.708 DEBUG:teuthology.orchestra.run.trial176:> mktemp 2026-02-17T12:32:10.765 INFO:teuthology.orchestra.run.trial176.stdout:/tmp/tmp.muJsWG9Q7T 2026-02-17T12:32:10.765 DEBUG:teuthology.orchestra.run.trial176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.muJsWG9Q7T 2026-02-17T12:32:10.859 DEBUG:teuthology.orchestra.run.trial176:> sudo chmod 0666 /tmp/tmp.muJsWG9Q7T 2026-02-17T12:32:10.942 DEBUG:teuthology.orchestra.remote:trial176:/tmp/tmp.muJsWG9Q7T is 253KB 2026-02-17T12:32:11.037 DEBUG:teuthology.orchestra.run.trial176:> rm -fr /tmp/tmp.muJsWG9Q7T 2026-02-17T12:32:11.054 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T12:32:11.054 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T12:32:11.173 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T12:32:11.174 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T12:32:11.176 DEBUG:teuthology.misc:Transferring archived files from trial176:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51452/remote/trial176/crash 2026-02-17T12:32:11.177 DEBUG:teuthology.orchestra.run.trial176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T12:32:11.237 INFO:tasks.ceph:Compressing logs... 2026-02-17T12:32:11.237 DEBUG:teuthology.orchestra.run.trial176:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:32:11.302 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46786.log 2026-02-17T12:32:11.321 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T12:32:11.321 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46786.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-17T12:32:11.321 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46786.log.gz 2026-02-17T12:32:11.321 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46910.log 2026-02-17T12:32:11.321 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T12:32:11.322 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.0.46910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47082.log 2026-02-17T12:32:11.322 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46299.log 2026-02-17T12:32:11.322 INFO:teuthology.orchestra.run.trial176.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.0.46910.log.gz 2026-02-17T12:32:11.322 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.47082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54235.log 2026-02-17T12:32:11.322 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47082.log.gz 2026-02-17T12:32:11.322 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46153.log 2026-02-17T12:32:11.322 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46299.log.gz 2026-02-17T12:32:11.322 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.54235.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37729.log 2026-02-17T12:32:11.322 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54235.log.gz 2026-02-17T12:32:11.322 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42582.log 2026-02-17T12:32:11.322 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46153.log.gz 2026-02-17T12:32:11.323 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph.tmp-client.admin.37729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46154.log 2026-02-17T12:32:11.323 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37729.log.gz 2026-02-17T12:32:11.323 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.42582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53794.log 2026-02-17T12:32:11.323 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42582.log.gz 2026-02-17T12:32:11.323 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46154.log.gz 2026-02-17T12:32:11.323 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45863.log 2026-02-17T12:32:11.323 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.53794.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-17T12:32:11.323 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53794.log.gz 2026-02-17T12:32:11.323 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.45863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46446.log 2026-02-17T12:32:11.323 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45863.log.gz 2026-02-17T12:32:11.323 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2026-02-17T12:32:11.323 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43136.log 2026-02-17T12:32:11.323 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46446.log.gz 2026-02-17T12:32:11.324 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2026-02-17T12:32:11.324 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43200.log 2026-02-17T12:32:11.324 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.43136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43136.log.gz 2026-02-17T12:32:11.324 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45888.log 2026-02-17T12:32:11.324 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.43200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43200.log.gz 2026-02-17T12:32:11.324 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53745.log 2026-02-17T12:32:11.324 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.45888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45888.log.gz 2026-02-17T12:32:11.324 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46152.log 2026-02-17T12:32:11.324 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.53745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53745.log.gz 2026-02-17T12:32:11.324 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46615.log 2026-02-17T12:32:11.324 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47011.log 2026-02-17T12:32:11.324 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46152.log.gz 2026-02-17T12:32:11.325 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46615.log.gz 2026-02-17T12:32:11.325 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54333.log 2026-02-17T12:32:11.325 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.47011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47011.log.gz 2026-02-17T12:32:11.325 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46300.log 2026-02-17T12:32:11.325 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.54333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54333.log.gz 2026-02-17T12:32:11.325 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54186.log 2026-02-17T12:32:11.325 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54039.log 2026-02-17T12:32:11.325 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46300.log.gz 2026-02-17T12:32:11.325 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.54186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54186.log.gz 2026-02-17T12:32:11.325 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53941.log 2026-02-17T12:32:11.325 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.54039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54039.log.gz 2026-02-17T12:32:11.325 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54380.log 2026-02-17T12:32:11.325 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.53941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53941.log.gz 2026-02-17T12:32:11.326 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54088.log 2026-02-17T12:32:11.326 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.54380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54380.log.gz 2026-02-17T12:32:11.326 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54284.log 2026-02-17T12:32:11.326 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.54088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54088.log.gz 2026-02-17T12:32:11.326 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54137.log 2026-02-17T12:32:11.326 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.54284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54284.log.gz 2026-02-17T12:32:11.326 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53598.log 2026-02-17T12:32:11.326 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.54137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54137.log.gz 2026-02-17T12:32:11.326 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T12:32:11.326 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.53598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53598.log.gz 2026-02-17T12:32:11.326 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45793.log 2026-02-17T12:32:11.326 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-17T12:32:11.326 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.45793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45793.log.gz 2026-02-17T12:32:11.327 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42771.log 2026-02-17T12:32:11.327 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-mon.b.log: 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T12:32:11.327 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T12:32:11.327 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.42771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42771.log.gz 2026-02-17T12:32:11.327 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53892.log 2026-02-17T12:32:11.327 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46002.log 2026-02-17T12:32:11.327 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.53892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53892.log.gz 2026-02-17T12:32:11.327 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43009.log 2026-02-17T12:32:11.327 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46002.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.46002.log.gz --verbose 2026-02-17T12:32:11.327 INFO:teuthology.orchestra.run.trial176.stderr: -- /var/log/ceph/ceph-client.admin.53990.log 2026-02-17T12:32:11.327 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.43009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43009.log.gz 2026-02-17T12:32:11.327 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53843.log 2026-02-17T12:32:11.327 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.53990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53990.log.gz 2026-02-17T12:32:11.328 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46447.log 2026-02-17T12:32:11.328 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.53843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53843.log.gz 2026-02-17T12:32:11.328 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46737.log 2026-02-17T12:32:11.328 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46447.log.gz 2026-02-17T12:32:11.328 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46301.log 2026-02-17T12:32:11.328 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46737.log.gz 2026-02-17T12:32:11.328 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45747.log 2026-02-17T12:32:11.328 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46301.log.gz 2026-02-17T12:32:11.328 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46448.log 2026-02-17T12:32:11.328 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.45747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45747.log.gz 2026-02-17T12:32:11.328 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T12:32:11.328 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46448.log.gz 2026-02-17T12:32:11.329 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46688.log 2026-02-17T12:32:11.329 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50559.log 2026-02-17T12:32:11.329 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46688.log.gz 2026-02-17T12:32:11.329 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42915.log 2026-02-17T12:32:11.329 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.50559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50559.log.gz 2026-02-17T12:32:11.329 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53673.log 2026-02-17T12:32:11.329 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.42915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42915.log.gz 2026-02-17T12:32:11.329 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46612.log 2026-02-17T12:32:11.329 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.0.53673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46541.log 2026-02-17T12:32:11.329 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46612.log.gz 2026-02-17T12:32:11.329 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47131.log 2026-02-17T12:32:11.329 INFO:teuthology.orchestra.run.trial176.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.0.53673.log.gz 2026-02-17T12:32:11.329 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46541.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T12:32:11.330 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46541.log.gz 2026-02-17T12:32:11.330 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.47131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47131.log.gz 2026-02-17T12:32:11.330 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46835.log 2026-02-17T12:32:11.330 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46988.log 2026-02-17T12:32:11.330 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46051.log 2026-02-17T12:32:11.330 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46835.log.gz 2026-02-17T12:32:11.330 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46988.log.gz 2026-02-17T12:32:11.330 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42962.log 2026-02-17T12:32:11.330 INFO:teuthology.orchestra.run.trial176.stderr: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T12:32:11.330 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.46051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45953.log 2026-02-17T12:32:11.330 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46051.log.gz 2026-02-17T12:32:11.330 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.42962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53650.log 2026-02-17T12:32:11.330 INFO:teuthology.orchestra.run.trial176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42962.log.gz 2026-02-17T12:32:11.331 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.45953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45953.log.gz 2026-02-17T12:32:11.331 INFO:teuthology.orchestra.run.trial176.stderr:/var/log/ceph/ceph-client.admin.53650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53650.log.gz 2026-02-17T12:32:11.337 INFO:teuthology.orchestra.run.trial176.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T12:32:11.351 INFO:teuthology.orchestra.run.trial176.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-17T12:32:11.362 INFO:teuthology.orchestra.run.trial176.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-17T12:32:11.391 INFO:teuthology.orchestra.run.trial176.stderr: 90.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T12:32:58.093 INFO:teuthology.orchestra.run.trial176.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T12:33:09.239 INFO:teuthology.orchestra.run.trial176.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T12:33:32.688 INFO:teuthology.orchestra.run.trial176.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T12:33:32.690 INFO:teuthology.orchestra.run.trial176.stderr: 2026-02-17T12:33:32.690 INFO:teuthology.orchestra.run.trial176.stderr:real 1m21.397s 2026-02-17T12:33:32.690 INFO:teuthology.orchestra.run.trial176.stderr:user 2m59.162s 2026-02-17T12:33:32.690 INFO:teuthology.orchestra.run.trial176.stderr:sys 0m6.798s 2026-02-17T12:33:32.690 INFO:tasks.ceph:Archiving logs... 2026-02-17T12:33:32.690 DEBUG:teuthology.misc:Transferring archived files from trial176:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51452/remote/trial176/log 2026-02-17T12:33:32.692 DEBUG:teuthology.orchestra.run.trial176:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T12:33:49.078 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T12:33:49.085 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T12:33:49.085 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T12:33:49.175 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T12:33:49.186 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T12:33:49.186 DEBUG:teuthology.orchestra.run.trial176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:33:49.203 INFO:teuthology.orchestra.run.trial176.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:33:49.235 INFO:teuthology.orchestra.run.trial176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:33:49.235 INFO:teuthology.orchestra.run.trial176.stdout:=============================================================================== 2026-02-17T12:33:49.235 INFO:teuthology.orchestra.run.trial176.stdout:^* 108.61.73.244 2 6 377 10 +740us[ +891us] +/- 31ms 2026-02-17T12:33:49.235 INFO:teuthology.orchestra.run.trial176.stdout:^+ 23-95-35-34-host.colocro> 2 6 377 10 +600us[ +600us] +/- 36ms 2026-02-17T12:33:49.235 INFO:teuthology.orchestra.run.trial176.stdout:^+ 172-235-154-118.ip.linod> 4 6 377 10 -3392us[-3392us] +/- 60ms 2026-02-17T12:33:49.235 INFO:teuthology.orchestra.run.trial176.stdout:^+ ntp1.lax.us.hojmark.net 2 6 377 11 +1968us[+2119us] +/- 44ms 2026-02-17T12:33:49.235 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T12:33:49.247 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T12:33:49.247 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T12:33:49.260 DEBUG:teuthology.orchestra.run.trial176:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T12:33:49.331 DEBUG:teuthology.orchestra.run.trial176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:33:49.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:33:49.356 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T12:33:49.368 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T12:33:49.389 INFO:teuthology.task.internal:Duration was 647.827953 seconds 2026-02-17T12:33:49.389 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T12:33:49.403 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T12:33:49.404 DEBUG:teuthology.orchestra.run.trial176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T12:33:49.440 INFO:teuthology.orchestra.run.trial176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:33:49.799 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T12:33:49.799 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial176.front.sepia.ceph.com 2026-02-17T12:33:49.799 DEBUG:teuthology.orchestra.run.trial176:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T12:33:49.857 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T12:33:49.858 DEBUG:teuthology.orchestra.run.trial176:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:33:49.959 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T12:33:49.959 DEBUG:teuthology.orchestra.run.trial176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:33:49.985 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:33:49.985 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:33:49.985 INFO:teuthology.orchestra.run.trial176.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T12:33:49.986 INFO:teuthology.orchestra.run.trial176.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:33:49.986 INFO:teuthology.orchestra.run.trial176.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T12:33:49.995 INFO:teuthology.orchestra.run.trial176.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T12:33:49.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T12:33:50.014 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T12:33:50.014 DEBUG:teuthology.orchestra.run.trial176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T12:33:50.062 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T12:33:50.079 DEBUG:teuthology.orchestra.run.trial176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:33:50.125 INFO:teuthology.orchestra.run.trial176.stdout:kernel.core_pattern = core 2026-02-17T12:33:50.156 DEBUG:teuthology.orchestra.run.trial176:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:33:50.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:33:50.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T12:33:50.232 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T12:33:50.233 DEBUG:teuthology.misc:Transferring archived files from trial176:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51452/remote/trial176 2026-02-17T12:33:50.233 DEBUG:teuthology.orchestra.run.trial176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T12:33:50.292 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T12:33:50.292 DEBUG:teuthology.orchestra.run.trial176:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T12:33:50.341 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T12:33:50.352 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T12:33:50.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T12:33:50.365 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T12:33:50.366 DEBUG:teuthology.orchestra.run.trial176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T12:33:50.397 INFO:teuthology.orchestra.run.trial176.stdout: 791885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:33 /home/ubuntu/cephtest 2026-02-17T12:33:50.399 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T12:33:50.415 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T12:33:50.453 INFO:teuthology.run:Summary data: description: rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} duration: 647.827953338623 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-17T12:33:50.453 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T12:33:50.571 INFO:teuthology.run:pass