2026-02-20T11:58:26.275 INFO:root:teuthology version: 1.2.4.dev11+ge6d9099ce 2026-02-20T11:58:26.289 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T11:58:26.372 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60610 branch: wip-perezjos-crimson-only-19-02-2026-PR64439 description: crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore tasks/rbd_python_api_tests_old_format} email: null first_in_suite: false flavor: debug job_id: '60610' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-perezjos-crimson-only-19-02-2026-PR64439 ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson cpu num: 4 crimson osd obc lru size: 10 debug alienstore: 20 debug bluefs: 20 debug bluestore: 20 debug ms: 20 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore max concurrent transactions: 8 crimson_compat: true flavor: debug fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - slow request sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} install: ceph: extra_system_packages: - python3-pytest flavor: debug sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 445d5c9ba18a4040e70e25303230c36c77773acb owner: scheduled_jjperez@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 1736 sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 445d5c9ba18a4040e70e25303230c36c77773acb targets: trial058.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJkg00aPqZtAlyMaBUY02WN/B3uqH3WDyvzCoZIb00xGQlpkuM8fMTI+o4C6/mir6hlrqy8VcIcadnK+wvw3kw= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 - workunit: clients: client.0: - rbd/test_librbd_python.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: reimage-ssh-down teuthology_sha1: e6d9099ce03dc21193fda653159ec82465c3a94a timestamp: 2026-02-20_10:21:31 tube: trial user: jjperez verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T11:58:26.372 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa; will attempt to use it 2026-02-20T11:58:26.373 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks 2026-02-20T11:58:26.373 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T11:58:26.375 INFO:teuthology.task.internal:Checking packages... 2026-02-20T11:58:26.375 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4' 2026-02-20T11:58:26.375 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T11:58:26.375 INFO:teuthology.packaging:ref: None 2026-02-20T11:58:26.375 INFO:teuthology.packaging:tag: None 2026-02-20T11:58:26.375 INFO:teuthology.packaging:branch: wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:58:26.375 INFO:teuthology.packaging:sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:58:26.375 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:58:26.490 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5357.g0c3148ca 2026-02-20T11:58:26.491 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T11:58:26.503 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T11:58:26.503 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T11:58:26.520 INFO:teuthology.task.internal:Saving configuration 2026-02-20T11:58:26.531 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T11:58:26.544 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T11:58:26.635 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial058.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60610', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 11:55:01.853592', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJkg00aPqZtAlyMaBUY02WN/B3uqH3WDyvzCoZIb00xGQlpkuM8fMTI+o4C6/mir6hlrqy8VcIcadnK+wvw3kw='} 2026-02-20T11:58:26.635 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T11:58:26.647 INFO:teuthology.task.internal:roles: ubuntu@trial058.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-20T11:58:26.647 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T11:58:26.737 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7376b2b45da0>, signals=[15]) 2026-02-20T11:58:26.737 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T11:58:26.748 INFO:teuthology.task.internal:Opening connections... 2026-02-20T11:58:26.748 DEBUG:teuthology.task.internal:connecting to ubuntu@trial058.front.sepia.ceph.com 2026-02-20T11:58:26.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:58:26.816 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T11:58:26.828 DEBUG:teuthology.orchestra.run.trial058:> uname -m 2026-02-20T11:58:26.891 INFO:teuthology.orchestra.run.trial058.stdout:x86_64 2026-02-20T11:58:26.892 DEBUG:teuthology.orchestra.run.trial058:> cat /etc/os-release 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:NAME="CentOS Stream" 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:VERSION="9" 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:ID="centos" 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:ID_LIKE="rhel fedora" 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:VERSION_ID="9" 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:PLATFORM_ID="platform:el9" 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:ANSI_COLOR="0;31" 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:LOGO="fedora-logo-icon" 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:HOME_URL="https://centos.org/" 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T11:58:26.947 INFO:teuthology.orchestra.run.trial058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T11:58:26.948 INFO:teuthology.lock.ops:Updating trial058.front.sepia.ceph.com on lock server 2026-02-20T11:58:27.006 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T11:58:27.019 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T11:58:27.031 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T11:58:27.031 DEBUG:teuthology.orchestra.run.trial058:> test '!' -e /home/ubuntu/cephtest 2026-02-20T11:58:27.046 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T11:58:27.057 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T11:58:27.057 DEBUG:teuthology.orchestra.run.trial058:> test -z $(ls -A /var/lib/ceph) 2026-02-20T11:58:27.102 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T11:58:27.170 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T11:58:27.189 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-20T11:58:27.189 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-20T11:58:27.189 DEBUG:teuthology.orchestra.run.trial058:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T11:58:27.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:58:27.204 DEBUG:teuthology.orchestra.run.trial058:> uname -r 2026-02-20T11:58:27.260 INFO:teuthology.orchestra.run.trial058.stdout:5.14.0-681.el9.x86_64 2026-02-20T11:58:27.260 INFO:teuthology.task.kernel:Running kernel on trial058: 5.14.0-681.el9.x86_64 2026-02-20T11:58:27.260 DEBUG:teuthology.orchestra.run.trial058:> sudo yum install -y kernel 2026-02-20T11:58:28.337 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-20T11:58:31.470 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-20T11:58:39.908 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - CRB 1.3 MB/s | 7.8 MB 00:06 2026-02-20T11:58:41.685 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 20 kB 00:01 2026-02-20T11:58:43.022 INFO:teuthology.orchestra.run.trial058.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-20T11:58:46.264 INFO:teuthology.orchestra.run.trial058.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-20T11:58:47.270 INFO:teuthology.orchestra.run.trial058.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T11:58:47.270 INFO:teuthology.orchestra.run.trial058.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T11:58:47.289 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-20T11:58:47.289 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-20T11:58:47.290 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-20T11:58:47.313 DEBUG:teuthology.orchestra.run.trial058:> echo no | sudo yum reinstall kernel || true 2026-02-20T11:58:47.607 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:58:46 AM UTC. 2026-02-20T11:58:47.687 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-20T11:58:47.688 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-20T11:58:47.689 INFO:teuthology.orchestra.run.trial058.stdout: Package Architecture Version Repository Size 2026-02-20T11:58:47.689 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-20T11:58:47.689 INFO:teuthology.orchestra.run.trial058.stdout:Reinstalling: 2026-02-20T11:58:47.689 INFO:teuthology.orchestra.run.trial058.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:58:47.689 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T11:58:47.689 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-20T11:58:47.689 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-20T11:58:47.689 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T11:58:47.689 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 803 k 2026-02-20T11:58:47.689 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 0 2026-02-20T11:58:47.690 INFO:teuthology.orchestra.run.trial058.stderr:Operation aborted. 2026-02-20T11:58:47.707 INFO:teuthology.orchestra.run.trial058.stdout:Is this ok [y/N]: 2026-02-20T11:58:47.708 DEBUG:teuthology.orchestra.run.trial058:> sudo yum reinstall -y kernel || true 2026-02-20T11:58:48.005 INFO:teuthology.orchestra.run.trial058.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:58:46 AM UTC. 2026-02-20T11:58:48.086 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-20T11:58:48.087 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-20T11:58:48.087 INFO:teuthology.orchestra.run.trial058.stdout: Package Architecture Version Repository Size 2026-02-20T11:58:48.087 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-20T11:58:48.087 INFO:teuthology.orchestra.run.trial058.stdout:Reinstalling: 2026-02-20T11:58:48.087 INFO:teuthology.orchestra.run.trial058.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:58:48.087 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T11:58:48.087 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-20T11:58:48.087 INFO:teuthology.orchestra.run.trial058.stdout:================================================================================ 2026-02-20T11:58:48.087 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T11:58:48.088 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 803 k 2026-02-20T11:58:48.088 INFO:teuthology.orchestra.run.trial058.stdout:Installed size: 0 2026-02-20T11:58:48.088 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-20T11:58:48.806 INFO:teuthology.orchestra.run.trial058.stdout:kernel-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2026-02-20T11:58:48.806 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:58:48.806 INFO:teuthology.orchestra.run.trial058.stdout:Total 1.1 MB/s | 803 kB 00:00 2026-02-20T11:58:48.816 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-20T11:58:48.850 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-20T11:58:48.850 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-20T11:58:48.855 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-20T11:58:48.855 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-20T11:58:48.878 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-20T11:58:48.882 INFO:teuthology.orchestra.run.trial058.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:58:48.882 INFO:teuthology.orchestra.run.trial058.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:58:48.993 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:58:48.993 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:58:49.049 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:58:49.049 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T11:58:49.049 INFO:teuthology.orchestra.run.trial058.stdout:Reinstalled: 2026-02-20T11:58:49.049 INFO:teuthology.orchestra.run.trial058.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T11:58:49.049 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T11:58:49.049 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-20T11:58:49.076 DEBUG:teuthology.orchestra.run.trial058:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T11:58:49.140 INFO:teuthology.orchestra.run.trial058.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T11:58:49.141 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T11:58:49.142 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T11:58:49.142 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-20T11:58:49.142 DEBUG:teuthology.orchestra.run.trial058:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T11:58:49.205 INFO:teuthology.orchestra.run.trial058.stdout:ttyS1 2026-02-20T11:58:49.229 DEBUG:teuthology.parallel:result is None 2026-02-20T11:58:49.229 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T11:58:49.236 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T11:58:49.236 DEBUG:teuthology.orchestra.run.trial058:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T11:58:49.285 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T11:58:49.296 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T11:58:49.309 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T11:58:49.309 DEBUG:teuthology.orchestra.run.trial058:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T11:58:49.347 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T11:58:49.363 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T11:58:49.363 DEBUG:teuthology.orchestra.run.trial058:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T11:58:49.407 INFO:teuthology.orchestra.run.trial058.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:58:49.415 INFO:teuthology.orchestra.run.trial058.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:58:49.416 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T11:58:49.428 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T11:58:49.428 DEBUG:teuthology.orchestra.run.trial058:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T11:58:49.480 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T11:58:49.497 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T11:58:49.497 DEBUG:teuthology.orchestra.run.trial058:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T11:58:49.536 DEBUG:teuthology.orchestra.run.trial058:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:58:49.655 DEBUG:teuthology.orchestra.run.trial058:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:58:49.680 DEBUG:teuthology.orchestra.run.trial058:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:58:49.815 DEBUG:teuthology.orchestra.run.trial058:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:58:49.837 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T11:58:49.837 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T11:58:49.900 DEBUG:teuthology.orchestra.run.trial058:> sudo service rsyslog restart 2026-02-20T11:58:49.967 INFO:teuthology.orchestra.run.trial058.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:58:50.493 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T11:58:50.505 INFO:teuthology.task.internal:Starting timer... 2026-02-20T11:58:50.505 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T11:58:50.526 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T11:58:50.551 DEBUG:teuthology.orchestra.run.trial058:> sudo service auditd rotate 2026-02-20T11:58:50.581 INFO:teuthology.orchestra.run.trial058.stdout:Rotating logs: 2026-02-20T11:58:50.583 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T11:58:50.583 DEBUG:teuthology.orchestra.run.trial058:> /usr/sbin/getenforce 2026-02-20T11:58:50.641 INFO:teuthology.orchestra.run.trial058.stdout:Permissive 2026-02-20T11:58:50.641 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial058.front.sepia.ceph.com': 'permissive'} 2026-02-20T11:58:50.642 DEBUG:teuthology.orchestra.run.trial058:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:58:50.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:58:50.707 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T11:58:50.707 DEBUG:teuthology.orchestra.run.trial058:> sudo /usr/sbin/setenforce permissive 2026-02-20T11:58:50.772 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T11:58:50.791 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T11:58:50.804 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T11:58:50.805 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial058.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T12:01:37.911 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial058.front.sepia.ceph.com')] 2026-02-20T12:01:37.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-20T12:01:37.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial058.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T12:01:38.019 DEBUG:teuthology.orchestra.run.trial058:> true 2026-02-20T12:01:38.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial058.front.sepia.ceph.com' 2026-02-20T12:01:38.102 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T12:01:38.117 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T12:01:38.117 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T12:01:38.118 DEBUG:teuthology.orchestra.run.trial058:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T12:01:38.169 INFO:teuthology.orchestra.run.trial058.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T12:01:38.181 INFO:teuthology.orchestra.run.trial058.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T12:01:38.202 INFO:teuthology.orchestra.run.trial058.stderr:sudo: ntpd: command not found 2026-02-20T12:01:38.212 INFO:teuthology.orchestra.run.trial058.stdout:506 Cannot talk to daemon 2026-02-20T12:01:38.224 INFO:teuthology.orchestra.run.trial058.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T12:01:38.236 INFO:teuthology.orchestra.run.trial058.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T12:01:38.283 INFO:teuthology.orchestra.run.trial058.stderr:bash: line 1: ntpq: command not found 2026-02-20T12:01:38.612 INFO:teuthology.orchestra.run.trial058.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T12:01:38.612 INFO:teuthology.orchestra.run.trial058.stdout:=============================================================================== 2026-02-20T12:01:38.612 INFO:teuthology.orchestra.run.trial058.stdout:^? 139-177-202-26.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T12:01:38.612 INFO:teuthology.orchestra.run.trial058.stdout:^? time-he.den.codehof.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T12:01:38.612 INFO:teuthology.orchestra.run.trial058.stdout:^? nyc3.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T12:01:38.613 INFO:teuthology.orchestra.run.trial058.stdout:^? time-h.den.codehof.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T12:01:38.614 INFO:teuthology.run_tasks:Running task install... 2026-02-20T12:01:38.628 DEBUG:teuthology.task.install:project ceph 2026-02-20T12:01:38.628 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T12:01:38.628 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T12:01:38.628 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T12:01:38.637 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T12:01:38.637 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-20T12:01:38.638 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T12:01:38.639 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T12:01:38.800 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T12:01:38.800 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T12:01:39.009 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T12:01:39.009 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:01:39.009 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T12:01:39.035 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo, python3-pytest on remote rpm x86_64 2026-02-20T12:01:39.036 DEBUG:teuthology.orchestra.run.trial058:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T12:01:39.100 DEBUG:teuthology.orchestra.run.trial058:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T12:01:39.173 DEBUG:teuthology.orchestra.run.trial058:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T12:01:39.238 INFO:teuthology.orchestra.run.trial058.stdout:check_obsoletes = 1 2026-02-20T12:01:39.240 DEBUG:teuthology.orchestra.run.trial058:> sudo yum clean all 2026-02-20T12:01:39.399 INFO:teuthology.orchestra.run.trial058.stdout:41 files removed 2026-02-20T12:01:39.413 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-osd-crimson ceph-osd-crimson-debuginfo python3-pytest 2026-02-20T12:01:39.842 INFO:teuthology.orchestra.run.trial058.stdout:ceph packages for x86_64 327 kB/s | 94 kB 00:00 2026-02-20T12:01:40.134 INFO:teuthology.orchestra.run.trial058.stdout:ceph noarch packages 92 kB/s | 24 kB 00:00 2026-02-20T12:01:40.364 INFO:teuthology.orchestra.run.trial058.stdout:ceph source packages 9.9 kB/s | 2.1 kB 00:00 2026-02-20T12:01:41.147 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-20T12:01:44.216 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-20T12:01:47.916 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - CRB 5.9 MB/s | 7.8 MB 00:01 2026-02-20T12:01:49.582 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 20 kB 00:00 2026-02-20T12:01:50.096 INFO:teuthology.orchestra.run.trial058.stdout:Extra Packages for Enterprise Linux 45 MB/s | 20 MB 00:00 2026-02-20T12:01:53.476 INFO:teuthology.orchestra.run.trial058.stdout:lab-extras 273 kB/s | 50 kB 00:00 2026-02-20T12:01:54.669 INFO:teuthology.orchestra.run.trial058.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T12:01:54.669 INFO:teuthology.orchestra.run.trial058.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T12:01:54.697 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-20T12:01:54.701 INFO:teuthology.orchestra.run.trial058.stdout:======================================================================================= 2026-02-20T12:01:54.701 INFO:teuthology.orchestra.run.trial058.stdout: Package Arch Version Repository Size 2026-02-20T12:01:54.701 INFO:teuthology.orchestra.run.trial058.stdout:======================================================================================= 2026-02-20T12:01:54.701 INFO:teuthology.orchestra.run.trial058.stdout:Installing: 2026-02-20T12:01:54.701 INFO:teuthology.orchestra.run.trial058.stdout: ceph x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 6.5 k 2026-02-20T12:01:54.702 INFO:teuthology.orchestra.run.trial058.stdout: ceph-base x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.1 M 2026-02-20T12:01:54.702 INFO:teuthology.orchestra.run.trial058.stdout: ceph-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 914 k 2026-02-20T12:01:54.702 INFO:teuthology.orchestra.run.trial058.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 149 k 2026-02-20T12:01:54.702 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 937 k 2026-02-20T12:01:54.702 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 184 k 2026-02-20T12:01:54.702 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 51 M 2026-02-20T12:01:54.702 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 7.4 M 2026-02-20T12:01:54.702 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-rook noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 50 k 2026-02-20T12:01:54.702 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 163 k 2026-02-20T12:01:54.702 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-classic x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 15 M 2026-02-20T12:01:54.702 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-crimson x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 88 M 2026-02-20T12:01:54.703 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 433 M 2026-02-20T12:01:54.703 INFO:teuthology.orchestra.run.trial058.stdout: ceph-radosgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 11 M 2026-02-20T12:01:54.703 INFO:teuthology.orchestra.run.trial058.stdout: ceph-test x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 127 M 2026-02-20T12:01:54.703 INFO:teuthology.orchestra.run.trial058.stdout: ceph-volume noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 301 k 2026-02-20T12:01:54.703 INFO:teuthology.orchestra.run.trial058.stdout: cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 1.0 M 2026-02-20T12:01:54.703 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T12:01:54.703 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 860 k 2026-02-20T12:01:54.703 INFO:teuthology.orchestra.run.trial058.stdout: librados-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 124 k 2026-02-20T12:01:54.703 INFO:teuthology.orchestra.run.trial058.stdout: python3-cephfs x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 204 k 2026-02-20T12:01:54.703 INFO:teuthology.orchestra.run.trial058.stdout: python3-pytest noarch 6.2.2-7.el9 appstream 519 k 2026-02-20T12:01:54.703 INFO:teuthology.orchestra.run.trial058.stdout: python3-rados x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 324 k 2026-02-20T12:01:54.703 INFO:teuthology.orchestra.run.trial058.stdout: python3-rbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 305 k 2026-02-20T12:01:54.704 INFO:teuthology.orchestra.run.trial058.stdout: python3-rgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 100 k 2026-02-20T12:01:54.704 INFO:teuthology.orchestra.run.trial058.stdout: rbd-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 86 k 2026-02-20T12:01:54.704 INFO:teuthology.orchestra.run.trial058.stdout: rbd-mirror x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.6 M 2026-02-20T12:01:54.704 INFO:teuthology.orchestra.run.trial058.stdout: rbd-nbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 167 k 2026-02-20T12:01:54.704 INFO:teuthology.orchestra.run.trial058.stdout:Upgrading: 2026-02-20T12:01:54.704 INFO:teuthology.orchestra.run.trial058.stdout: librados2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 3.3 M 2026-02-20T12:01:54.704 INFO:teuthology.orchestra.run.trial058.stdout: librbd1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.7 M 2026-02-20T12:01:54.704 INFO:teuthology.orchestra.run.trial058.stdout:Installing dependencies: 2026-02-20T12:01:54.704 INFO:teuthology.orchestra.run.trial058.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T12:01:54.704 INFO:teuthology.orchestra.run.trial058.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T12:01:54.704 INFO:teuthology.orchestra.run.trial058.stdout: ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 21 M 2026-02-20T12:01:54.704 INFO:teuthology.orchestra.run.trial058.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 57 k 2026-02-20T12:01:54.705 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mds x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.0 M 2026-02-20T12:01:54.705 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 297 k 2026-02-20T12:01:54.705 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 4.9 M 2026-02-20T12:01:54.705 INFO:teuthology.orchestra.run.trial058.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 17 k 2026-02-20T12:01:54.705 INFO:teuthology.orchestra.run.trial058.stdout: ceph-selinux x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 25 k 2026-02-20T12:01:54.705 INFO:teuthology.orchestra.run.trial058.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T12:01:54.705 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T12:01:54.705 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T12:01:54.705 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T12:01:54.705 INFO:teuthology.orchestra.run.trial058.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T12:01:54.705 INFO:teuthology.orchestra.run.trial058.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T12:01:54.705 INFO:teuthology.orchestra.run.trial058.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T12:01:54.706 INFO:teuthology.orchestra.run.trial058.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T12:01:54.706 INFO:teuthology.orchestra.run.trial058.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T12:01:54.706 INFO:teuthology.orchestra.run.trial058.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T12:01:54.706 INFO:teuthology.orchestra.run.trial058.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T12:01:54.706 INFO:teuthology.orchestra.run.trial058.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T12:01:54.706 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 26 k 2026-02-20T12:01:54.706 INFO:teuthology.orchestra.run.trial058.stdout: libcephsqlite x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 153 k 2026-02-20T12:01:54.706 INFO:teuthology.orchestra.run.trial058.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T12:01:54.706 INFO:teuthology.orchestra.run.trial058.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T12:01:54.706 INFO:teuthology.orchestra.run.trial058.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T12:01:54.706 INFO:teuthology.orchestra.run.trial058.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T12:01:54.706 INFO:teuthology.orchestra.run.trial058.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T12:01:54.706 INFO:teuthology.orchestra.run.trial058.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T12:01:54.707 INFO:teuthology.orchestra.run.trial058.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T12:01:54.707 INFO:teuthology.orchestra.run.trial058.stdout: libradosstriper1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 263 k 2026-02-20T12:01:54.707 INFO:teuthology.orchestra.run.trial058.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T12:01:54.707 INFO:teuthology.orchestra.run.trial058.stdout: librgw2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.6 M 2026-02-20T12:01:54.707 INFO:teuthology.orchestra.run.trial058.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T12:01:54.707 INFO:teuthology.orchestra.run.trial058.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T12:01:54.707 INFO:teuthology.orchestra.run.trial058.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T12:01:54.707 INFO:teuthology.orchestra.run.trial058.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T12:01:54.707 INFO:teuthology.orchestra.run.trial058.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T12:01:54.707 INFO:teuthology.orchestra.run.trial058.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T12:01:54.707 INFO:teuthology.orchestra.run.trial058.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T12:01:54.707 INFO:teuthology.orchestra.run.trial058.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T12:01:54.707 INFO:teuthology.orchestra.run.trial058.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T12:01:54.708 INFO:teuthology.orchestra.run.trial058.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T12:01:54.708 INFO:teuthology.orchestra.run.trial058.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T12:01:54.708 INFO:teuthology.orchestra.run.trial058.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T12:01:54.708 INFO:teuthology.orchestra.run.trial058.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T12:01:54.708 INFO:teuthology.orchestra.run.trial058.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T12:01:54.708 INFO:teuthology.orchestra.run.trial058.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T12:01:54.708 INFO:teuthology.orchestra.run.trial058.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T12:01:54.708 INFO:teuthology.orchestra.run.trial058.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T12:01:54.708 INFO:teuthology.orchestra.run.trial058.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T12:01:54.708 INFO:teuthology.orchestra.run.trial058.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T12:01:54.708 INFO:teuthology.orchestra.run.trial058.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T12:01:54.708 INFO:teuthology.orchestra.run.trial058.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T12:01:54.708 INFO:teuthology.orchestra.run.trial058.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T12:01:54.709 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-argparse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 45 k 2026-02-20T12:01:54.709 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 185 k 2026-02-20T12:01:54.709 INFO:teuthology.orchestra.run.trial058.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T12:01:54.709 INFO:teuthology.orchestra.run.trial058.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T12:01:54.709 INFO:teuthology.orchestra.run.trial058.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T12:01:54.709 INFO:teuthology.orchestra.run.trial058.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T12:01:54.709 INFO:teuthology.orchestra.run.trial058.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T12:01:54.709 INFO:teuthology.orchestra.run.trial058.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T12:01:54.709 INFO:teuthology.orchestra.run.trial058.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T12:01:54.709 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T12:01:54.709 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T12:01:54.709 INFO:teuthology.orchestra.run.trial058.stdout: python3-iniconfig noarch 1.1.1-7.el9 appstream 17 k 2026-02-20T12:01:54.709 INFO:teuthology.orchestra.run.trial058.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T12:01:54.710 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T12:01:54.710 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T12:01:54.710 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T12:01:54.710 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T12:01:54.710 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T12:01:54.710 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T12:01:54.710 INFO:teuthology.orchestra.run.trial058.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T12:01:54.710 INFO:teuthology.orchestra.run.trial058.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T12:01:54.710 INFO:teuthology.orchestra.run.trial058.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T12:01:54.710 INFO:teuthology.orchestra.run.trial058.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T12:01:54.710 INFO:teuthology.orchestra.run.trial058.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T12:01:54.710 INFO:teuthology.orchestra.run.trial058.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T12:01:54.710 INFO:teuthology.orchestra.run.trial058.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T12:01:54.711 INFO:teuthology.orchestra.run.trial058.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T12:01:54.711 INFO:teuthology.orchestra.run.trial058.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T12:01:54.711 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T12:01:54.711 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T12:01:54.711 INFO:teuthology.orchestra.run.trial058.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T12:01:54.711 INFO:teuthology.orchestra.run.trial058.stdout: python3-pluggy noarch 0.13.1-7.el9 appstream 41 k 2026-02-20T12:01:54.711 INFO:teuthology.orchestra.run.trial058.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T12:01:54.711 INFO:teuthology.orchestra.run.trial058.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T12:01:54.711 INFO:teuthology.orchestra.run.trial058.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T12:01:54.711 INFO:teuthology.orchestra.run.trial058.stdout: python3-py noarch 1.10.0-6.el9 appstream 477 k 2026-02-20T12:01:54.711 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T12:01:54.711 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T12:01:54.711 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T12:01:54.712 INFO:teuthology.orchestra.run.trial058.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T12:01:54.712 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T12:01:54.712 INFO:teuthology.orchestra.run.trial058.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T12:01:54.712 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T12:01:54.712 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T12:01:54.712 INFO:teuthology.orchestra.run.trial058.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T12:01:54.712 INFO:teuthology.orchestra.run.trial058.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T12:01:54.712 INFO:teuthology.orchestra.run.trial058.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T12:01:54.712 INFO:teuthology.orchestra.run.trial058.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T12:01:54.712 INFO:teuthology.orchestra.run.trial058.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T12:01:54.712 INFO:teuthology.orchestra.run.trial058.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T12:01:54.712 INFO:teuthology.orchestra.run.trial058.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T12:01:54.712 INFO:teuthology.orchestra.run.trial058.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T12:01:54.713 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T12:01:54.713 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T12:01:54.713 INFO:teuthology.orchestra.run.trial058.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T12:01:54.713 INFO:teuthology.orchestra.run.trial058.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T12:01:54.713 INFO:teuthology.orchestra.run.trial058.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T12:01:54.713 INFO:teuthology.orchestra.run.trial058.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T12:01:54.713 INFO:teuthology.orchestra.run.trial058.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T12:01:54.713 INFO:teuthology.orchestra.run.trial058.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T12:01:54.713 INFO:teuthology.orchestra.run.trial058.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T12:01:54.713 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T12:01:54.713 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T12:01:54.713 INFO:teuthology.orchestra.run.trial058.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T12:01:54.713 INFO:teuthology.orchestra.run.trial058.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T12:01:54.714 INFO:teuthology.orchestra.run.trial058.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T12:01:54.714 INFO:teuthology.orchestra.run.trial058.stdout:Installing weak dependencies: 2026-02-20T12:01:54.714 INFO:teuthology.orchestra.run.trial058.stdout: ceph-debugsource x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 12 M 2026-02-20T12:01:54.714 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 22 k 2026-02-20T12:01:54.714 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-daemon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T12:01:54.714 INFO:teuthology.orchestra.run.trial058.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T12:01:54.714 INFO:teuthology.orchestra.run.trial058.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T12:01:54.714 INFO:teuthology.orchestra.run.trial058.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T12:01:54.714 INFO:teuthology.orchestra.run.trial058.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T12:01:54.714 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:01:54.714 INFO:teuthology.orchestra.run.trial058.stdout:Transaction Summary 2026-02-20T12:01:54.714 INFO:teuthology.orchestra.run.trial058.stdout:======================================================================================= 2026-02-20T12:01:54.714 INFO:teuthology.orchestra.run.trial058.stdout:Install 156 Packages 2026-02-20T12:01:54.715 INFO:teuthology.orchestra.run.trial058.stdout:Upgrade 2 Packages 2026-02-20T12:01:54.715 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:01:54.715 INFO:teuthology.orchestra.run.trial058.stdout:Total download size: 869 M 2026-02-20T12:01:54.715 INFO:teuthology.orchestra.run.trial058.stdout:Downloading Packages: 2026-02-20T12:01:55.514 INFO:teuthology.orchestra.run.trial058.stdout:(1/158): ceph-20.3.0-5357.g0c3148ca.el9.x86_64. 30 kB/s | 6.5 kB 00:00 2026-02-20T12:01:56.042 INFO:teuthology.orchestra.run.trial058.stdout:(2/158): ceph-base-20.3.0-5357.g0c3148ca.el9.x8 6.8 MB/s | 5.1 MB 00:00 2026-02-20T12:01:56.094 INFO:teuthology.orchestra.run.trial058.stdout:(3/158): ceph-fuse-20.3.0-5357.g0c3148ca.el9.x8 17 MB/s | 914 kB 00:00 2026-02-20T12:01:56.115 INFO:teuthology.orchestra.run.trial058.stdout:(4/158): ceph-immutable-object-cache-20.3.0-535 6.7 MB/s | 149 kB 00:00 2026-02-20T12:01:56.216 INFO:teuthology.orchestra.run.trial058.stdout:(5/158): ceph-mds-20.3.0-5357.g0c3148ca.el9.x86 20 MB/s | 2.0 MB 00:00 2026-02-20T12:01:56.281 INFO:teuthology.orchestra.run.trial058.stdout:(6/158): ceph-mgr-20.3.0-5357.g0c3148ca.el9.x86 14 MB/s | 937 kB 00:00 2026-02-20T12:01:56.512 INFO:teuthology.orchestra.run.trial058.stdout:(7/158): ceph-mon-20.3.0-5357.g0c3148ca.el9.x86 21 MB/s | 4.9 MB 00:00 2026-02-20T12:01:56.549 INFO:teuthology.orchestra.run.trial058.stdout:(8/158): ceph-osd-20.3.0-5357.g0c3148ca.el9.x86 4.2 MB/s | 163 kB 00:00 2026-02-20T12:01:56.595 INFO:teuthology.orchestra.run.trial058.stdout:(9/158): ceph-common-20.3.0-5357.g0c3148ca.el9. 16 MB/s | 21 MB 00:01 2026-02-20T12:01:57.258 INFO:teuthology.orchestra.run.trial058.stdout:(10/158): ceph-osd-classic-20.3.0-5357.g0c3148c 21 MB/s | 15 MB 00:00 2026-02-20T12:01:57.670 INFO:teuthology.orchestra.run.trial058.stdout:(11/158): ceph-debugsource-20.3.0-5357.g0c3148c 5.6 MB/s | 12 MB 00:02 2026-02-20T12:01:58.555 INFO:teuthology.orchestra.run.trial058.stdout:(12/158): ceph-radosgw-20.3.0-5357.g0c3148ca.el 13 MB/s | 11 MB 00:00 2026-02-20T12:01:58.595 INFO:teuthology.orchestra.run.trial058.stdout:(13/158): ceph-selinux-20.3.0-5357.g0c3148ca.el 631 kB/s | 25 kB 00:00 2026-02-20T12:02:00.664 INFO:teuthology.orchestra.run.trial058.stdout:(14/158): ceph-osd-crimson-20.3.0-5357.g0c3148c 22 MB/s | 88 MB 00:04 2026-02-20T12:02:00.681 INFO:teuthology.orchestra.run.trial058.stdout:(15/158): libcephfs-daemon-20.3.0-5357.g0c3148c 2.1 MB/s | 37 kB 00:00 2026-02-20T12:02:00.722 INFO:teuthology.orchestra.run.trial058.stdout:(16/158): libcephfs-devel-20.3.0-5357.g0c3148ca 914 kB/s | 37 kB 00:00 2026-02-20T12:02:00.762 INFO:teuthology.orchestra.run.trial058.stdout:(17/158): libcephfs-proxy2-20.3.0-5357.g0c3148c 638 kB/s | 26 kB 00:00 2026-02-20T12:02:00.819 INFO:teuthology.orchestra.run.trial058.stdout:(18/158): libcephfs2-20.3.0-5357.g0c3148ca.el9. 15 MB/s | 860 kB 00:00 2026-02-20T12:02:00.863 INFO:teuthology.orchestra.run.trial058.stdout:(19/158): libcephsqlite-20.3.0-5357.g0c3148ca.e 3.4 MB/s | 153 kB 00:00 2026-02-20T12:02:00.906 INFO:teuthology.orchestra.run.trial058.stdout:(20/158): librados-devel-20.3.0-5357.g0c3148ca. 2.8 MB/s | 124 kB 00:00 2026-02-20T12:02:00.952 INFO:teuthology.orchestra.run.trial058.stdout:(21/158): libradosstriper1-20.3.0-5357.g0c3148c 5.6 MB/s | 263 kB 00:00 2026-02-20T12:02:01.252 INFO:teuthology.orchestra.run.trial058.stdout:(22/158): librgw2-20.3.0-5357.g0c3148ca.el9.x86 19 MB/s | 5.6 MB 00:00 2026-02-20T12:02:01.288 INFO:teuthology.orchestra.run.trial058.stdout:(23/158): python3-ceph-argparse-20.3.0-5357.g0c 1.2 MB/s | 45 kB 00:00 2026-02-20T12:02:01.331 INFO:teuthology.orchestra.run.trial058.stdout:(24/158): python3-ceph-common-20.3.0-5357.g0c31 4.2 MB/s | 185 kB 00:00 2026-02-20T12:02:01.373 INFO:teuthology.orchestra.run.trial058.stdout:(25/158): python3-cephfs-20.3.0-5357.g0c3148ca. 4.7 MB/s | 204 kB 00:00 2026-02-20T12:02:01.418 INFO:teuthology.orchestra.run.trial058.stdout:(26/158): python3-rados-20.3.0-5357.g0c3148ca.e 7.1 MB/s | 324 kB 00:00 2026-02-20T12:02:01.462 INFO:teuthology.orchestra.run.trial058.stdout:(27/158): python3-rbd-20.3.0-5357.g0c3148ca.el9 6.8 MB/s | 305 kB 00:00 2026-02-20T12:02:01.503 INFO:teuthology.orchestra.run.trial058.stdout:(28/158): python3-rgw-20.3.0-5357.g0c3148ca.el9 2.4 MB/s | 100 kB 00:00 2026-02-20T12:02:01.543 INFO:teuthology.orchestra.run.trial058.stdout:(29/158): rbd-fuse-20.3.0-5357.g0c3148ca.el9.x8 2.1 MB/s | 86 kB 00:00 2026-02-20T12:02:01.708 INFO:teuthology.orchestra.run.trial058.stdout:(30/158): rbd-mirror-20.3.0-5357.g0c3148ca.el9. 16 MB/s | 2.6 MB 00:00 2026-02-20T12:02:01.752 INFO:teuthology.orchestra.run.trial058.stdout:(31/158): rbd-nbd-20.3.0-5357.g0c3148ca.el9.x86 3.8 MB/s | 167 kB 00:00 2026-02-20T12:02:01.793 INFO:teuthology.orchestra.run.trial058.stdout:(32/158): ceph-grafana-dashboards-20.3.0-5357.g 1.4 MB/s | 57 kB 00:00 2026-02-20T12:02:01.836 INFO:teuthology.orchestra.run.trial058.stdout:(33/158): ceph-mgr-cephadm-20.3.0-5357.g0c3148c 4.1 MB/s | 184 kB 00:00 2026-02-20T12:02:05.765 INFO:teuthology.orchestra.run.trial058.stdout:(34/158): ceph-mgr-dashboard-20.3.0-5357.g0c314 13 MB/s | 51 MB 00:03 2026-02-20T12:02:06.229 INFO:teuthology.orchestra.run.trial058.stdout:(35/158): ceph-mgr-diskprediction-local-20.3.0- 16 MB/s | 7.4 MB 00:00 2026-02-20T12:02:06.264 INFO:teuthology.orchestra.run.trial058.stdout:(36/158): ceph-mgr-k8sevents-20.3.0-5357.g0c314 642 kB/s | 22 kB 00:00 2026-02-20T12:02:06.308 INFO:teuthology.orchestra.run.trial058.stdout:(37/158): ceph-mgr-modules-core-20.3.0-5357.g0c 6.6 MB/s | 297 kB 00:00 2026-02-20T12:02:06.353 INFO:teuthology.orchestra.run.trial058.stdout:(38/158): ceph-mgr-rook-20.3.0-5357.g0c3148ca.e 1.1 MB/s | 50 kB 00:00 2026-02-20T12:02:06.399 INFO:teuthology.orchestra.run.trial058.stdout:(39/158): ceph-prometheus-alerts-20.3.0-5357.g0 381 kB/s | 17 kB 00:00 2026-02-20T12:02:06.450 INFO:teuthology.orchestra.run.trial058.stdout:(40/158): ceph-volume-20.3.0-5357.g0c3148ca.el9 5.7 MB/s | 301 kB 00:00 2026-02-20T12:02:06.560 INFO:teuthology.orchestra.run.trial058.stdout:(41/158): cephadm-20.3.0-5357.g0c3148ca.el9.noa 9.3 MB/s | 1.0 MB 00:00 2026-02-20T12:02:07.556 INFO:teuthology.orchestra.run.trial058.stdout:(42/158): cryptsetup-2.8.1-3.el9.x86_64.rpm 352 kB/s | 351 kB 00:00 2026-02-20T12:02:08.128 INFO:teuthology.orchestra.run.trial058.stdout:(43/158): ceph-test-20.3.0-5357.g0c3148ca.el9.x 13 MB/s | 127 MB 00:09 2026-02-20T12:02:08.548 INFO:teuthology.orchestra.run.trial058.stdout:(44/158): ledmon-libs-1.1.0-3.el9.x86_64.rpm 96 kB/s | 40 kB 00:00 2026-02-20T12:02:08.647 INFO:teuthology.orchestra.run.trial058.stdout:(45/158): libatomic-11.5.0-14.el9.x86_64.rpm 231 kB/s | 23 kB 00:00 2026-02-20T12:02:08.824 INFO:teuthology.orchestra.run.trial058.stdout:(46/158): libconfig-1.7.2-9.el9.x86_64.rpm 407 kB/s | 72 kB 00:00 2026-02-20T12:02:09.786 INFO:teuthology.orchestra.run.trial058.stdout:(47/158): libgfortran-11.5.0-14.el9.x86_64.rpm 826 kB/s | 794 kB 00:00 2026-02-20T12:02:10.042 INFO:teuthology.orchestra.run.trial058.stdout:(48/158): libquadmath-11.5.0-14.el9.x86_64.rpm 721 kB/s | 184 kB 00:00 2026-02-20T12:02:10.054 INFO:teuthology.orchestra.run.trial058.stdout:(49/158): hwloc-libs-2.4.1-6.el9.x86_64.rpm 860 kB/s | 2.1 MB 00:02 2026-02-20T12:02:10.172 INFO:teuthology.orchestra.run.trial058.stdout:(50/158): mailcap-2.1.49-5.el9.noarch.rpm 281 kB/s | 33 kB 00:00 2026-02-20T12:02:10.220 INFO:teuthology.orchestra.run.trial058.stdout:(51/158): lksctp-tools-1.0.19-2.el9.x86_64.rpm 530 kB/s | 94 kB 00:00 2026-02-20T12:02:10.397 INFO:teuthology.orchestra.run.trial058.stdout:(52/158): pciutils-3.7.0-7.el9.x86_64.rpm 525 kB/s | 93 kB 00:00 2026-02-20T12:02:10.733 INFO:teuthology.orchestra.run.trial058.stdout:(53/158): python3-cffi-1.14.5-5.el9.x86_64.rpm 754 kB/s | 253 kB 00:00 2026-02-20T12:02:11.530 INFO:teuthology.orchestra.run.trial058.stdout:(54/158): nvme-cli-2.16-1.el9.x86_64.rpm 868 kB/s | 1.2 MB 00:01 2026-02-20T12:02:11.709 INFO:teuthology.orchestra.run.trial058.stdout:(55/158): python3-ply-3.11-14.el9.noarch.rpm 598 kB/s | 106 kB 00:00 2026-02-20T12:02:11.887 INFO:teuthology.orchestra.run.trial058.stdout:(56/158): python3-pycparser-2.20-6.el9.noarch.r 757 kB/s | 135 kB 00:00 2026-02-20T12:02:12.144 INFO:teuthology.orchestra.run.trial058.stdout:(57/158): python3-pyparsing-2.4.7-9.el9.noarch. 587 kB/s | 150 kB 00:00 2026-02-20T12:02:12.248 INFO:teuthology.orchestra.run.trial058.stdout:(58/158): python3-cryptography-36.0.1-5.el9.x86 842 kB/s | 1.2 MB 00:01 2026-02-20T12:02:12.323 INFO:teuthology.orchestra.run.trial058.stdout:(59/158): python3-requests-2.25.1-10.el9.noarch 707 kB/s | 126 kB 00:00 2026-02-20T12:02:12.578 INFO:teuthology.orchestra.run.trial058.stdout:(60/158): unzip-6.0-59.el9.x86_64.rpm 711 kB/s | 182 kB 00:00 2026-02-20T12:02:12.583 INFO:teuthology.orchestra.run.trial058.stdout:(61/158): python3-urllib3-1.26.5-7.el9.noarch.r 650 kB/s | 218 kB 00:00 2026-02-20T12:02:12.914 INFO:teuthology.orchestra.run.trial058.stdout:(62/158): zip-3.0-35.el9.x86_64.rpm 793 kB/s | 266 kB 00:00 2026-02-20T12:02:12.983 INFO:teuthology.orchestra.run.trial058.stdout:(63/158): flexiblas-3.0.4-9.el9.x86_64.rpm 426 kB/s | 30 kB 00:00 2026-02-20T12:02:12.997 INFO:teuthology.orchestra.run.trial058.stdout:(64/158): boost-program-options-1.75.0-13.el9.x 251 kB/s | 104 kB 00:00 2026-02-20T12:02:13.066 INFO:teuthology.orchestra.run.trial058.stdout:(65/158): flexiblas-openblas-openmp-3.0.4-9.el9 216 kB/s | 15 kB 00:00 2026-02-20T12:02:13.229 INFO:teuthology.orchestra.run.trial058.stdout:(66/158): libasan8-15.2.1-7.el9.x86_64.rpm 3.1 MB/s | 525 kB 00:00 2026-02-20T12:02:13.236 INFO:teuthology.orchestra.run.trial058.stdout:(67/158): flexiblas-netlib-3.0.4-9.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2026-02-20T12:02:13.351 INFO:teuthology.orchestra.run.trial058.stdout:(68/158): libnbd-1.20.3-4.el9.x86_64.rpm 1.3 MB/s | 164 kB 00:00 2026-02-20T12:02:13.351 INFO:teuthology.orchestra.run.trial058.stdout:(69/158): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2026-02-20T12:02:13.453 INFO:teuthology.orchestra.run.trial058.stdout:(70/158): librabbitmq-0.11.0-7.el9.x86_64.rpm 441 kB/s | 45 kB 00:00 2026-02-20T12:02:13.514 INFO:teuthology.orchestra.run.trial058.stdout:(71/158): librdkafka-1.6.1-102.el9.x86_64.rpm 4.0 MB/s | 662 kB 00:00 2026-02-20T12:02:13.590 INFO:teuthology.orchestra.run.trial058.stdout:(72/158): libstoragemgmt-1.10.1-1.el9.x86_64.rp 1.8 MB/s | 246 kB 00:00 2026-02-20T12:02:13.632 INFO:teuthology.orchestra.run.trial058.stdout:(73/158): libubsan-11.5.0-14.el9.x86_64.rpm 1.5 MB/s | 176 kB 00:00 2026-02-20T12:02:13.727 INFO:teuthology.orchestra.run.trial058.stdout:(74/158): libxslt-1.1.34-12.el9.x86_64.rpm 1.7 MB/s | 233 kB 00:00 2026-02-20T12:02:13.770 INFO:teuthology.orchestra.run.trial058.stdout:(75/158): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2026-02-20T12:02:13.842 INFO:teuthology.orchestra.run.trial058.stdout:(76/158): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2026-02-20T12:02:13.862 INFO:teuthology.orchestra.run.trial058.stdout:(77/158): openblas-0.3.29-1.el9.x86_64.rpm 460 kB/s | 42 kB 00:00 2026-02-20T12:02:14.071 INFO:teuthology.orchestra.run.trial058.stdout:(78/158): protobuf-3.14.0-17.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2026-02-20T12:02:14.127 INFO:teuthology.orchestra.run.trial058.stdout:(79/158): openblas-openmp-0.3.29-1.el9.x86_64.r 19 MB/s | 5.3 MB 00:00 2026-02-20T12:02:14.264 INFO:teuthology.orchestra.run.trial058.stdout:(80/158): python3-devel-3.9.25-3.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2026-02-20T12:02:14.377 INFO:teuthology.orchestra.run.trial058.stdout:(81/158): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2026-02-20T12:02:14.441 INFO:teuthology.orchestra.run.trial058.stdout:(82/158): python3-iniconfig-1.1.1-7.el9.noarch. 98 kB/s | 17 kB 00:00 2026-02-20T12:02:14.513 INFO:teuthology.orchestra.run.trial058.stdout:(83/158): python3-jinja2-2.11.3-8.el9.noarch.rp 1.8 MB/s | 249 kB 00:00 2026-02-20T12:02:14.533 INFO:teuthology.orchestra.run.trial058.stdout:(84/158): python3-jmespath-1.0.1-1.el9.noarch.r 519 kB/s | 48 kB 00:00 2026-02-20T12:02:14.629 INFO:teuthology.orchestra.run.trial058.stdout:(85/158): python3-libstoragemgmt-1.10.1-1.el9.x 1.5 MB/s | 177 kB 00:00 2026-02-20T12:02:14.699 INFO:teuthology.orchestra.run.trial058.stdout:(86/158): python3-markupsafe-1.1.1-12.el9.x86_6 496 kB/s | 35 kB 00:00 2026-02-20T12:02:14.720 INFO:teuthology.orchestra.run.trial058.stdout:(87/158): python3-lxml-4.6.5-3.el9.x86_64.rpm 6.6 MB/s | 1.2 MB 00:00 2026-02-20T12:02:14.879 INFO:teuthology.orchestra.run.trial058.stdout:(88/158): python3-numpy-f2py-1.23.5-2.el9.x86_6 2.7 MB/s | 442 kB 00:00 2026-02-20T12:02:14.998 INFO:teuthology.orchestra.run.trial058.stdout:(89/158): python3-packaging-20.9-5.el9.noarch.r 647 kB/s | 77 kB 00:00 2026-02-20T12:02:15.008 INFO:teuthology.orchestra.run.trial058.stdout:(90/158): python3-numpy-1.23.5-2.el9.x86_64.rpm 20 MB/s | 6.1 MB 00:00 2026-02-20T12:02:15.145 INFO:teuthology.orchestra.run.trial058.stdout:(91/158): python3-protobuf-3.14.0-17.el9.noarch 1.9 MB/s | 267 kB 00:00 2026-02-20T12:02:15.150 INFO:teuthology.orchestra.run.trial058.stdout:(92/158): python3-pluggy-0.13.1-7.el9.noarch.rp 273 kB/s | 41 kB 00:00 2026-02-20T12:02:15.264 INFO:teuthology.orchestra.run.trial058.stdout:(93/158): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2026-02-20T12:02:15.359 INFO:teuthology.orchestra.run.trial058.stdout:(94/158): python3-py-1.10.0-6.el9.noarch.rpm 2.2 MB/s | 477 kB 00:00 2026-02-20T12:02:15.401 INFO:teuthology.orchestra.run.trial058.stdout:(95/158): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2026-02-20T12:02:15.493 INFO:teuthology.orchestra.run.trial058.stdout:(96/158): python3-requests-oauthlib-1.3.0-12.el 586 kB/s | 54 kB 00:00 2026-02-20T12:02:15.560 INFO:teuthology.orchestra.run.trial058.stdout:(97/158): python3-pytest-6.2.2-7.el9.noarch.rpm 2.5 MB/s | 519 kB 00:00 2026-02-20T12:02:15.647 INFO:teuthology.orchestra.run.trial058.stdout:(98/158): python3-toml-0.10.2-6.el9.noarch.rpm 480 kB/s | 42 kB 00:00 2026-02-20T12:02:15.783 INFO:teuthology.orchestra.run.trial058.stdout:(99/158): qatlib-25.08.0-2.el9.x86_64.rpm 1.7 MB/s | 240 kB 00:00 2026-02-20T12:02:15.866 INFO:teuthology.orchestra.run.trial058.stdout:(100/158): qatlib-service-25.08.0-2.el9.x86_64. 446 kB/s | 37 kB 00:00 2026-02-20T12:02:15.959 INFO:teuthology.orchestra.run.trial058.stdout:(101/158): qatzip-libs-1.3.1-1.el9.x86_64.rpm 712 kB/s | 66 kB 00:00 2026-02-20T12:02:16.042 INFO:teuthology.orchestra.run.trial058.stdout:(102/158): python3-scipy-1.9.3-2.el9.x86_64.rpm 35 MB/s | 19 MB 00:00 2026-02-20T12:02:16.098 INFO:teuthology.orchestra.run.trial058.stdout:(103/158): socat-1.7.4.1-8.el9.x86_64.rpm 2.1 MB/s | 303 kB 00:00 2026-02-20T12:02:16.158 INFO:teuthology.orchestra.run.trial058.stdout:(104/158): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.6 MB/s | 189 kB 00:00 2026-02-20T12:02:16.191 INFO:teuthology.orchestra.run.trial058.stdout:(105/158): xmlsec1-openssl-1.2.29-13.el9.x86_64 981 kB/s | 90 kB 00:00 2026-02-20T12:02:16.233 INFO:teuthology.orchestra.run.trial058.stdout:(106/158): lua-devel-5.4.4-4.el9.x86_64.rpm 528 kB/s | 22 kB 00:00 2026-02-20T12:02:16.249 INFO:teuthology.orchestra.run.trial058.stdout:(107/158): xmlstarlet-1.6.1-20.el9.x86_64.rpm 695 kB/s | 64 kB 00:00 2026-02-20T12:02:16.319 INFO:teuthology.orchestra.run.trial058.stdout:(108/158): protobuf-compiler-3.14.0-17.el9.x86_ 9.9 MB/s | 862 kB 00:00 2026-02-20T12:02:16.506 INFO:teuthology.orchestra.run.trial058.stdout:(109/158): gperftools-libs-2.9.1-3.el9.x86_64.r 1.6 MB/s | 308 kB 00:00 2026-02-20T12:02:16.536 INFO:teuthology.orchestra.run.trial058.stdout:(110/158): grpc-data-1.46.7-10.el9.noarch.rpm 653 kB/s | 19 kB 00:00 2026-02-20T12:02:16.550 INFO:teuthology.orchestra.run.trial058.stdout:(111/158): abseil-cpp-20211102.0-4.el9.x86_64.r 1.8 MB/s | 551 kB 00:00 2026-02-20T12:02:16.583 INFO:teuthology.orchestra.run.trial058.stdout:(112/158): libarrow-doc-9.0.0-15.el9.noarch.rpm 764 kB/s | 25 kB 00:00 2026-02-20T12:02:16.615 INFO:teuthology.orchestra.run.trial058.stdout:(113/158): liboath-2.6.12-1.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2026-02-20T12:02:16.654 INFO:teuthology.orchestra.run.trial058.stdout:(114/158): libunwind-1.6.2-1.el9.x86_64.rpm 1.7 MB/s | 67 kB 00:00 2026-02-20T12:02:16.686 INFO:teuthology.orchestra.run.trial058.stdout:(115/158): luarocks-3.9.2-5.el9.noarch.rpm 4.6 MB/s | 151 kB 00:00 2026-02-20T12:02:16.744 INFO:teuthology.orchestra.run.trial058.stdout:(116/158): libarrow-9.0.0-15.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2026-02-20T12:02:16.752 INFO:teuthology.orchestra.run.trial058.stdout:(117/158): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-20T12:02:16.785 INFO:teuthology.orchestra.run.trial058.stdout:(118/158): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2026-02-20T12:02:16.786 INFO:teuthology.orchestra.run.trial058.stdout:(119/158): python3-autocommand-2.2.2-8.el9.noar 879 kB/s | 29 kB 00:00 2026-02-20T12:02:16.816 INFO:teuthology.orchestra.run.trial058.stdout:(120/158): python3-backports-tarfile-1.2.0-1.el 1.9 MB/s | 60 kB 00:00 2026-02-20T12:02:16.818 INFO:teuthology.orchestra.run.trial058.stdout:(121/158): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2026-02-20T12:02:16.847 INFO:teuthology.orchestra.run.trial058.stdout:(122/158): python3-cachetools-4.2.4-1.el9.noarc 1.0 MB/s | 32 kB 00:00 2026-02-20T12:02:16.851 INFO:teuthology.orchestra.run.trial058.stdout:(123/158): python3-certifi-2023.05.07-4.el9.noa 437 kB/s | 14 kB 00:00 2026-02-20T12:02:16.880 INFO:teuthology.orchestra.run.trial058.stdout:(124/158): python3-cheroot-10.0.1-4.el9.noarch. 5.2 MB/s | 173 kB 00:00 2026-02-20T12:02:16.890 INFO:teuthology.orchestra.run.trial058.stdout:(125/158): python3-cherrypy-18.6.1-2.el9.noarch 8.9 MB/s | 358 kB 00:00 2026-02-20T12:02:16.915 INFO:teuthology.orchestra.run.trial058.stdout:(126/158): python3-google-auth-2.45.0-1.el9.noa 7.1 MB/s | 254 kB 00:00 2026-02-20T12:02:16.947 INFO:teuthology.orchestra.run.trial058.stdout:(127/158): python3-grpcio-tools-1.46.7-10.el9.x 4.4 MB/s | 144 kB 00:00 2026-02-20T12:02:16.980 INFO:teuthology.orchestra.run.trial058.stdout:(128/158): python3-influxdb-5.3.1-1.el9.noarch. 4.2 MB/s | 139 kB 00:00 2026-02-20T12:02:16.991 INFO:teuthology.orchestra.run.trial058.stdout:(129/158): python3-grpcio-1.46.7-10.el9.x86_64. 20 MB/s | 2.0 MB 00:00 2026-02-20T12:02:17.010 INFO:teuthology.orchestra.run.trial058.stdout:(130/158): python3-isodate-0.6.1-3.el9.noarch.r 1.8 MB/s | 56 kB 00:00 2026-02-20T12:02:17.024 INFO:teuthology.orchestra.run.trial058.stdout:(131/158): python3-jaraco-8.2.1-3.el9.noarch.rp 328 kB/s | 11 kB 00:00 2026-02-20T12:02:17.041 INFO:teuthology.orchestra.run.trial058.stdout:(132/158): python3-jaraco-classes-3.2.1-5.el9.n 579 kB/s | 18 kB 00:00 2026-02-20T12:02:17.056 INFO:teuthology.orchestra.run.trial058.stdout:(133/158): python3-jaraco-collections-3.0.0-8.e 713 kB/s | 23 kB 00:00 2026-02-20T12:02:17.071 INFO:teuthology.orchestra.run.trial058.stdout:(134/158): python3-jaraco-context-6.0.1-3.el9.n 651 kB/s | 20 kB 00:00 2026-02-20T12:02:17.089 INFO:teuthology.orchestra.run.trial058.stdout:(135/158): python3-jaraco-functools-3.5.0-2.el9 601 kB/s | 19 kB 00:00 2026-02-20T12:02:17.102 INFO:teuthology.orchestra.run.trial058.stdout:(136/158): python3-jaraco-text-4.0.0-2.el9.noar 872 kB/s | 26 kB 00:00 2026-02-20T12:02:17.155 INFO:teuthology.orchestra.run.trial058.stdout:(137/158): python3-kubernetes-26.1.0-3.el9.noar 15 MB/s | 1.0 MB 00:00 2026-02-20T12:02:17.164 INFO:teuthology.orchestra.run.trial058.stdout:(138/158): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2026-02-20T12:02:17.189 INFO:teuthology.orchestra.run.trial058.stdout:(139/158): python3-msgpack-1.0.3-2.el9.x86_64.r 2.5 MB/s | 86 kB 00:00 2026-02-20T12:02:17.195 INFO:teuthology.orchestra.run.trial058.stdout:(140/158): python3-natsort-7.1.1-5.el9.noarch.r 1.8 MB/s | 58 kB 00:00 2026-02-20T12:02:17.226 INFO:teuthology.orchestra.run.trial058.stdout:(141/158): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.8 MB/s | 90 kB 00:00 2026-02-20T12:02:17.232 INFO:teuthology.orchestra.run.trial058.stdout:(142/158): python3-portend-3.1.0-2.el9.noarch.r 384 kB/s | 16 kB 00:00 2026-02-20T12:02:17.257 INFO:teuthology.orchestra.run.trial058.stdout:(143/158): python3-repoze-lru-0.7-16.el9.noarch 1.0 MB/s | 31 kB 00:00 2026-02-20T12:02:17.265 INFO:teuthology.orchestra.run.trial058.stdout:(144/158): python3-routes-2.5.1-5.el9.noarch.rp 5.6 MB/s | 188 kB 00:00 2026-02-20T12:02:17.288 INFO:teuthology.orchestra.run.trial058.stdout:(145/158): python3-rsa-4.9-2.el9.noarch.rpm 1.9 MB/s | 59 kB 00:00 2026-02-20T12:02:17.299 INFO:teuthology.orchestra.run.trial058.stdout:(146/158): python3-saml-1.16.0-1.el9.noarch.rpm 3.6 MB/s | 125 kB 00:00 2026-02-20T12:02:17.318 INFO:teuthology.orchestra.run.trial058.stdout:(147/158): python3-tempora-5.0.0-2.el9.noarch.r 1.2 MB/s | 36 kB 00:00 2026-02-20T12:02:17.345 INFO:teuthology.orchestra.run.trial058.stdout:(148/158): python3-typing-extensions-4.15.0-1.e 1.9 MB/s | 86 kB 00:00 2026-02-20T12:02:17.349 INFO:teuthology.orchestra.run.trial058.stdout:(149/158): python3-websocket-client-1.2.3-2.el9 2.8 MB/s | 90 kB 00:00 2026-02-20T12:02:17.378 INFO:teuthology.orchestra.run.trial058.stdout:(150/158): python3-xmlsec-1.3.13-1.el9.x86_64.r 1.4 MB/s | 48 kB 00:00 2026-02-20T12:02:17.380 INFO:teuthology.orchestra.run.trial058.stdout:(151/158): python3-xmltodict-0.12.0-15.el9.noar 730 kB/s | 22 kB 00:00 2026-02-20T12:02:17.410 INFO:teuthology.orchestra.run.trial058.stdout:(152/158): python3-zc-lockfile-2.0-10.el9.noarc 615 kB/s | 20 kB 00:00 2026-02-20T12:02:17.412 INFO:teuthology.orchestra.run.trial058.stdout:(153/158): re2-20211101-20.el9.x86_64.rpm 5.8 MB/s | 191 kB 00:00 2026-02-20T12:02:17.444 INFO:teuthology.orchestra.run.trial058.stdout:(154/158): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.8 MB/s | 122 kB 00:00 2026-02-20T12:02:17.483 INFO:teuthology.orchestra.run.trial058.stdout:(155/158): thrift-0.15.0-4.el9.x86_64.rpm 22 MB/s | 1.6 MB 00:00 2026-02-20T12:02:18.255 INFO:teuthology.orchestra.run.trial058.stdout:(156/158): librbd1-20.3.0-5357.g0c3148ca.el9.x8 3.5 MB/s | 2.7 MB 00:00 2026-02-20T12:02:18.267 INFO:teuthology.orchestra.run.trial058.stdout:(157/158): librados2-20.3.0-5357.g0c3148ca.el9. 4.0 MB/s | 3.3 MB 00:00 2026-02-20T12:03:00.729 INFO:teuthology.orchestra.run.trial058.stdout:(158/158): ceph-osd-crimson-debuginfo-20.3.0-53 6.8 MB/s | 433 MB 01:03 2026-02-20T12:03:00.732 INFO:teuthology.orchestra.run.trial058.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:03:00.732 INFO:teuthology.orchestra.run.trial058.stdout:Total 13 MB/s | 869 MB 01:06 2026-02-20T12:03:01.285 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction check 2026-02-20T12:03:01.339 INFO:teuthology.orchestra.run.trial058.stdout:Transaction check succeeded. 2026-02-20T12:03:01.340 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction test 2026-02-20T12:03:04.109 INFO:teuthology.orchestra.run.trial058.stdout:Transaction test succeeded. 2026-02-20T12:03:04.109 INFO:teuthology.orchestra.run.trial058.stdout:Running transaction 2026-02-20T12:03:06.947 INFO:teuthology.orchestra.run.trial058.stdout: Preparing : 1/1 2026-02-20T12:03:06.950 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/160 2026-02-20T12:03:06.958 INFO:teuthology.orchestra.run.trial058.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/160 2026-02-20T12:03:06.971 INFO:teuthology.orchestra.run.trial058.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/160 2026-02-20T12:03:07.116 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2026-02-20T12:03:07.118 INFO:teuthology.orchestra.run.trial058.stdout: Upgrading : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/160 2026-02-20T12:03:07.165 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/160 2026-02-20T12:03:07.166 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 6/160 2026-02-20T12:03:07.176 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 6/160 2026-02-20T12:03:07.178 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86 7/160 2026-02-20T12:03:07.179 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86 8/160 2026-02-20T12:03:07.206 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86 8/160 2026-02-20T12:03:07.212 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 9/160 2026-02-20T12:03:07.220 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 10/160 2026-02-20T12:03:07.224 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 11/160 2026-02-20T12:03:07.227 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 12/160 2026-02-20T12:03:07.228 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 13/160 2026-02-20T12:03:07.233 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 14/160 2026-02-20T12:03:07.348 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 15/160 2026-02-20T12:03:07.349 INFO:teuthology.orchestra.run.trial058.stdout: Upgrading : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 16/160 2026-02-20T12:03:07.392 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 16/160 2026-02-20T12:03:07.398 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 17/160 2026-02-20T12:03:07.406 INFO:teuthology.orchestra.run.trial058.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 18/160 2026-02-20T12:03:07.406 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 19/160 2026-02-20T12:03:07.430 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 19/160 2026-02-20T12:03:07.430 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86 20/160 2026-02-20T12:03:07.443 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86 20/160 2026-02-20T12:03:07.446 INFO:teuthology.orchestra.run.trial058.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 21/160 2026-02-20T12:03:07.477 INFO:teuthology.orchestra.run.trial058.stdout: Installing : re2-1:20211101-20.el9.x86_64 22/160 2026-02-20T12:03:07.482 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 23/160 2026-02-20T12:03:07.486 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 24/160 2026-02-20T12:03:07.507 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 25/160 2026-02-20T12:03:07.513 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/160 2026-02-20T12:03:07.515 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2026-02-20T12:03:07.520 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 28/160 2026-02-20T12:03:07.521 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 29/160 2026-02-20T12:03:07.532 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 29/160 2026-02-20T12:03:07.536 INFO:teuthology.orchestra.run.trial058.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 30/160 2026-02-20T12:03:07.559 INFO:teuthology.orchestra.run.trial058.stdout: Installing : unzip-6.0-59.el9.x86_64 31/160 2026-02-20T12:03:07.572 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 32/160 2026-02-20T12:03:07.579 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 33/160 2026-02-20T12:03:07.582 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 34/160 2026-02-20T12:03:07.588 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 35/160 2026-02-20T12:03:07.590 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 36/160 2026-02-20T12:03:07.591 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 37/160 2026-02-20T12:03:07.601 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 38/160 2026-02-20T12:03:07.636 INFO:teuthology.orchestra.run.trial058.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 39/160 2026-02-20T12:03:07.641 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9. 40/160 2026-02-20T12:03:07.652 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el 41/160 2026-02-20T12:03:07.663 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_6 42/160 2026-02-20T12:03:07.669 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 43/160 2026-02-20T12:03:07.693 INFO:teuthology.orchestra.run.trial058.stdout: Installing : zip-3.0-35.el9.x86_64 44/160 2026-02-20T12:03:07.696 INFO:teuthology.orchestra.run.trial058.stdout: Installing : luarocks-3.9.2-5.el9.noarch 45/160 2026-02-20T12:03:07.747 INFO:teuthology.orchestra.run.trial058.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 46/160 2026-02-20T12:03:07.759 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/160 2026-02-20T12:03:07.767 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/160 2026-02-20T12:03:07.770 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/160 2026-02-20T12:03:07.772 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/160 2026-02-20T12:03:07.776 INFO:teuthology.orchestra.run.trial058.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 51/160 2026-02-20T12:03:07.793 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 52/160 2026-02-20T12:03:07.798 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 53/160 2026-02-20T12:03:07.802 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/160 2026-02-20T12:03:07.809 INFO:teuthology.orchestra.run.trial058.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 55/160 2026-02-20T12:03:07.817 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_6 56/160 2026-02-20T12:03:07.828 INFO:teuthology.orchestra.run.trial058.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 57/160 2026-02-20T12:03:07.833 INFO:teuthology.orchestra.run.trial058.stdout: Installing : thrift-0.15.0-4.el9.x86_64 58/160 2026-02-20T12:03:07.836 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 59/160 2026-02-20T12:03:07.851 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 60/160 2026-02-20T12:03:07.855 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 61/160 2026-02-20T12:03:07.860 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 62/160 2026-02-20T12:03:07.872 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 63/160 2026-02-20T12:03:07.881 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 64/160 2026-02-20T12:03:07.887 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 65/160 2026-02-20T12:03:07.907 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 66/160 2026-02-20T12:03:07.918 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 67/160 2026-02-20T12:03:07.933 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 68/160 2026-02-20T12:03:07.938 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 69/160 2026-02-20T12:03:07.946 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/160 2026-02-20T12:03:07.985 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/160 2026-02-20T12:03:08.310 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/160 2026-02-20T12:03:08.320 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/160 2026-02-20T12:03:08.324 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/160 2026-02-20T12:03:08.330 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/160 2026-02-20T12:03:08.336 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/160 2026-02-20T12:03:08.340 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 77/160 2026-02-20T12:03:08.343 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/160 2026-02-20T12:03:08.349 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 79/160 2026-02-20T12:03:08.351 INFO:teuthology.orchestra.run.trial058.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 80/160 2026-02-20T12:03:08.353 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 81/160 2026-02-20T12:03:08.382 INFO:teuthology.orchestra.run.trial058.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 82/160 2026-02-20T12:03:08.426 INFO:teuthology.orchestra.run.trial058.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 83/160 2026-02-20T12:03:08.436 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 84/160 2026-02-20T12:03:08.482 INFO:teuthology.orchestra.run.trial058.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 85/160 2026-02-20T12:03:08.511 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-py-1.10.0-6.el9.noarch 86/160 2026-02-20T12:03:08.521 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 87/160 2026-02-20T12:03:08.528 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 88/160 2026-02-20T12:03:08.533 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pluggy-0.13.1-7.el9.noarch 89/160 2026-02-20T12:03:08.540 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 90/160 2026-02-20T12:03:08.544 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 91/160 2026-02-20T12:03:08.579 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-iniconfig-1.1.1-7.el9.noarch 92/160 2026-02-20T12:03:08.804 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 93/160 2026-02-20T12:03:08.828 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 94/160 2026-02-20T12:03:08.832 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 95/160 2026-02-20T12:03:08.890 INFO:teuthology.orchestra.run.trial058.stdout: Installing : openblas-0.3.29-1.el9.x86_64 96/160 2026-02-20T12:03:08.892 INFO:teuthology.orchestra.run.trial058.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 97/160 2026-02-20T12:03:08.913 INFO:teuthology.orchestra.run.trial058.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 98/160 2026-02-20T12:03:09.240 INFO:teuthology.orchestra.run.trial058.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 99/160 2026-02-20T12:03:09.313 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 100/160 2026-02-20T12:03:09.988 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 101/160 2026-02-20T12:03:10.003 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 102/160 2026-02-20T12:03:10.009 INFO:teuthology.orchestra.run.trial058.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 103/160 2026-02-20T12:03:10.258 INFO:teuthology.orchestra.run.trial058.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 104/160 2026-02-20T12:03:10.259 INFO:teuthology.orchestra.run.trial058.stdout: Installing : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 105/160 2026-02-20T12:03:10.277 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 105/160 2026-02-20T12:03:10.278 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 106/160 2026-02-20T12:03:11.218 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 107/160 2026-02-20T12:03:11.220 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 107/160 2026-02-20T12:03:11.237 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 107/160 2026-02-20T12:03:11.247 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 108/160 2026-02-20T12:03:11.254 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-packaging-20.9-5.el9.noarch 109/160 2026-02-20T12:03:11.268 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-ply-3.11-14.el9.noarch 110/160 2026-02-20T12:03:11.283 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 111/160 2026-02-20T12:03:11.360 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 112/160 2026-02-20T12:03:11.368 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 113/160 2026-02-20T12:03:11.392 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 114/160 2026-02-20T12:03:11.422 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 115/160 2026-02-20T12:03:11.473 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 116/160 2026-02-20T12:03:11.479 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 117/160 2026-02-20T12:03:11.483 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 118/160 2026-02-20T12:03:11.487 INFO:teuthology.orchestra.run.trial058.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 119/160 2026-02-20T12:03:11.489 INFO:teuthology.orchestra.run.trial058.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 120/160 2026-02-20T12:03:11.490 INFO:teuthology.orchestra.run.trial058.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 121/160 2026-02-20T12:03:11.507 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 121/160 2026-02-20T12:03:11.623 INFO:teuthology.orchestra.run.trial058.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 122/160 2026-02-20T12:03:11.625 INFO:teuthology.orchestra.run.trial058.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 123/160 2026-02-20T12:03:11.905 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 123/160 2026-02-20T12:03:11.905 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T12:03:11.905 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:03:12.166 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 124/160 2026-02-20T12:03:12.207 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 124/160 2026-02-20T12:03:12.207 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T12:03:12.207 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T12:03:12.208 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:03:12.210 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 125/160 2026-02-20T12:03:16.888 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 125/160 2026-02-20T12:03:16.888 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /sys 2026-02-20T12:03:16.889 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /proc 2026-02-20T12:03:16.889 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /mnt 2026-02-20T12:03:16.889 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /var/tmp 2026-02-20T12:03:16.889 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /home 2026-02-20T12:03:16.889 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /root 2026-02-20T12:03:16.889 INFO:teuthology.orchestra.run.trial058.stdout:skipping the directory /tmp 2026-02-20T12:03:16.889 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:03:16.977 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 126/160 2026-02-20T12:03:16.999 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 126/160 2026-02-20T12:03:16.999 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:03:16.999 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T12:03:16.999 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T12:03:17.000 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T12:03:17.000 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:03:17.204 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 127/160 2026-02-20T12:03:17.224 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 127/160 2026-02-20T12:03:17.224 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:03:17.225 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T12:03:17.225 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T12:03:17.225 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T12:03:17.225 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:03:17.231 INFO:teuthology.orchestra.run.trial058.stdout: Installing : mailcap-2.1.49-5.el9.noarch 128/160 2026-02-20T12:03:17.233 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 129/160 2026-02-20T12:03:17.249 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-20T12:03:17.249 INFO:teuthology.orchestra.run.trial058.stdout:Creating group 'qat' with GID 992. 2026-02-20T12:03:17.250 INFO:teuthology.orchestra.run.trial058.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T12:03:17.250 INFO:teuthology.orchestra.run.trial058.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T12:03:17.250 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:03:17.256 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-20T12:03:17.280 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 130/160 2026-02-20T12:03:17.280 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T12:03:17.281 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:03:17.316 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 131/160 2026-02-20T12:03:17.904 INFO:teuthology.orchestra.run.trial058.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 132/160 2026-02-20T12:03:23.303 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86 133/160 2026-02-20T12:03:23.367 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86 134/160 2026-02-20T12:03:23.369 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 135/160 2026-02-20T12:03:23.382 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 135/160 2026-02-20T12:03:23.383 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:03:23.383 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T12:03:23.383 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:03:23.393 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 136/160 2026-02-20T12:03:23.416 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 136/160 2026-02-20T12:03:23.416 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:03:23.416 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T12:03:23.416 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T12:03:23.417 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T12:03:23.417 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:03:23.476 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 137/160 2026-02-20T12:03:23.478 INFO:teuthology.orchestra.run.trial058.stdout: Installing : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 137/160 2026-02-20T12:03:23.488 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.e 138/160 2026-02-20T12:03:23.511 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca. 139/160 2026-02-20T12:03:23.513 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noa 140/160 2026-02-20T12:03:26.403 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noa 140/160 2026-02-20T12:03:26.410 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.n 141/160 2026-02-20T12:03:26.866 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.n 141/160 2026-02-20T12:03:26.866 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3 142/160 2026-02-20T12:03:26.879 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3 142/160 2026-02-20T12:03:26.880 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.n 143/160 2026-02-20T12:03:26.940 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.n 143/160 2026-02-20T12:03:26.980 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el 144/160 2026-02-20T12:03:26.981 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 145/160 2026-02-20T12:03:27.002 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 145/160 2026-02-20T12:03:27.002 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:03:27.002 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T12:03:27.002 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T12:03:27.002 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T12:03:27.003 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:03:27.015 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 146/160 2026-02-20T12:03:29.264 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 146/160 2026-02-20T12:03:51.529 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86 147/160 2026-02-20T12:03:51.530 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148 148/160 2026-02-20T12:03:52.011 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 149/160 2026-02-20T12:03:52.012 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 150/160 2026-02-20T12:03:52.034 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 150/160 2026-02-20T12:03:52.034 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:03:52.034 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T12:03:52.034 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T12:03:52.034 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T12:03:52.034 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:03:52.043 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5357.g0c314 151/160 2026-02-20T12:03:52.062 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5357.g0c314 151/160 2026-02-20T12:03:52.062 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:03:52.062 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T12:03:52.063 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:03:52.173 INFO:teuthology.orchestra.run.trial058.stdout: Installing : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 152/160 2026-02-20T12:03:52.192 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 152/160 2026-02-20T12:03:52.192 INFO:teuthology.orchestra.run.trial058.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:03:52.193 INFO:teuthology.orchestra.run.trial058.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T12:03:52.193 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T12:03:52.193 INFO:teuthology.orchestra.run.trial058.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T12:03:52.193 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:03:59.181 INFO:teuthology.orchestra.run.trial058.stdout: Installing : python3-pytest-6.2.2-7.el9.noarch 153/160 2026-02-20T12:03:59.191 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 154/160 2026-02-20T12:03:59.196 INFO:teuthology.orchestra.run.trial058.stdout: Installing : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_ 155/160 2026-02-20T12:03:59.204 INFO:teuthology.orchestra.run.trial058.stdout: Installing : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 156/160 2026-02-20T12:03:59.245 INFO:teuthology.orchestra.run.trial058.stdout: Installing : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 157/160 2026-02-20T12:03:59.248 INFO:teuthology.orchestra.run.trial058.stdout: Installing : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 158/160 2026-02-20T12:03:59.248 INFO:teuthology.orchestra.run.trial058.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/160 2026-02-20T12:03:59.260 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/160 2026-02-20T12:03:59.261 INFO:teuthology.orchestra.run.trial058.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-20T12:03:59.272 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-20T12:03:59.279 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86 160/160 2026-02-20T12:03:59.302 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86 160/160 2026-02-20T12:04:02.686 INFO:teuthology.orchestra.run.trial058.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86 4/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5357.g0c314 6/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 7/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 8/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 9/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 10/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86 11/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86 12/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148 13/160 2026-02-20T12:04:02.687 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 14/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 15/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 16/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86 17/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_ 18/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86 19/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 20/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_6 22/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86 23/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 24/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el 25/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9. 26/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_6 27/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 28/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 29/160 2026-02-20T12:04:02.688 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 30/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 31/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 32/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 33/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca. 34/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noa 35/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.n 36/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3 37/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.n 38/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el 39/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 40/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.e 41/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 42/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 43/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 44/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 45/160 2026-02-20T12:04:02.689 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 46/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 47/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 48/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 49/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 50/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 51/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 52/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 53/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 54/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 55/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 56/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-ply-3.11-14.el9.noarch 57/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 58/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 59/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 60/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 61/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : unzip-6.0-59.el9.x86_64 62/160 2026-02-20T12:04:02.690 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : zip-3.0-35.el9.x86_64 63/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 64/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 65/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 66/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 67/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 68/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 69/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 70/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 71/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 72/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 73/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 74/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 75/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 76/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lua-5.4.4-4.el9.x86_64 77/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 78/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 79/160 2026-02-20T12:04:02.691 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 80/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 81/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 82/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-iniconfig-1.1.1-7.el9.noarch 83/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 84/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 85/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 86/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 87/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 88/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 89/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 90/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 91/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pluggy-0.13.1-7.el9.noarch 92/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 93/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-py-1.10.0-6.el9.noarch 94/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 95/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 96/160 2026-02-20T12:04:02.692 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pytest-6.2.2-7.el9.noarch 97/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 98/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 99/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 100/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 101/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 102/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 103/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 104/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 105/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 106/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 107/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 108/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 109/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 110/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 111/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 112/160 2026-02-20T12:04:02.693 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 113/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 114/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 115/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 116/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 117/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 118/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 119/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 120/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 121/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 122/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 123/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 124/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 125/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 126/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 127/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 128/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 129/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 130/160 2026-02-20T12:04:02.694 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 131/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 132/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 133/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 134/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 135/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 136/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 137/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 138/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 139/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 140/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 141/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 142/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 143/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 144/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 145/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 146/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 147/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 148/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 149/160 2026-02-20T12:04:02.695 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 150/160 2026-02-20T12:04:02.696 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 151/160 2026-02-20T12:04:02.696 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 152/160 2026-02-20T12:04:02.696 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 153/160 2026-02-20T12:04:02.696 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : re2-1:20211101-20.el9.x86_64 154/160 2026-02-20T12:04:02.696 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 155/160 2026-02-20T12:04:02.696 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 156/160 2026-02-20T12:04:02.696 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 157/160 2026-02-20T12:04:02.696 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 158/160 2026-02-20T12:04:02.696 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 159/160 2026-02-20T12:04:02.753 INFO:teuthology.orchestra.run.trial058.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 160/160 2026-02-20T12:04:02.753 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:02.753 INFO:teuthology.orchestra.run.trial058.stdout:Upgraded: 2026-02-20T12:04:02.753 INFO:teuthology.orchestra.run.trial058.stdout: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.754 INFO:teuthology.orchestra.run.trial058.stdout: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.754 INFO:teuthology.orchestra.run.trial058.stdout:Installed: 2026-02-20T12:04:02.754 INFO:teuthology.orchestra.run.trial058.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T12:04:02.754 INFO:teuthology.orchestra.run.trial058.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T12:04:02.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T12:04:02.754 INFO:teuthology.orchestra.run.trial058.stdout: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T12:04:02.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T12:04:02.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T12:04:02.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T12:04:02.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T12:04:02.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T12:04:02.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.755 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.756 INFO:teuthology.orchestra.run.trial058.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.756 INFO:teuthology.orchestra.run.trial058.stdout: ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T12:04:02.756 INFO:teuthology.orchestra.run.trial058.stdout: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.756 INFO:teuthology.orchestra.run.trial058.stdout: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.756 INFO:teuthology.orchestra.run.trial058.stdout: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.756 INFO:teuthology.orchestra.run.trial058.stdout: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T12:04:02.756 INFO:teuthology.orchestra.run.trial058.stdout: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T12:04:02.756 INFO:teuthology.orchestra.run.trial058.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T12:04:02.756 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T12:04:02.756 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T12:04:02.757 INFO:teuthology.orchestra.run.trial058.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T12:04:02.757 INFO:teuthology.orchestra.run.trial058.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T12:04:02.757 INFO:teuthology.orchestra.run.trial058.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T12:04:02.757 INFO:teuthology.orchestra.run.trial058.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T12:04:02.757 INFO:teuthology.orchestra.run.trial058.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T12:04:02.757 INFO:teuthology.orchestra.run.trial058.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T12:04:02.757 INFO:teuthology.orchestra.run.trial058.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T12:04:02.757 INFO:teuthology.orchestra.run.trial058.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T12:04:02.757 INFO:teuthology.orchestra.run.trial058.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T12:04:02.757 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.757 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.757 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.758 INFO:teuthology.orchestra.run.trial058.stdout: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.758 INFO:teuthology.orchestra.run.trial058.stdout: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.758 INFO:teuthology.orchestra.run.trial058.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T12:04:02.758 INFO:teuthology.orchestra.run.trial058.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T12:04:02.758 INFO:teuthology.orchestra.run.trial058.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T12:04:02.758 INFO:teuthology.orchestra.run.trial058.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T12:04:02.758 INFO:teuthology.orchestra.run.trial058.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T12:04:02.758 INFO:teuthology.orchestra.run.trial058.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T12:04:02.758 INFO:teuthology.orchestra.run.trial058.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T12:04:02.758 INFO:teuthology.orchestra.run.trial058.stdout: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.758 INFO:teuthology.orchestra.run.trial058.stdout: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.758 INFO:teuthology.orchestra.run.trial058.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T12:04:02.758 INFO:teuthology.orchestra.run.trial058.stdout: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.759 INFO:teuthology.orchestra.run.trial058.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T12:04:02.759 INFO:teuthology.orchestra.run.trial058.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T12:04:02.759 INFO:teuthology.orchestra.run.trial058.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T12:04:02.759 INFO:teuthology.orchestra.run.trial058.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T12:04:02.759 INFO:teuthology.orchestra.run.trial058.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T12:04:02.759 INFO:teuthology.orchestra.run.trial058.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T12:04:02.759 INFO:teuthology.orchestra.run.trial058.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T12:04:02.759 INFO:teuthology.orchestra.run.trial058.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T12:04:02.759 INFO:teuthology.orchestra.run.trial058.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T12:04:02.759 INFO:teuthology.orchestra.run.trial058.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T12:04:02.759 INFO:teuthology.orchestra.run.trial058.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T12:04:02.759 INFO:teuthology.orchestra.run.trial058.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T12:04:02.759 INFO:teuthology.orchestra.run.trial058.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T12:04:02.760 INFO:teuthology.orchestra.run.trial058.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T12:04:02.760 INFO:teuthology.orchestra.run.trial058.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T12:04:02.760 INFO:teuthology.orchestra.run.trial058.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T12:04:02.760 INFO:teuthology.orchestra.run.trial058.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T12:04:02.760 INFO:teuthology.orchestra.run.trial058.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T12:04:02.760 INFO:teuthology.orchestra.run.trial058.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T12:04:02.760 INFO:teuthology.orchestra.run.trial058.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T12:04:02.760 INFO:teuthology.orchestra.run.trial058.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T12:04:02.760 INFO:teuthology.orchestra.run.trial058.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T12:04:02.760 INFO:teuthology.orchestra.run.trial058.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T12:04:02.761 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.761 INFO:teuthology.orchestra.run.trial058.stdout: python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.761 INFO:teuthology.orchestra.run.trial058.stdout: python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.761 INFO:teuthology.orchestra.run.trial058.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T12:04:02.761 INFO:teuthology.orchestra.run.trial058.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T12:04:02.761 INFO:teuthology.orchestra.run.trial058.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T12:04:02.761 INFO:teuthology.orchestra.run.trial058.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T12:04:02.761 INFO:teuthology.orchestra.run.trial058.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T12:04:02.761 INFO:teuthology.orchestra.run.trial058.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T12:04:02.761 INFO:teuthology.orchestra.run.trial058.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T12:04:02.761 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T12:04:02.761 INFO:teuthology.orchestra.run.trial058.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T12:04:02.761 INFO:teuthology.orchestra.run.trial058.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T12:04:02.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-iniconfig-1.1.1-7.el9.noarch 2026-02-20T12:04:02.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T12:04:02.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T12:04:02.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T12:04:02.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T12:04:02.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T12:04:02.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T12:04:02.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T12:04:02.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T12:04:02.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T12:04:02.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T12:04:02.762 INFO:teuthology.orchestra.run.trial058.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T12:04:02.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T12:04:02.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T12:04:02.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T12:04:02.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T12:04:02.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T12:04:02.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T12:04:02.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T12:04:02.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T12:04:02.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-pluggy-0.13.1-7.el9.noarch 2026-02-20T12:04:02.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T12:04:02.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T12:04:02.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T12:04:02.763 INFO:teuthology.orchestra.run.trial058.stdout: python3-py-1.10.0-6.el9.noarch 2026-02-20T12:04:02.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T12:04:02.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T12:04:02.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T12:04:02.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T12:04:02.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T12:04:02.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-pytest-6.2.2-7.el9.noarch 2026-02-20T12:04:02.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T12:04:02.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T12:04:02.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T12:04:02.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.764 INFO:teuthology.orchestra.run.trial058.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T12:04:02.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T12:04:02.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T12:04:02.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T12:04:02.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T12:04:02.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T12:04:02.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T12:04:02.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T12:04:02.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T12:04:02.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T12:04:02.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T12:04:02.765 INFO:teuthology.orchestra.run.trial058.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T12:04:02.765 INFO:teuthology.orchestra.run.trial058.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T12:04:02.765 INFO:teuthology.orchestra.run.trial058.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T12:04:02.766 INFO:teuthology.orchestra.run.trial058.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T12:04:02.766 INFO:teuthology.orchestra.run.trial058.stdout: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.766 INFO:teuthology.orchestra.run.trial058.stdout: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.766 INFO:teuthology.orchestra.run.trial058.stdout: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T12:04:02.766 INFO:teuthology.orchestra.run.trial058.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T12:04:02.766 INFO:teuthology.orchestra.run.trial058.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T12:04:02.766 INFO:teuthology.orchestra.run.trial058.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T12:04:02.766 INFO:teuthology.orchestra.run.trial058.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T12:04:02.766 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T12:04:02.766 INFO:teuthology.orchestra.run.trial058.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T12:04:02.766 INFO:teuthology.orchestra.run.trial058.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T12:04:02.766 INFO:teuthology.orchestra.run.trial058.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T12:04:02.766 INFO:teuthology.orchestra.run.trial058.stdout: zip-3.0-35.el9.x86_64 2026-02-20T12:04:02.767 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:02.767 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-20T12:04:02.907 DEBUG:teuthology.parallel:result is None 2026-02-20T12:04:02.908 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T12:04:03.162 DEBUG:teuthology.orchestra.run.trial058:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T12:04:03.185 INFO:teuthology.orchestra.run.trial058.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T12:04:03.185 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T12:04:03.185 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T12:04:03.188 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T12:04:03.188 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:03.188 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T12:04:03.251 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T12:04:03.251 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:03.251 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T12:04:03.315 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T12:04:03.379 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T12:04:03.379 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:03.379 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T12:04:03.443 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T12:04:03.507 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T12:04:03.507 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:03.507 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T12:04:03.571 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T12:04:03.635 INFO:teuthology.run_tasks:Running task pexec... 2026-02-20T12:04:03.652 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-20T12:04:03.653 DEBUG:teuthology.orchestra.run.trial058:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T12:04:03.677 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial058.front.sepia.ceph.com 2026-02-20T12:04:03.678 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T12:04:03.729 DEBUG:teuthology.parallel:result is None 2026-02-20T12:04:03.729 INFO:teuthology.run_tasks:Running task install... 2026-02-20T12:04:03.743 DEBUG:teuthology.task.install:project ceph 2026-02-20T12:04:03.743 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T12:04:03.743 DEBUG:teuthology.task.install:config {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T12:04:03.743 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T12:04:03.752 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T12:04:03.752 INFO:teuthology.task.install:extra packages: [] 2026-02-20T12:04:03.752 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': ['python3-pytest'], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T12:04:03.753 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T12:04:03.912 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T12:04:03.912 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T12:04:04.233 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T12:04:04.233 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:04.233 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T12:04:04.259 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-pytest on remote rpm x86_64 2026-02-20T12:04:04.260 DEBUG:teuthology.orchestra.run.trial058:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T12:04:04.323 DEBUG:teuthology.orchestra.run.trial058:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T12:04:04.388 DEBUG:teuthology.orchestra.run.trial058:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T12:04:04.444 INFO:teuthology.orchestra.run.trial058.stdout:check_obsoletes = 1 2026-02-20T12:04:04.453 DEBUG:teuthology.orchestra.run.trial058:> sudo yum clean all 2026-02-20T12:04:04.615 INFO:teuthology.orchestra.run.trial058.stdout:56 files removed 2026-02-20T12:04:04.629 DEBUG:teuthology.orchestra.run.trial058:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-pytest 2026-02-20T12:04:05.274 INFO:teuthology.orchestra.run.trial058.stdout:ceph packages for x86_64 189 kB/s | 94 kB 00:00 2026-02-20T12:04:05.756 INFO:teuthology.orchestra.run.trial058.stdout:ceph noarch packages 54 kB/s | 24 kB 00:00 2026-02-20T12:04:06.217 INFO:teuthology.orchestra.run.trial058.stdout:ceph source packages 4.7 kB/s | 2.1 kB 00:00 2026-02-20T12:04:07.123 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-20T12:04:10.373 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 27 MB 00:02 2026-02-20T12:04:14.401 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 7.8 MB 00:01 2026-02-20T12:04:15.515 INFO:teuthology.orchestra.run.trial058.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 20 kB 00:00 2026-02-20T12:04:16.146 INFO:teuthology.orchestra.run.trial058.stdout:Extra Packages for Enterprise Linux 36 MB/s | 20 MB 00:00 2026-02-20T12:04:19.284 INFO:teuthology.orchestra.run.trial058.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-20T12:04:20.459 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.460 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.460 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.460 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.461 INFO:teuthology.orchestra.run.trial058.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T12:04:20.461 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.461 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.462 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T12:04:20.462 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T12:04:20.463 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T12:04:20.463 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T12:04:20.464 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.464 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.464 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.465 INFO:teuthology.orchestra.run.trial058.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T12:04:20.465 INFO:teuthology.orchestra.run.trial058.stdout:Package librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.466 INFO:teuthology.orchestra.run.trial058.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.466 INFO:teuthology.orchestra.run.trial058.stdout:Package libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.467 INFO:teuthology.orchestra.run.trial058.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.467 INFO:teuthology.orchestra.run.trial058.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.468 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.468 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.468 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.469 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.469 INFO:teuthology.orchestra.run.trial058.stdout:Package rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.470 INFO:teuthology.orchestra.run.trial058.stdout:Package rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.470 INFO:teuthology.orchestra.run.trial058.stdout:Package rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T12:04:20.471 INFO:teuthology.orchestra.run.trial058.stdout:Package python3-pytest-6.2.2-7.el9.noarch is already installed. 2026-02-20T12:04:20.490 INFO:teuthology.orchestra.run.trial058.stdout:Dependencies resolved. 2026-02-20T12:04:20.490 INFO:teuthology.orchestra.run.trial058.stdout:Nothing to do. 2026-02-20T12:04:20.490 INFO:teuthology.orchestra.run.trial058.stdout:Complete! 2026-02-20T12:04:20.517 DEBUG:teuthology.parallel:result is None 2026-02-20T12:04:20.518 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T12:04:20.678 DEBUG:teuthology.orchestra.run.trial058:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T12:04:20.699 INFO:teuthology.orchestra.run.trial058.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T12:04:20.699 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T12:04:20.700 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T12:04:20.702 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-20T12:04:20.702 INFO:teuthology.run_tasks:Running task ceph... 2026-02-20T12:04:20.801 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-20T12:04:20.801 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 777 /var/log/ceph 2026-02-20T12:04:20.827 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-20T12:04:20.827 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T12:04:20.891 INFO:tasks.ceph:Creating extra log directories... 2026-02-20T12:04:20.891 DEBUG:teuthology.orchestra.run.trial058:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T12:04:20.965 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-20T12:04:20.965 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug alienstore': 20, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 20, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-20T12:04:20.966 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60610', 'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439', 'description': 'crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore tasks/rbd_python_api_tests_old_format}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '60610', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug alienstore': 20, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 20, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'slow request'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}}}, 'install': {'ceph': {'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}}, 'owner': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'priority': 101, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 1736, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '445d5c9ba18a4040e70e25303230c36c77773acb', 'targets': {'trial058.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJkg00aPqZtAlyMaBUY02WN/B3uqH3WDyvzCoZIb00xGQlpkuM8fMTI+o4C6/mir6hlrqy8VcIcadnK+wvw3kw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': ['python3-pytest'], 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug alienstore': 20, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 20, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'crimson_compat': True, 'flavor': 'debug', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'slow request'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rbd/test_librbd_python.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'reimage-ssh-down', 'teuthology_sha1': 'e6d9099ce03dc21193fda653159ec82465c3a94a', 'timestamp': '2026-02-20_10:21:31', 'tube': 'trial', 'user': 'jjperez', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699'} 2026-02-20T12:04:20.966 DEBUG:teuthology.orchestra.run.trial058:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T12:04:21.011 DEBUG:teuthology.orchestra.run.trial058:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T12:04:21.076 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:21.076 DEBUG:teuthology.orchestra.run.trial058:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T12:04:21.133 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T12:04:21.133 DEBUG:teuthology.orchestra.run.trial058:> stat /dev/vg_nvme/lv_1 2026-02-20T12:04:21.192 INFO:teuthology.orchestra.run.trial058.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T12:04:21.192 INFO:teuthology.orchestra.run.trial058.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T12:04:21.192 INFO:teuthology.orchestra.run.trial058.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-20T12:04:21.192 INFO:teuthology.orchestra.run.trial058.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T12:04:21.192 INFO:teuthology.orchestra.run.trial058.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T12:04:21.193 INFO:teuthology.orchestra.run.trial058.stdout:Access: 2026-02-20 12:03:59.506795037 +0000 2026-02-20T12:04:21.193 INFO:teuthology.orchestra.run.trial058.stdout:Modify: 2026-02-20 12:03:11.930542803 +0000 2026-02-20T12:04:21.193 INFO:teuthology.orchestra.run.trial058.stdout:Change: 2026-02-20 12:03:11.930542803 +0000 2026-02-20T12:04:21.193 INFO:teuthology.orchestra.run.trial058.stdout: Birth: 2026-02-20 12:03:11.930542803 +0000 2026-02-20T12:04:21.193 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T12:04:21.255 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records in 2026-02-20T12:04:21.255 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records out 2026-02-20T12:04:21.255 INFO:teuthology.orchestra.run.trial058.stderr:512 bytes copied, 0.000161652 s, 3.2 MB/s 2026-02-20T12:04:21.257 DEBUG:teuthology.orchestra.run.trial058:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T12:04:21.315 DEBUG:teuthology.orchestra.run.trial058:> stat /dev/vg_nvme/lv_2 2026-02-20T12:04:21.371 INFO:teuthology.orchestra.run.trial058.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T12:04:21.371 INFO:teuthology.orchestra.run.trial058.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T12:04:21.371 INFO:teuthology.orchestra.run.trial058.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-20T12:04:21.371 INFO:teuthology.orchestra.run.trial058.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T12:04:21.371 INFO:teuthology.orchestra.run.trial058.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T12:04:21.371 INFO:teuthology.orchestra.run.trial058.stdout:Access: 2026-02-20 12:03:59.507795018 +0000 2026-02-20T12:04:21.371 INFO:teuthology.orchestra.run.trial058.stdout:Modify: 2026-02-20 12:03:11.929542814 +0000 2026-02-20T12:04:21.371 INFO:teuthology.orchestra.run.trial058.stdout:Change: 2026-02-20 12:03:11.929542814 +0000 2026-02-20T12:04:21.371 INFO:teuthology.orchestra.run.trial058.stdout: Birth: 2026-02-20 12:03:11.929542814 +0000 2026-02-20T12:04:21.372 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T12:04:21.435 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records in 2026-02-20T12:04:21.435 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records out 2026-02-20T12:04:21.435 INFO:teuthology.orchestra.run.trial058.stderr:512 bytes copied, 0.000144751 s, 3.5 MB/s 2026-02-20T12:04:21.437 DEBUG:teuthology.orchestra.run.trial058:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T12:04:21.494 DEBUG:teuthology.orchestra.run.trial058:> stat /dev/vg_nvme/lv_3 2026-02-20T12:04:21.550 INFO:teuthology.orchestra.run.trial058.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T12:04:21.551 INFO:teuthology.orchestra.run.trial058.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T12:04:21.551 INFO:teuthology.orchestra.run.trial058.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-20T12:04:21.551 INFO:teuthology.orchestra.run.trial058.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T12:04:21.551 INFO:teuthology.orchestra.run.trial058.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T12:04:21.551 INFO:teuthology.orchestra.run.trial058.stdout:Access: 2026-02-20 12:03:59.507795018 +0000 2026-02-20T12:04:21.551 INFO:teuthology.orchestra.run.trial058.stdout:Modify: 2026-02-20 12:03:11.930542803 +0000 2026-02-20T12:04:21.551 INFO:teuthology.orchestra.run.trial058.stdout:Change: 2026-02-20 12:03:11.930542803 +0000 2026-02-20T12:04:21.551 INFO:teuthology.orchestra.run.trial058.stdout: Birth: 2026-02-20 12:03:11.930542803 +0000 2026-02-20T12:04:21.552 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T12:04:21.615 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records in 2026-02-20T12:04:21.615 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records out 2026-02-20T12:04:21.615 INFO:teuthology.orchestra.run.trial058.stderr:512 bytes copied, 0.00014435 s, 3.5 MB/s 2026-02-20T12:04:21.616 DEBUG:teuthology.orchestra.run.trial058:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T12:04:21.673 DEBUG:teuthology.orchestra.run.trial058:> stat /dev/vg_nvme/lv_4 2026-02-20T12:04:21.730 INFO:teuthology.orchestra.run.trial058.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T12:04:21.730 INFO:teuthology.orchestra.run.trial058.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T12:04:21.730 INFO:teuthology.orchestra.run.trial058.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-20T12:04:21.730 INFO:teuthology.orchestra.run.trial058.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T12:04:21.730 INFO:teuthology.orchestra.run.trial058.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T12:04:21.730 INFO:teuthology.orchestra.run.trial058.stdout:Access: 2026-02-20 12:03:59.507795018 +0000 2026-02-20T12:04:21.730 INFO:teuthology.orchestra.run.trial058.stdout:Modify: 2026-02-20 12:03:11.930542803 +0000 2026-02-20T12:04:21.730 INFO:teuthology.orchestra.run.trial058.stdout:Change: 2026-02-20 12:03:11.930542803 +0000 2026-02-20T12:04:21.730 INFO:teuthology.orchestra.run.trial058.stdout: Birth: 2026-02-20 12:03:11.930542803 +0000 2026-02-20T12:04:21.731 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T12:04:21.793 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records in 2026-02-20T12:04:21.793 INFO:teuthology.orchestra.run.trial058.stderr:1+0 records out 2026-02-20T12:04:21.793 INFO:teuthology.orchestra.run.trial058.stderr:512 bytes copied, 0.000172232 s, 3.0 MB/s 2026-02-20T12:04:21.794 DEBUG:teuthology.orchestra.run.trial058:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T12:04:21.850 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T12:04:21.851 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial058.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-20T12:04:21.851 INFO:tasks.ceph:Generating config... 2026-02-20T12:04:21.853 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-20T12:04:21.854 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-20T12:04:21.854 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-20T12:04:21.854 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-20T12:04:21.854 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-20T12:04:21.854 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-20T12:04:21.854 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-20T12:04:21.854 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-20T12:04:21.854 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-20T12:04:21.854 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-20T12:04:21.854 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-20T12:04:21.855 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2026-02-20T12:04:21.855 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-20T12:04:21.855 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-20T12:04:21.855 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2026-02-20T12:04:21.855 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-20T12:04:21.855 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-20T12:04:21.855 INFO:tasks.ceph:[osd] debug alienstore = 20 2026-02-20T12:04:21.855 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-20T12:04:21.855 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-20T12:04:21.855 INFO:tasks.ceph:[osd] debug ms = 20 2026-02-20T12:04:21.855 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-20T12:04:21.855 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-20T12:04:21.856 INFO:tasks.ceph:[osd] err to stderr = True 2026-02-20T12:04:21.856 INFO:tasks.ceph:[osd] log flush on exit = True 2026-02-20T12:04:21.856 INFO:tasks.ceph:[osd] log to file = False 2026-02-20T12:04:21.856 INFO:tasks.ceph:[osd] log to stderr = True 2026-02-20T12:04:21.856 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-20T12:04:21.856 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-20T12:04:21.856 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-20T12:04:21.856 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-20T12:04:21.856 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-20T12:04:21.856 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-20T12:04:21.856 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-20T12:04:21.856 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-20T12:04:21.857 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-20T12:04:21.857 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-20T12:04:21.857 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-20T12:04:21.857 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-20T12:04:21.857 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-20T12:04:21.857 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-20T12:04:21.857 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-20T12:04:21.857 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-20T12:04:21.857 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-20T12:04:21.857 INFO:tasks.ceph:Setting up mon.a... 2026-02-20T12:04:21.858 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-20T12:04:21.933 INFO:teuthology.orchestra.run.trial058.stdout:creating /etc/ceph/ceph.keyring 2026-02-20T12:04:21.935 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-20T12:04:22.019 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T12:04:22.085 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.58')] 2026-02-20T12:04:22.086 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.58', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug alienstore': 20, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 20, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-20T12:04:22.087 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:22.087 DEBUG:teuthology.orchestra.run.trial058:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T12:04:22.141 DEBUG:teuthology.orchestra.run.trial058:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.58 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:04:22.222 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:22.220+0000 7f5921882f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:22.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:22.220+0000 7f5921882f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:22.223 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:22.220+0000 7f5921882f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:22.224 INFO:teuthology.orchestra.run.trial058.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:04:22.224 INFO:teuthology.orchestra.run.trial058.stdout:monmaptool: generated fsid 21851b77-bde8-4289-9cff-a647d5e308c7 2026-02-20T12:04:22.224 INFO:teuthology.orchestra.run.trial058.stdout:setting min_mon_release = tentacle 2026-02-20T12:04:22.224 INFO:teuthology.orchestra.run.trial058.stdout:epoch 0 2026-02-20T12:04:22.224 INFO:teuthology.orchestra.run.trial058.stdout:fsid 21851b77-bde8-4289-9cff-a647d5e308c7 2026-02-20T12:04:22.225 INFO:teuthology.orchestra.run.trial058.stdout:last_changed 2026-02-20T12:04:22.222142+0000 2026-02-20T12:04:22.225 INFO:teuthology.orchestra.run.trial058.stdout:created 2026-02-20T12:04:22.222142+0000 2026-02-20T12:04:22.225 INFO:teuthology.orchestra.run.trial058.stdout:min_mon_release 20 (tentacle) 2026-02-20T12:04:22.225 INFO:teuthology.orchestra.run.trial058.stdout:election_strategy: 1 2026-02-20T12:04:22.225 INFO:teuthology.orchestra.run.trial058.stdout:0: [v2:10.20.193.58:3300/0,v1:10.20.193.58:6789/0] mon.a 2026-02-20T12:04:22.225 INFO:teuthology.orchestra.run.trial058.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-20T12:04:22.226 DEBUG:teuthology.orchestra.run.trial058:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T12:04:22.280 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 21851b77-bde8-4289-9cff-a647d5e308c7... 2026-02-20T12:04:22.282 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T12:04:22.361 INFO:teuthology.orchestra.run.trial058.stdout:[global] 2026-02-20T12:04:22.361 INFO:teuthology.orchestra.run.trial058.stdout: chdir = "" 2026-02-20T12:04:22.361 INFO:teuthology.orchestra.run.trial058.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T12:04:22.361 INFO:teuthology.orchestra.run.trial058.stdout: auth supported = cephx 2026-02-20T12:04:22.361 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.361 INFO:teuthology.orchestra.run.trial058.stdout: filestore xattr use omap = true 2026-02-20T12:04:22.361 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.361 INFO:teuthology.orchestra.run.trial058.stdout: mon clock drift allowed = 1.000 2026-02-20T12:04:22.362 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.362 INFO:teuthology.orchestra.run.trial058.stdout: osd crush chooseleaf type = 0 2026-02-20T12:04:22.362 INFO:teuthology.orchestra.run.trial058.stdout: auth debug = true 2026-02-20T12:04:22.362 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.362 INFO:teuthology.orchestra.run.trial058.stdout: ms die on old message = true 2026-02-20T12:04:22.362 INFO:teuthology.orchestra.run.trial058.stdout: ms die on bug = true 2026-02-20T12:04:22.362 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.362 INFO:teuthology.orchestra.run.trial058.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T12:04:22.362 INFO:teuthology.orchestra.run.trial058.stdout: mon pg warn max object skew = 0 2026-02-20T12:04:22.362 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.362 INFO:teuthology.orchestra.run.trial058.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T12:04:22.362 INFO:teuthology.orchestra.run.trial058.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: osd pool default size = 2 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: mon osd allow primary affinity = true 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: mon osd allow pg remap = true 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on legacy crush tunables = false 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on crush straw calc version zero = false 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on no sortbitwise = false 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on osd down out interval zero = false 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: mon warn on too few osds = false 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: mon_allow_pool_size_one = true 2026-02-20T12:04:22.363 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: osd default data pool replay window = 5 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: mon allow pool delete = true 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: mon cluster log file level = debug 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: debug asserts on shutdown = true 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: mon health detail to clog = false 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: mon host = 10.20.193.58 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: ms client mode = crc 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: ms cluster mode = crc 2026-02-20T12:04:22.364 INFO:teuthology.orchestra.run.trial058.stdout: ms mon client mode = crc 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout: ms mon cluster mode = crc 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout: ms mon service mode = crc 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout: ms service mode = crc 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout: fsid = 21851b77-bde8-4289-9cff-a647d5e308c7 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout:[osd] 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout: osd journal size = 100 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout: osd scrub load threshold = 5.0 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout: osd scrub max interval = 600 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout: osd mclock profile = high_recovery_ops 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout: osd mclock skip benchmark = true 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.365 INFO:teuthology.orchestra.run.trial058.stdout: osd recover clone overlap = true 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: osd recovery max chunk = 1048576 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: osd debug shutdown = true 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: osd debug op order = true 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: osd debug verify stray on activate = true 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: osd debug trim objects = true 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: osd open classes on start = true 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: osd debug pg log writeout = true 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: osd deep scrub update digest min age = 30 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: osd map max advance = 10 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.366 INFO:teuthology.orchestra.run.trial058.stdout: journal zero on create = true 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: filestore ondisk finisher threads = 3 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: filestore apply finisher threads = 3 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: bdev debug aio = true 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: osd debug misdirected ops = true 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: debug monc = 20 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: bluestore block size = 96636764160 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: bluestore compression algorithm = snappy 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: bluestore compression mode = aggressive 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: bluestore fsck on mount = True 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: bluestore rocksdb cf = False 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: crimson cpu num = 4 2026-02-20T12:04:22.367 INFO:teuthology.orchestra.run.trial058.stdout: crimson osd obc lru size = 10 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: debug alienstore = 20 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: debug bluefs = 20 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: debug bluestore = 20 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: debug ms = 20 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: debug osd = 20 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: debug rocksdb = 10 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: err to stderr = True 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: log flush on exit = True 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: log to file = False 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: log to stderr = True 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: mon osd backfillfull_ratio = 0.85 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: mon osd full ratio = 0.9 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: mon osd nearfull ratio = 0.8 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: osd failsafe full ratio = 0.95 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: osd objectstore = bluestore 2026-02-20T12:04:22.368 INFO:teuthology.orchestra.run.trial058.stdout: osd shutdown pgref assert = True 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout: seastore cachepin size pershard = 64M 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout: seastore max concurrent transactions = 8 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout:[mgr] 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout: debug ms = 1 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout: debug mgr = 20 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout: debug mon = 20 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout: debug auth = 20 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout: mon reweight min pgs per osd = 4 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout: mon reweight min bytes per osd = 10 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout: mgr/telemetry/nag = false 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout:[mon] 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout: debug ms = 1 2026-02-20T12:04:22.369 INFO:teuthology.orchestra.run.trial058.stdout: debug mon = 20 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: debug paxos = 20 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: debug auth = 20 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: mon data avail warn = 5 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: mon mgr mkfs grace = 240 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: mon reweight min pgs per osd = 4 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: mon osd reporter subtree level = osd 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: mon osd prime pg temp = true 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: mon reweight min bytes per osd = 10 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T12:04:22.370 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: # 1m isn't quite enough 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: mon_down_mkfs_grace = 2m 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: mon_warn_on_filestore_osds = false 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: mon min osdmap epochs = 50 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: mon osdmap full prune interval = 2 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: mon osdmap full prune min = 15 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: mon osdmap full prune txsize = 2 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: paxos service trim min = 10 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: osd pool default crimson = True 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout:[client] 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: rgw cache enabled = true 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: rgw enable ops log = true 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: rgw enable usage log = true 2026-02-20T12:04:22.371 INFO:teuthology.orchestra.run.trial058.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T12:04:22.372 INFO:teuthology.orchestra.run.trial058.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T12:04:22.372 INFO:teuthology.orchestra.run.trial058.stdout:[mon.a] 2026-02-20T12:04:22.373 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-20T12:04:22.373 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-20T12:04:22.463 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-20T12:04:22.463 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:22.463 DEBUG:teuthology.orchestra.run.trial058:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-20T12:04:22.479 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:22.480 DEBUG:teuthology.orchestra.run.trial058:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-20T12:04:22.535 INFO:tasks.ceph:Sending monmap to node ubuntu@trial058.front.sepia.ceph.com 2026-02-20T12:04:22.536 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:22.536 DEBUG:teuthology.orchestra.run.trial058:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T12:04:22.536 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T12:04:22.608 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:22.609 DEBUG:teuthology.orchestra.run.trial058:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:04:22.665 INFO:tasks.ceph:Setting up mon nodes... 2026-02-20T12:04:22.665 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-20T12:04:22.665 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T12:04:22.757 INFO:teuthology.orchestra.run.trial058.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T12:04:22.760 INFO:tasks.ceph:Setting up mds nodes... 2026-02-20T12:04:22.760 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-20T12:04:22.760 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-20T12:04:22.803 INFO:teuthology.orchestra.run.trial058.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-20T12:04:22.814 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-20T12:04:22.815 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial058.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-20T12:04:22.815 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-20T12:04:22.879 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T12:04:22.879 INFO:tasks.ceph:role: osd.0 2026-02-20T12:04:22.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial058.front.sepia.ceph.com 2026-02-20T12:04:22.880 DEBUG:teuthology.orchestra.run.trial058:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T12:04:22.943 INFO:teuthology.orchestra.run.trial058.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T12:04:22.943 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T12:04:22.944 INFO:teuthology.orchestra.run.trial058.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T12:04:22.944 INFO:teuthology.orchestra.run.trial058.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T12:04:22.944 INFO:teuthology.orchestra.run.trial058.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T12:04:22.944 INFO:teuthology.orchestra.run.trial058.stdout: = sunit=0 swidth=0 blks 2026-02-20T12:04:22.944 INFO:teuthology.orchestra.run.trial058.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T12:04:22.944 INFO:teuthology.orchestra.run.trial058.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T12:04:22.944 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T12:04:22.944 INFO:teuthology.orchestra.run.trial058.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T12:04:23.529 INFO:teuthology.orchestra.run.trial058.stdout:Discarding blocks...Done. 2026-02-20T12:04:23.531 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial058.front.sepia.ceph.com -o noatime 2026-02-20T12:04:23.532 DEBUG:teuthology.orchestra.run.trial058:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-20T12:04:23.600 DEBUG:teuthology.orchestra.run.trial058:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-20T12:04:23.666 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-20T12:04:23.731 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T12:04:23.731 INFO:tasks.ceph:role: osd.1 2026-02-20T12:04:23.731 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial058.front.sepia.ceph.com 2026-02-20T12:04:23.731 DEBUG:teuthology.orchestra.run.trial058:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T12:04:23.795 INFO:teuthology.orchestra.run.trial058.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T12:04:23.796 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T12:04:23.796 INFO:teuthology.orchestra.run.trial058.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T12:04:23.796 INFO:teuthology.orchestra.run.trial058.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T12:04:23.796 INFO:teuthology.orchestra.run.trial058.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T12:04:23.796 INFO:teuthology.orchestra.run.trial058.stdout: = sunit=0 swidth=0 blks 2026-02-20T12:04:23.796 INFO:teuthology.orchestra.run.trial058.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T12:04:23.796 INFO:teuthology.orchestra.run.trial058.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T12:04:23.796 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T12:04:23.796 INFO:teuthology.orchestra.run.trial058.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T12:04:24.355 INFO:teuthology.orchestra.run.trial058.stdout:Discarding blocks...Done. 2026-02-20T12:04:24.357 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial058.front.sepia.ceph.com -o noatime 2026-02-20T12:04:24.357 DEBUG:teuthology.orchestra.run.trial058:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-20T12:04:24.431 DEBUG:teuthology.orchestra.run.trial058:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-20T12:04:24.498 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-20T12:04:24.561 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-20T12:04:24.561 INFO:tasks.ceph:role: osd.2 2026-02-20T12:04:24.561 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial058.front.sepia.ceph.com 2026-02-20T12:04:24.561 DEBUG:teuthology.orchestra.run.trial058:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-20T12:04:24.626 INFO:teuthology.orchestra.run.trial058.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T12:04:24.627 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T12:04:24.627 INFO:teuthology.orchestra.run.trial058.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T12:04:24.627 INFO:teuthology.orchestra.run.trial058.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T12:04:24.627 INFO:teuthology.orchestra.run.trial058.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T12:04:24.627 INFO:teuthology.orchestra.run.trial058.stdout: = sunit=0 swidth=0 blks 2026-02-20T12:04:24.627 INFO:teuthology.orchestra.run.trial058.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T12:04:24.627 INFO:teuthology.orchestra.run.trial058.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T12:04:24.627 INFO:teuthology.orchestra.run.trial058.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T12:04:24.627 INFO:teuthology.orchestra.run.trial058.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T12:04:25.193 INFO:teuthology.orchestra.run.trial058.stdout:Discarding blocks...Done. 2026-02-20T12:04:25.195 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial058.front.sepia.ceph.com -o noatime 2026-02-20T12:04:25.196 DEBUG:teuthology.orchestra.run.trial058:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-20T12:04:25.269 DEBUG:teuthology.orchestra.run.trial058:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-20T12:04:25.337 DEBUG:teuthology.orchestra.run.trial058:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:04:25.488 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T12:04:25.543 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:25,542 seastar - Reactor backend: linux-aio 2026-02-20T12:04:25.553 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:25,551 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:04:25.553 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:25,552 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:04:25.555 INFO:teuthology.orchestra.run.trial058.stderr:==36477==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T12:04:25.611 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:25,609 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T12:04:25.611 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:25,609 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T12:04:25.611 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:25,609 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T12:04:25.611 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:25,609 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T12:04:25.611 INFO:teuthology.orchestra.run.trial058.stderr:DEBUG 2026-02-20 12:04:25,610 [shard 0:main] seastar - reactor::drain 2026-02-20T12:04:27.676 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-20T12:04:27.676 INFO:teuthology.orchestra.run.trial058.stderr:Suppressions used: 2026-02-20T12:04:27.676 INFO:teuthology.orchestra.run.trial058.stderr: count bytes template 2026-02-20T12:04:27.677 INFO:teuthology.orchestra.run.trial058.stderr: 1 8 MallocExtension::Register 2026-02-20T12:04:27.677 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-20T12:04:27.677 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-20T12:04:27.697 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T12:04:27.697 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T12:04:27.737 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T12:04:27.738 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T12:04:27.744 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:27,743 seastar - Reactor backend: linux-aio 2026-02-20T12:04:27.755 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:27,754 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:04:27.755 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:27,754 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:04:27.758 INFO:teuthology.orchestra.run.trial058.stderr:==36475==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T12:04:27.759 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:27,758 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T12:04:27.816 INFO:teuthology.orchestra.run.trial058.stderr:DEBUG 2026-02-20 12:04:27,815 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T12:04:30.953 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-20T12:04:30.953 INFO:teuthology.orchestra.run.trial058.stderr:Suppressions used: 2026-02-20T12:04:30.954 INFO:teuthology.orchestra.run.trial058.stderr: count bytes template 2026-02-20T12:04:30.954 INFO:teuthology.orchestra.run.trial058.stderr: 1 8 MallocExtension::Register 2026-02-20T12:04:30.954 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-20T12:04:30.954 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-20T12:04:30.983 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-20T12:04:31.009 DEBUG:teuthology.orchestra.run.trial058:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:04:31.161 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T12:04:31.222 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:31,220 seastar - Reactor backend: linux-aio 2026-02-20T12:04:31.233 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:31,231 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:04:31.233 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:31,231 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:04:31.235 INFO:teuthology.orchestra.run.trial058.stderr:==36679==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T12:04:31.268 INFO:teuthology.orchestra.run.trial058.stderr:Reactor stalled for 32 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x3558127 0x35584c4 0x3558849 0x35594f1 0x35598f4 0x3559c3f 0x3559dcf 0x355a28c 0x355a600 0x36127e3 0x3612f9d 0x361329f 0x3613430 0x36136d9 0x36139e0 0x3613b26 0x350ae22 0x3553762 0x35539a8 0x3553afc 0x3553baa 0x3553e74 0x3554077 0x35542f8 0x35544ba 0x35545d9 0x350ae22 0x350b1ce 0x350b414 0x350b4ed 0x356439c 0x35f5ae1 0x35f5e23 0x35f6055 0x35f62d8 0x35f6657 0x35f6967 0x35f6a25 0x35f6fc3 0x35f742b 0x35f7868 0x35f7b8e 0x35f7cb0 0x35fa172 0x35fc00b 0x35fc2c2 0x35fd353 0x35fd411 0x35fd4b3 0x35fd5dc 0x35fd901 0x35fdb03 0x35fde85 0x3614f46 0x36157f0 0x3615d50 0x36160c8 0x3616566 0x36169a5 0x35fe7d4 0x35ff181 0x35ff438 0x35ff8d7 0x35ff9f3 0x361e13f 0x361e4d1 0x361e804 0x361eb61 0x361ed99 0x361f3d4 0x361f704 0x361fa6a 0x361ff17 0x3620356 0x35ffbf2 0x3600001 0x36002b8 0x3600409 0x3624bcc 0x3624f57 0x362528a 0x362577d 0x3625b5f 0x3625ceb 0x3626123 0x362648f 0x36267f4 0x3626b17 0x3626bf9 2026-02-20T12:04:31.289 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:31,288 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T12:04:31.289 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:31,288 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T12:04:31.290 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:31,288 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T12:04:31.290 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:31,288 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T12:04:31.290 INFO:teuthology.orchestra.run.trial058.stderr:DEBUG 2026-02-20 12:04:31,289 [shard 0:main] seastar - reactor::drain 2026-02-20T12:04:33.350 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-20T12:04:33.350 INFO:teuthology.orchestra.run.trial058.stderr:Suppressions used: 2026-02-20T12:04:33.350 INFO:teuthology.orchestra.run.trial058.stderr: count bytes template 2026-02-20T12:04:33.350 INFO:teuthology.orchestra.run.trial058.stderr: 1 8 MallocExtension::Register 2026-02-20T12:04:33.350 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-20T12:04:33.350 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-20T12:04:33.369 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T12:04:33.370 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T12:04:33.414 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T12:04:33.415 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T12:04:33.421 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:33,420 seastar - Reactor backend: linux-aio 2026-02-20T12:04:33.437 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:33,436 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:04:33.437 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:33,436 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:04:33.440 INFO:teuthology.orchestra.run.trial058.stderr:==36677==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T12:04:33.440 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:33,439 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T12:04:33.498 INFO:teuthology.orchestra.run.trial058.stderr:DEBUG 2026-02-20 12:04:33,497 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T12:04:36.705 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-20T12:04:36.705 INFO:teuthology.orchestra.run.trial058.stderr:Suppressions used: 2026-02-20T12:04:36.705 INFO:teuthology.orchestra.run.trial058.stderr: count bytes template 2026-02-20T12:04:36.706 INFO:teuthology.orchestra.run.trial058.stderr: 1 8 MallocExtension::Register 2026-02-20T12:04:36.706 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-20T12:04:36.706 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-20T12:04:36.735 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-20T12:04:36.760 DEBUG:teuthology.orchestra.run.trial058:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:04:36.912 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T12:04:36.966 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:36,964 seastar - Reactor backend: linux-aio 2026-02-20T12:04:36.976 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:36,975 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:04:36.977 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:36,975 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:04:36.979 INFO:teuthology.orchestra.run.trial058.stderr:==36881==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T12:04:37.034 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:37,032 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T12:04:37.034 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:37,032 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T12:04:37.034 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:37,032 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T12:04:37.034 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:37,032 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T12:04:37.034 INFO:teuthology.orchestra.run.trial058.stderr:DEBUG 2026-02-20 12:04:37,033 [shard 0:main] seastar - reactor::drain 2026-02-20T12:04:39.088 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-20T12:04:39.088 INFO:teuthology.orchestra.run.trial058.stderr:Suppressions used: 2026-02-20T12:04:39.088 INFO:teuthology.orchestra.run.trial058.stderr: count bytes template 2026-02-20T12:04:39.088 INFO:teuthology.orchestra.run.trial058.stderr: 1 8 MallocExtension::Register 2026-02-20T12:04:39.088 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-20T12:04:39.088 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-20T12:04:39.107 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T12:04:39.107 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T12:04:39.153 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T12:04:39.153 INFO:teuthology.orchestra.run.trial058.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T12:04:39.159 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:39,158 seastar - Reactor backend: linux-aio 2026-02-20T12:04:39.170 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:39,169 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:04:39.170 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:39,169 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T12:04:39.174 INFO:teuthology.orchestra.run.trial058.stderr:==36879==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T12:04:39.174 INFO:teuthology.orchestra.run.trial058.stderr:INFO 2026-02-20 12:04:39,173 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T12:04:39.232 INFO:teuthology.orchestra.run.trial058.stderr:DEBUG 2026-02-20 12:04:39,231 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T12:04:42.500 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-20T12:04:42.500 INFO:teuthology.orchestra.run.trial058.stderr:Suppressions used: 2026-02-20T12:04:42.500 INFO:teuthology.orchestra.run.trial058.stderr: count bytes template 2026-02-20T12:04:42.500 INFO:teuthology.orchestra.run.trial058.stderr: 1 8 MallocExtension::Register 2026-02-20T12:04:42.500 INFO:teuthology.orchestra.run.trial058.stderr:----------------------------------------------------- 2026-02-20T12:04:42.500 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-20T12:04:42.529 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-20T12:04:42.556 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-20T12:04:42.556 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:42.557 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-20T12:04:42.620 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:42.620 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-20T12:04:42.684 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:42.684 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-20T12:04:42.747 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:42.748 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-20T12:04:42.813 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:42.814 DEBUG:teuthology.orchestra.run.trial058:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-20T12:04:42.869 INFO:tasks.ceph:Adding keys to all mons... 2026-02-20T12:04:42.869 DEBUG:teuthology.orchestra.run.trial058:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-20T12:04:42.932 INFO:teuthology.orchestra.run.trial058.stdout:[mgr.x] 2026-02-20T12:04:42.932 INFO:teuthology.orchestra.run.trial058.stdout: key = AQDGTZhpP3ATLRAAQZ0+B5tVgb3LUTsJnsDfCQ== 2026-02-20T12:04:42.933 INFO:teuthology.orchestra.run.trial058.stdout:[osd.0] 2026-02-20T12:04:42.933 INFO:teuthology.orchestra.run.trial058.stdout: key = AQDLTZhpUPzcMBAAnmTcySeJuSARE6DW9ei0JA== 2026-02-20T12:04:42.933 INFO:teuthology.orchestra.run.trial058.stdout:[osd.1] 2026-02-20T12:04:42.933 INFO:teuthology.orchestra.run.trial058.stdout: key = AQDRTZhpxA3kHRAAEXUqK3WsDPVBKFa/+yKshw== 2026-02-20T12:04:42.933 INFO:teuthology.orchestra.run.trial058.stdout:[osd.2] 2026-02-20T12:04:42.933 INFO:teuthology.orchestra.run.trial058.stdout: key = AQDXTZhpU8oCDhAAC8fCTQWeq76gbIemGB7Y5g== 2026-02-20T12:04:42.933 INFO:teuthology.orchestra.run.trial058.stdout:[client.0] 2026-02-20T12:04:42.933 INFO:teuthology.orchestra.run.trial058.stdout: key = AQDGTZhpNE/QLxAAXiPtwfKszbPS5uprvEFhqw== 2026-02-20T12:04:42.934 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-20T12:04:43.022 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T12:04:43.072 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T12:04:43.121 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T12:04:43.169 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T12:04:43.219 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-20T12:04:43.220 DEBUG:teuthology.orchestra.run.trial058:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-20T12:04:43.245 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-20T12:04:43.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:43.328+0000 7f8e2f881c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.329 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:43.328+0000 7f8e2f881c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.341 DEBUG:teuthology.orchestra.run.trial058:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-20T12:04:43.366 DEBUG:teuthology.orchestra.run.trial058:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-20T12:04:43.422 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-20T12:04:43.422 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-20T12:04:43.423 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-20T12:04:43.464 INFO:tasks.ceph.mon.a:Started 2026-02-20T12:04:43.465 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-20T12:04:43.465 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-20T12:04:43.465 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-20T12:04:43.467 INFO:tasks.ceph.mgr.x:Started 2026-02-20T12:04:43.468 DEBUG:tasks.ceph:set 0 configs 2026-02-20T12:04:43.468 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config dump 2026-02-20T12:04:43.527 INFO:tasks.ceph.mon.a.trial058.stderr:2026-02-20T12:04:43.526+0000 7f7cb2ae3c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.527 INFO:tasks.ceph.mon.a.trial058.stderr:2026-02-20T12:04:43.526+0000 7f7cb2ae3c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.527 INFO:tasks.ceph.mon.a.trial058.stderr:2026-02-20T12:04:43.526+0000 7f7cb2ae3c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.531 INFO:tasks.ceph.mgr.x.trial058.stderr:2026-02-20T12:04:43.530+0000 7f1f6b5c0fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.543 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:43.540+0000 7f312545a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.546 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:43.545+0000 7f312545a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.578 INFO:teuthology.orchestra.run.trial058.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-20T12:04:43.586 INFO:tasks.ceph:Setting crush tunables to default 2026-02-20T12:04:43.587 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph osd crush tunables default 2026-02-20T12:04:43.662 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:43.658+0000 7f040556f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.664 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:43.663+0000 7f040556f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.698 INFO:teuthology.orchestra.run.trial058.stderr:adjusted tunables profile to default 2026-02-20T12:04:43.707 INFO:tasks.ceph:check_enable_crimson: True 2026-02-20T12:04:43.708 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-20T12:04:43.708 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-20T12:04:43.735 INFO:tasks.ceph.mgr.x.trial058.stderr:2026-02-20T12:04:43.734+0000 7f1f6b5c0fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.736 INFO:tasks.ceph.mgr.x.trial058.stderr:2026-02-20T12:04:43.734+0000 7f1f6b5c0fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.782 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:43.779+0000 7fc38dba4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.785 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:43.784+0000 7fc38dba4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:43.823 INFO:tasks.ceph.mon.a.trial058.stderr:2026-02-20T12:04:43.822+0000 7f7caa1f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-20T12:04:43.823 INFO:tasks.ceph.mon.a.trial058.stderr:Please be aware that this feature is experimental, untested, 2026-02-20T12:04:43.823 INFO:tasks.ceph.mon.a.trial058.stderr:unsupported, and may result in data corruption, data loss, 2026-02-20T12:04:43.823 INFO:tasks.ceph.mon.a.trial058.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-20T12:04:43.823 INFO:tasks.ceph.mon.a.trial058.stderr:feature with important data. 2026-02-20T12:04:43.823 INFO:tasks.ceph.mon.a.trial058.stderr: 2026-02-20T12:04:44.583 INFO:tasks.ceph.mgr.x.trial058.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T12:04:44.584 INFO:tasks.ceph.mgr.x.trial058.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T12:04:44.584 INFO:tasks.ceph.mgr.x.trial058.stderr: from numpy import show_config as show_numpy_config 2026-02-20T12:04:44.710 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-20T12:04:44.710 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:44.710 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-20T12:04:44.774 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:44.775 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-20T12:04:44.837 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:04:44.837 DEBUG:teuthology.orchestra.run.trial058:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-20T12:04:44.901 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph osd new c03c48db-00dc-4ccb-8179-68227b5ef076 0 2026-02-20T12:04:45.015 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:45.009+0000 7f26ae6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:45.017 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:45.015+0000 7f26ae6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:45.055 INFO:teuthology.orchestra.run.trial058.stdout:0 2026-02-20T12:04:45.063 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph osd new f6cdcbc7-bbb2-4c63-a8b6-5cc616a122ed 1 2026-02-20T12:04:45.138 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:45.132+0000 7fa1ed65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:45.140 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:45.138+0000 7fa1ed65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:45.178 INFO:teuthology.orchestra.run.trial058.stdout:1 2026-02-20T12:04:45.186 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph osd new 4c8b41a2-6cb9-450d-8833-a7a78d405999 2 2026-02-20T12:04:45.261 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:45.256+0000 7fe02ac1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:45.263 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:45.261+0000 7fe02ac1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:45.301 INFO:teuthology.orchestra.run.trial058.stdout:2 2026-02-20T12:04:45.309 DEBUG:teuthology.orchestra.run.trial058:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-20T12:04:45.336 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T12:04:45.337 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-20T12:04:45.379 INFO:tasks.ceph.osd.0:Started 2026-02-20T12:04:45.379 DEBUG:teuthology.orchestra.run.trial058:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-20T12:04:45.408 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T12:04:45.408 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-20T12:04:45.451 INFO:tasks.ceph.osd.1:Started 2026-02-20T12:04:45.451 DEBUG:teuthology.orchestra.run.trial058:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-20T12:04:45.478 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T12:04:45.478 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-20T12:04:45.520 INFO:tasks.ceph.osd.2:Started 2026-02-20T12:04:45.520 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T12:04:45.598 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:45.594+0000 7f6b85d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:45.601 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:45.599+0000 7f6b85d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:45.635 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:04:45.635 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":6,"fsid":"21851b77-bde8-4289-9cff-a647d5e308c7","created":"2026-02-20T12:04:43.538448+0000","modified":"2026-02-20T12:04:45.299504+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T12:04:45.299504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c03c48db-00dc-4ccb-8179-68227b5ef076","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f6cdcbc7-bbb2-4c63-a8b6-5cc616a122ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4c8b41a2-6cb9-450d-8833-a7a78d405999","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T12:04:45.644 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-20T12:04:45.645 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-20T12:04:45.946 DEBUG:teuthology.orchestra.run.trial058:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T12:04:46.015 INFO:teuthology.misc.health.trial058.stderr:2026-02-20T12:04:46.011+0000 7f7299f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:46.018 INFO:teuthology.misc.health.trial058.stderr:2026-02-20T12:04:46.016+0000 7f7299f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:46.050 INFO:teuthology.misc.health.trial058.stdout: 2026-02-20T12:04:46.050 INFO:teuthology.misc.health.trial058.stdout:{"epoch":6,"fsid":"21851b77-bde8-4289-9cff-a647d5e308c7","created":"2026-02-20T12:04:43.538448+0000","modified":"2026-02-20T12:04:45.299504+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T12:04:45.299504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c03c48db-00dc-4ccb-8179-68227b5ef076","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f6cdcbc7-bbb2-4c63-a8b6-5cc616a122ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4c8b41a2-6cb9-450d-8833-a7a78d405999","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T12:04:46.057 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-20T12:04:46.992 INFO:tasks.ceph.mgr.x.trial058.stderr:2026-02-20T12:04:46.989+0000 7f1e86497640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-20T12:04:52.359 DEBUG:teuthology.orchestra.run.trial058:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T12:04:52.428 INFO:teuthology.misc.health.trial058.stderr:2026-02-20T12:04:52.423+0000 7f04c4d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:52.430 INFO:teuthology.misc.health.trial058.stderr:2026-02-20T12:04:52.428+0000 7f04c4d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:52.543 INFO:teuthology.misc.health.trial058.stdout: 2026-02-20T12:04:52.544 INFO:teuthology.misc.health.trial058.stdout:{"epoch":7,"fsid":"21851b77-bde8-4289-9cff-a647d5e308c7","created":"2026-02-20T12:04:43.538448+0000","modified":"2026-02-20T12:04:52.318221+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T12:04:45.299504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c03c48db-00dc-4ccb-8179-68227b5ef076","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f6cdcbc7-bbb2-4c63-a8b6-5cc616a122ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4c8b41a2-6cb9-450d-8833-a7a78d405999","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T12:04:52.555 DEBUG:teuthology.misc:0 of 3 OSDs are up 2026-02-20T12:04:58.857 DEBUG:teuthology.orchestra.run.trial058:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T12:04:58.926 INFO:teuthology.misc.health.trial058.stderr:2026-02-20T12:04:58.922+0000 7f14b58cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:58.929 INFO:teuthology.misc.health.trial058.stderr:2026-02-20T12:04:58.927+0000 7f14b58cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:59.040 INFO:teuthology.misc.health.trial058.stdout: 2026-02-20T12:04:59.040 INFO:teuthology.misc.health.trial058.stdout:{"epoch":13,"fsid":"21851b77-bde8-4289-9cff-a647d5e308c7","created":"2026-02-20T12:04:43.538448+0000","modified":"2026-02-20T12:04:58.346439+0000","last_up_change":"2026-02-20T12:04:55.332193+0000","last_in_change":"2026-02-20T12:04:45.299504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T12:04:56.003566+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c03c48db-00dc-4ccb-8179-68227b5ef076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6805","nonce":227985633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":227985633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":227985633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":227985633}]},"public_addr":"10.20.193.58:6805/227985633","cluster_addr":"10.20.193.58:6804/227985633","heartbeat_back_addr":"10.20.193.58:6810/227985633","heartbeat_front_addr":"10.20.193.58:6812/227985633","state":["exists","up"]},{"osd":1,"uuid":"f6cdcbc7-bbb2-4c63-a8b6-5cc616a122ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1329192065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6803","nonce":1329192065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1329192065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6809","nonce":1329192065}]},"public_addr":"10.20.193.58:6802/1329192065","cluster_addr":"10.20.193.58:6803/1329192065","heartbeat_back_addr":"10.20.193.58:6806/1329192065","heartbeat_front_addr":"10.20.193.58:6809/1329192065","state":["exists","up"]},{"osd":2,"uuid":"4c8b41a2-6cb9-450d-8833-a7a78d405999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6807","nonce":2976858905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":2976858905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6811","nonce":2976858905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6813","nonce":2976858905}]},"public_addr":"10.20.193.58:6807/2976858905","cluster_addr":"10.20.193.58:6808/2976858905","heartbeat_back_addr":"10.20.193.58:6811/2976858905","heartbeat_front_addr":"10.20.193.58:6813/2976858905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T12:04:59.048 DEBUG:teuthology.misc:3 of 3 OSDs are up 2026-02-20T12:04:59.048 INFO:tasks.ceph:Creating RBD pool 2026-02-20T12:04:59.049 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-20T12:04:59.123 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:59.117+0000 7fdfe695b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:59.125 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:59.123+0000 7fdfe695b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:59.600 INFO:teuthology.orchestra.run.trial058.stderr:pool 'rbd' created 2026-02-20T12:04:59.617 DEBUG:teuthology.orchestra.run.trial058:> rbd --cluster ceph pool init rbd 2026-02-20T12:04:59.658 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:59.656+0000 7febb91ee240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:59.659 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:59.656+0000 7febb91ee240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:04:59.661 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:04:59.659+0000 7febb91ee240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:02.629 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-20T12:05:02.630 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-20T12:05:02.630 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-20T12:05:02.747 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:02.743+0000 7f240e45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:02.749 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:02.747+0000 7f240e45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:02.863 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:05:02.873 INFO:teuthology.orchestra.run.trial058.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-20T12:05:02.874 INFO:tasks.ceph_manager:config epoch is 1 2026-02-20T12:05:02.874 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T12:05:02.874 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-20T12:05:02.874 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-20T12:05:02.951 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:02.947+0000 7f9cfaf0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:02.954 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:02.952+0000 7f9cfaf0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.096 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:05:03.104 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6800","nonce":1970274113},{"type":"v1","addr":"10.20.193.58:6801","nonce":1970274113}]},"active_addr":"10.20.193.58:6801/1970274113","active_change":"2026-02-20T12:04:45.984898+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.58:0","nonce":944521354}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.58:0","nonce":2550913297}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.58:0","nonce":719166169}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.58:0","nonce":2371109680}]}]} 2026-02-20T12:05:03.108 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-20T12:05:03.108 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T12:05:03.109 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T12:05:03.185 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.181+0000 7f505b164640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.187 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.185+0000 7f505b164640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.296 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:05:03.296 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":17,"fsid":"21851b77-bde8-4289-9cff-a647d5e308c7","created":"2026-02-20T12:04:43.538448+0000","modified":"2026-02-20T12:05:02.607212+0000","last_up_change":"2026-02-20T12:04:55.332193+0000","last_in_change":"2026-02-20T12:04:45.299504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T12:04:56.003566+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T12:04:59.238977+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c03c48db-00dc-4ccb-8179-68227b5ef076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6805","nonce":227985633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":227985633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":227985633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":227985633}]},"public_addr":"10.20.193.58:6805/227985633","cluster_addr":"10.20.193.58:6804/227985633","heartbeat_back_addr":"10.20.193.58:6810/227985633","heartbeat_front_addr":"10.20.193.58:6812/227985633","state":["exists","up"]},{"osd":1,"uuid":"f6cdcbc7-bbb2-4c63-a8b6-5cc616a122ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1329192065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6803","nonce":1329192065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1329192065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6809","nonce":1329192065}]},"public_addr":"10.20.193.58:6802/1329192065","cluster_addr":"10.20.193.58:6803/1329192065","heartbeat_back_addr":"10.20.193.58:6806/1329192065","heartbeat_front_addr":"10.20.193.58:6809/1329192065","state":["exists","up"]},{"osd":2,"uuid":"4c8b41a2-6cb9-450d-8833-a7a78d405999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6807","nonce":2976858905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":2976858905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6811","nonce":2976858905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6813","nonce":2976858905}]},"public_addr":"10.20.193.58:6807/2976858905","cluster_addr":"10.20.193.58:6808/2976858905","heartbeat_back_addr":"10.20.193.58:6811/2976858905","heartbeat_front_addr":"10.20.193.58:6813/2976858905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T12:05:03.306 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T12:05:03.306 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T12:05:03.382 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.378+0000 7f7ce275c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.385 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.382+0000 7f7ce275c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.497 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:05:03.497 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":17,"fsid":"21851b77-bde8-4289-9cff-a647d5e308c7","created":"2026-02-20T12:04:43.538448+0000","modified":"2026-02-20T12:05:02.607212+0000","last_up_change":"2026-02-20T12:04:55.332193+0000","last_in_change":"2026-02-20T12:04:45.299504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T12:04:56.003566+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T12:04:59.238977+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c03c48db-00dc-4ccb-8179-68227b5ef076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6805","nonce":227985633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":227985633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":227985633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":227985633}]},"public_addr":"10.20.193.58:6805/227985633","cluster_addr":"10.20.193.58:6804/227985633","heartbeat_back_addr":"10.20.193.58:6810/227985633","heartbeat_front_addr":"10.20.193.58:6812/227985633","state":["exists","up"]},{"osd":1,"uuid":"f6cdcbc7-bbb2-4c63-a8b6-5cc616a122ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1329192065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6803","nonce":1329192065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1329192065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6809","nonce":1329192065}]},"public_addr":"10.20.193.58:6802/1329192065","cluster_addr":"10.20.193.58:6803/1329192065","heartbeat_back_addr":"10.20.193.58:6806/1329192065","heartbeat_front_addr":"10.20.193.58:6809/1329192065","state":["exists","up"]},{"osd":2,"uuid":"4c8b41a2-6cb9-450d-8833-a7a78d405999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6807","nonce":2976858905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":2976858905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6811","nonce":2976858905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6813","nonce":2976858905}]},"public_addr":"10.20.193.58:6807/2976858905","cluster_addr":"10.20.193.58:6808/2976858905","heartbeat_back_addr":"10.20.193.58:6811/2976858905","heartbeat_front_addr":"10.20.193.58:6813/2976858905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T12:05:03.506 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-20T12:05:03.507 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-20T12:05:03.507 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-20T12:05:03.587 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.582+0000 7f6d6d2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.582+0000 7fe2a275c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.588 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.583+0000 7f4c554cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.590 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.588+0000 7f6d6d2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.588+0000 7f4c554cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.591 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.588+0000 7fe2a275c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.608 INFO:teuthology.orchestra.run.trial058.stdout:42949672968 2026-02-20T12:05:03.608 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T12:05:03.610 INFO:teuthology.orchestra.run.trial058.stdout:42949672968 2026-02-20T12:05:03.610 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T12:05:03.611 INFO:teuthology.orchestra.run.trial058.stdout:38654705673 2026-02-20T12:05:03.612 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T12:05:03.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.724+0000 7f30bf051640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.729 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.724+0000 7f0c5b0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.731 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.729+0000 7f30bf051640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.730+0000 7f0c5b0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.732 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.727+0000 7f29e42cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.737 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:03.736+0000 7f29e42cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:03.845 INFO:teuthology.orchestra.run.trial058.stdout:42949672968 2026-02-20T12:05:03.845 INFO:teuthology.orchestra.run.trial058.stdout:42949672965 2026-02-20T12:05:03.853 INFO:teuthology.orchestra.run.trial058.stdout:38654705673 2026-02-20T12:05:03.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.0 2026-02-20T12:05:03.858 DEBUG:teuthology.parallel:result is None 2026-02-20T12:05:03.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672965 for osd.2 2026-02-20T12:05:03.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.1 2026-02-20T12:05:03.864 DEBUG:teuthology.parallel:result is None 2026-02-20T12:05:04.860 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T12:05:04.937 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:04.933+0000 7f2b4810b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:04.939 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:04.937+0000 7f2b4810b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:05.051 INFO:teuthology.orchestra.run.trial058.stdout:42949672968 2026-02-20T12:05:05.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.2 2026-02-20T12:05:05.060 DEBUG:teuthology.parallel:result is None 2026-02-20T12:05:05.060 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T12:05:05.060 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T12:05:05.137 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:05.132+0000 7fb3d3193640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:05.139 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:05.137+0000 7fb3d3193640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:05.248 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:05:05.249 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-20T12:05:05.257 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-20T12:05:03.989370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80852,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":80256,"kb_avail":283034668,"statfs":{"total":289910292480,"available":289827500032,"internally_reserved":0,"allocated":561152,"data_stored":1293892,"data_compressed":61146,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82182144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.388616"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.614760+0000","last_change":"2026-02-20T12:05:02.620099+0000","last_active":"2026-02-20T12:05:02.614760+0000","last_peered":"2026-02-20T12:05:02.614760+0000","last_clean":"2026-02-20T12:05:02.614760+0000","last_became_active":"2026-02-20T12:05:00.637133+0000","last_became_peered":"2026-02-20T12:05:00.637133+0000","last_unstale":"2026-02-20T12:05:02.614760+0000","last_undegraded":"2026-02-20T12:05:02.614760+0000","last_fullsized":"2026-02-20T12:05:02.614760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.616821+0000","last_change":"2026-02-20T12:05:02.617908+0000","last_active":"2026-02-20T12:05:02.616821+0000","last_peered":"2026-02-20T12:05:02.616821+0000","last_clean":"2026-02-20T12:05:02.616821+0000","last_became_active":"2026-02-20T12:05:00.644220+0000","last_became_peered":"2026-02-20T12:05:00.644220+0000","last_unstale":"2026-02-20T12:05:02.616821+0000","last_undegraded":"2026-02-20T12:05:02.616821+0000","last_fullsized":"2026-02-20T12:05:02.616821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.613179+0000","last_change":"2026-02-20T12:05:02.619693+0000","last_active":"2026-02-20T12:05:02.613179+0000","last_peered":"2026-02-20T12:05:02.613179+0000","last_clean":"2026-02-20T12:05:02.613179+0000","last_became_active":"2026-02-20T12:05:00.631189+0000","last_became_peered":"2026-02-20T12:05:00.631189+0000","last_unstale":"2026-02-20T12:05:02.613179+0000","last_undegraded":"2026-02-20T12:05:02.613179+0000","last_fullsized":"2026-02-20T12:05:02.613179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.615371+0000","last_change":"2026-02-20T12:05:02.616706+0000","last_active":"2026-02-20T12:05:02.615371+0000","last_peered":"2026-02-20T12:05:02.615371+0000","last_clean":"2026-02-20T12:05:02.615371+0000","last_became_active":"2026-02-20T12:05:00.646307+0000","last_became_peered":"2026-02-20T12:05:00.646307+0000","last_unstale":"2026-02-20T12:05:02.615371+0000","last_undegraded":"2026-02-20T12:05:02.615371+0000","last_fullsized":"2026-02-20T12:05:02.615371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.616462+0000","last_change":"2026-02-20T12:05:02.616462+0000","last_active":"2026-02-20T12:05:02.616462+0000","last_peered":"2026-02-20T12:05:02.616462+0000","last_clean":"2026-02-20T12:05:02.616462+0000","last_became_active":"2026-02-20T12:05:00.637028+0000","last_became_peered":"2026-02-20T12:05:00.637028+0000","last_unstale":"2026-02-20T12:05:02.616462+0000","last_undegraded":"2026-02-20T12:05:02.616462+0000","last_fullsized":"2026-02-20T12:05:02.616462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.614014+0000","last_change":"2026-02-20T12:05:02.615379+0000","last_active":"2026-02-20T12:05:02.614014+0000","last_peered":"2026-02-20T12:05:02.614014+0000","last_clean":"2026-02-20T12:05:02.614014+0000","last_became_active":"2026-02-20T12:05:00.636679+0000","last_became_peered":"2026-02-20T12:05:00.636679+0000","last_unstale":"2026-02-20T12:05:02.614014+0000","last_undegraded":"2026-02-20T12:05:02.614014+0000","last_fullsized":"2026-02-20T12:05:02.614014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.612020+0000","last_change":"2026-02-20T12:05:02.614235+0000","last_active":"2026-02-20T12:05:02.612020+0000","last_peered":"2026-02-20T12:05:02.612020+0000","last_clean":"2026-02-20T12:05:02.612020+0000","last_became_active":"2026-02-20T12:05:00.630351+0000","last_became_peered":"2026-02-20T12:05:00.630351+0000","last_unstale":"2026-02-20T12:05:02.612020+0000","last_undegraded":"2026-02-20T12:05:02.612020+0000","last_fullsized":"2026-02-20T12:05:02.612020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.615349+0000","last_change":"2026-02-20T12:05:02.616884+0000","last_active":"2026-02-20T12:05:02.615349+0000","last_peered":"2026-02-20T12:05:02.615349+0000","last_clean":"2026-02-20T12:05:02.615349+0000","last_became_active":"2026-02-20T12:05:00.629266+0000","last_became_peered":"2026-02-20T12:05:00.629266+0000","last_unstale":"2026-02-20T12:05:02.615349+0000","last_undegraded":"2026-02-20T12:05:02.615349+0000","last_fullsized":"2026-02-20T12:05:02.615349+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":90,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.614144+0000","last_change":"2026-02-20T12:04:57.360938+0000","last_active":"2026-02-20T12:05:02.614144+0000","last_peered":"2026-02-20T12:05:02.614144+0000","last_clean":"2026-02-20T12:05:02.614144+0000","last_became_active":"2026-02-20T12:04:57.357761+0000","last_became_peered":"2026-02-20T12:04:57.357761+0000","last_unstale":"2026-02-20T12:05:02.614144+0000","last_undegraded":"2026-02-20T12:05:02.614144+0000","last_fullsized":"2026-02-20T12:05:02.614144+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:56.337799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:56.337799+0000","last_clean_scrub_stamp":"2026-02-20T12:04:56.337799+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26972,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344868,"statfs":{"total":96636764160,"available":96609144832,"internally_reserved":0,"allocated":208896,"data_stored":628093,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26908,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344932,"statfs":{"total":96636764160,"available":96609210368,"internally_reserved":0,"allocated":143360,"data_stored":37706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26972,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344868,"statfs":{"total":96636764160,"available":96609144832,"internally_reserved":0,"allocated":208896,"data_stored":628093,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T12:05:05.259 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T12:05:05.333 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:05.329+0000 7fb6343c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:05.335 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:05.333+0000 7fb6343c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:05.445 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:05:05.445 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-20T12:05:05.454 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2026-02-20T12:05:03.989370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":80852,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":80256,"kb_avail":283034668,"statfs":{"total":289910292480,"available":289827500032,"internally_reserved":0,"allocated":561152,"data_stored":1293892,"data_compressed":61146,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82182144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.388616"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.614760+0000","last_change":"2026-02-20T12:05:02.620099+0000","last_active":"2026-02-20T12:05:02.614760+0000","last_peered":"2026-02-20T12:05:02.614760+0000","last_clean":"2026-02-20T12:05:02.614760+0000","last_became_active":"2026-02-20T12:05:00.637133+0000","last_became_peered":"2026-02-20T12:05:00.637133+0000","last_unstale":"2026-02-20T12:05:02.614760+0000","last_undegraded":"2026-02-20T12:05:02.614760+0000","last_fullsized":"2026-02-20T12:05:02.614760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.616821+0000","last_change":"2026-02-20T12:05:02.617908+0000","last_active":"2026-02-20T12:05:02.616821+0000","last_peered":"2026-02-20T12:05:02.616821+0000","last_clean":"2026-02-20T12:05:02.616821+0000","last_became_active":"2026-02-20T12:05:00.644220+0000","last_became_peered":"2026-02-20T12:05:00.644220+0000","last_unstale":"2026-02-20T12:05:02.616821+0000","last_undegraded":"2026-02-20T12:05:02.616821+0000","last_fullsized":"2026-02-20T12:05:02.616821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.613179+0000","last_change":"2026-02-20T12:05:02.619693+0000","last_active":"2026-02-20T12:05:02.613179+0000","last_peered":"2026-02-20T12:05:02.613179+0000","last_clean":"2026-02-20T12:05:02.613179+0000","last_became_active":"2026-02-20T12:05:00.631189+0000","last_became_peered":"2026-02-20T12:05:00.631189+0000","last_unstale":"2026-02-20T12:05:02.613179+0000","last_undegraded":"2026-02-20T12:05:02.613179+0000","last_fullsized":"2026-02-20T12:05:02.613179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.615371+0000","last_change":"2026-02-20T12:05:02.616706+0000","last_active":"2026-02-20T12:05:02.615371+0000","last_peered":"2026-02-20T12:05:02.615371+0000","last_clean":"2026-02-20T12:05:02.615371+0000","last_became_active":"2026-02-20T12:05:00.646307+0000","last_became_peered":"2026-02-20T12:05:00.646307+0000","last_unstale":"2026-02-20T12:05:02.615371+0000","last_undegraded":"2026-02-20T12:05:02.615371+0000","last_fullsized":"2026-02-20T12:05:02.615371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.616462+0000","last_change":"2026-02-20T12:05:02.616462+0000","last_active":"2026-02-20T12:05:02.616462+0000","last_peered":"2026-02-20T12:05:02.616462+0000","last_clean":"2026-02-20T12:05:02.616462+0000","last_became_active":"2026-02-20T12:05:00.637028+0000","last_became_peered":"2026-02-20T12:05:00.637028+0000","last_unstale":"2026-02-20T12:05:02.616462+0000","last_undegraded":"2026-02-20T12:05:02.616462+0000","last_fullsized":"2026-02-20T12:05:02.616462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.614014+0000","last_change":"2026-02-20T12:05:02.615379+0000","last_active":"2026-02-20T12:05:02.614014+0000","last_peered":"2026-02-20T12:05:02.614014+0000","last_clean":"2026-02-20T12:05:02.614014+0000","last_became_active":"2026-02-20T12:05:00.636679+0000","last_became_peered":"2026-02-20T12:05:00.636679+0000","last_unstale":"2026-02-20T12:05:02.614014+0000","last_undegraded":"2026-02-20T12:05:02.614014+0000","last_fullsized":"2026-02-20T12:05:02.614014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.612020+0000","last_change":"2026-02-20T12:05:02.614235+0000","last_active":"2026-02-20T12:05:02.612020+0000","last_peered":"2026-02-20T12:05:02.612020+0000","last_clean":"2026-02-20T12:05:02.612020+0000","last_became_active":"2026-02-20T12:05:00.630351+0000","last_became_peered":"2026-02-20T12:05:00.630351+0000","last_unstale":"2026-02-20T12:05:02.612020+0000","last_undegraded":"2026-02-20T12:05:02.612020+0000","last_fullsized":"2026-02-20T12:05:02.612020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.615349+0000","last_change":"2026-02-20T12:05:02.616884+0000","last_active":"2026-02-20T12:05:02.615349+0000","last_peered":"2026-02-20T12:05:02.615349+0000","last_clean":"2026-02-20T12:05:02.615349+0000","last_became_active":"2026-02-20T12:05:00.629266+0000","last_became_peered":"2026-02-20T12:05:00.629266+0000","last_unstale":"2026-02-20T12:05:02.615349+0000","last_undegraded":"2026-02-20T12:05:02.615349+0000","last_fullsized":"2026-02-20T12:05:02.615349+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":90,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T12:05:02.614144+0000","last_change":"2026-02-20T12:04:57.360938+0000","last_active":"2026-02-20T12:05:02.614144+0000","last_peered":"2026-02-20T12:05:02.614144+0000","last_clean":"2026-02-20T12:05:02.614144+0000","last_became_active":"2026-02-20T12:04:57.357761+0000","last_became_peered":"2026-02-20T12:04:57.357761+0000","last_unstale":"2026-02-20T12:05:02.614144+0000","last_undegraded":"2026-02-20T12:05:02.614144+0000","last_fullsized":"2026-02-20T12:05:02.614144+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:56.337799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:56.337799+0000","last_clean_scrub_stamp":"2026-02-20T12:04:56.337799+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26972,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344868,"statfs":{"total":96636764160,"available":96609144832,"internally_reserved":0,"allocated":208896,"data_stored":628093,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26908,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344932,"statfs":{"total":96636764160,"available":96609210368,"internally_reserved":0,"allocated":143360,"data_stored":37706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26972,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344868,"statfs":{"total":96636764160,"available":96609144832,"internally_reserved":0,"allocated":208896,"data_stored":628093,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T12:05:05.455 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T12:05:05.455 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T12:05:05.455 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-20T12:05:05.455 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-20T12:05:05.530 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:05.526+0000 7f6a3e01a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:05.532 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:05:05.530+0000 7f6a3e01a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:05.669 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:05:05.669 INFO:teuthology.orchestra.run.trial058.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T12:05:05.679 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-20T12:05:05.679 INFO:teuthology.run_tasks:Running task workunit... 2026-02-20T12:05:05.695 INFO:tasks.workunit:Pulling workunits from ref 445d5c9ba18a4040e70e25303230c36c77773acb 2026-02-20T12:05:05.695 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-20T12:05:05.696 DEBUG:teuthology.orchestra.run.trial058:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-20T12:05:05.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:05:05.712 INFO:teuthology.orchestra.run.trial058.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-20T12:05:05.712 DEBUG:teuthology.orchestra.run.trial058:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-20T12:05:05.769 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-20T12:05:05.769 DEBUG:teuthology.orchestra.run.trial058:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-20T12:05:05.825 INFO:tasks.workunit:timeout=3h 2026-02-20T12:05:05.825 INFO:tasks.workunit:cleanup=True 2026-02-20T12:05:05.826 DEBUG:teuthology.orchestra.run.trial058:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 445d5c9ba18a4040e70e25303230c36c77773acb 2026-02-20T12:05:05.888 INFO:tasks.workunit.client.0.trial058.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr:Note: switching to '445d5c9ba18a4040e70e25303230c36c77773acb'. 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr:state without impacting any branches by switching back to a branch. 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr: git switch -c 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr:Or undo this operation with: 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr: git switch - 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-20T12:05:38.843 INFO:tasks.workunit.client.0.trial058.stderr: 2026-02-20T12:05:38.844 INFO:tasks.workunit.client.0.trial058.stderr:HEAD is now at 445d5c9ba18 Merge PR #66907 into main 2026-02-20T12:05:38.844 DEBUG:teuthology.orchestra.run.trial058:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-20T12:05:38.901 INFO:tasks.workunit.client.0.trial058.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-20T12:05:38.904 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-20T12:05:38.904 INFO:tasks.workunit.client.0.trial058.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-20T12:05:38.993 INFO:tasks.workunit.client.0.trial058.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-20T12:05:39.024 INFO:tasks.workunit.client.0.trial058.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-20T12:05:39.050 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-20T12:05:39.052 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-20T12:05:39.052 INFO:tasks.workunit.client.0.trial058.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-20T12:05:39.076 INFO:tasks.workunit.client.0.trial058.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-20T12:05:39.080 DEBUG:teuthology.orchestra.run.trial058:> set -ex 2026-02-20T12:05:39.080 DEBUG:teuthology.orchestra.run.trial058:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-20T12:05:39.137 INFO:tasks.workunit:Running workunits matching rbd/test_librbd_python.sh on client.0... 2026-02-20T12:05:39.139 INFO:tasks.workunit:Running workunit rbd/test_librbd_python.sh... 2026-02-20T12:05:39.139 DEBUG:teuthology.orchestra.run.trial058:workunit test rbd/test_librbd_python.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=445d5c9ba18a4040e70e25303230c36c77773acb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh 2026-02-20T12:05:39.197 INFO:tasks.workunit.client.0.trial058.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh 2026-02-20T12:05:39.198 INFO:tasks.workunit.client.0.trial058.stderr:+ relpath=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../../src/test/pybind 2026-02-20T12:05:39.198 INFO:tasks.workunit.client.0.trial058.stderr:+ '[' -n '' ']' 2026-02-20T12:05:39.198 INFO:tasks.workunit.client.0.trial058.stderr:+ python3 -m pytest -v /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../../src/test/pybind/test_rbd.py 2026-02-20T12:05:39.270 INFO:tasks.workunit.client.0.trial058.stdout:============================= test session starts ============================== 2026-02-20T12:05:39.270 INFO:tasks.workunit.client.0.trial058.stdout:platform linux -- Python 3.9.25, pytest-6.2.2, py-1.10.0, pluggy-0.13.1 -- /usr/bin/python3 2026-02-20T12:05:39.270 INFO:tasks.workunit.client.0.trial058.stdout:cachedir: .pytest_cache 2026-02-20T12:05:39.270 INFO:tasks.workunit.client.0.trial058.stdout:rootdir: /home/ubuntu/cephtest/clone.client.0/src/test/pybind, configfile: pytest.ini 2026-02-20T12:05:39.563 INFO:tasks.workunit.client.0.trial058.stdout:collecting ... collected 196 items 2026-02-20T12:05:39.563 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-20T12:05:42.681 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_version PASSED [ 0%] 2026-02-20T12:05:42.988 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_create PASSED [ 1%] 2026-02-20T12:05:45.875 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_create_defaults PASSED [ 1%] 2026-02-20T12:05:46.315 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_context_manager PASSED [ 2%] 2026-02-20T12:05:48.012 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_open_read_only PASSED [ 2%] 2026-02-20T12:05:49.033 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_open_dne PASSED [ 3%] 2026-02-20T12:05:50.039 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_open_readonly_dne PASSED [ 3%] 2026-02-20T12:05:50.039 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_open_by_id SKIPPED [ 4%] 2026-02-20T12:05:50.444 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_aio_open PASSED [ 4%] 2026-02-20T12:05:50.488 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_remove_dne PASSED [ 5%] 2026-02-20T12:05:50.494 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_list_empty PASSED [ 5%] 2026-02-20T12:05:50.861 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_list PASSED [ 6%] 2026-02-20T12:05:51.187 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_remove_with_progress PASSED [ 6%] 2026-02-20T12:05:51.597 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_remove_canceled PASSED [ 7%] 2026-02-20T12:05:51.920 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_remove_with_progress_except PASSED [ 7%] 2026-02-20T12:05:52.433 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_rename PASSED [ 8%] 2026-02-20T12:05:53.638 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_pool_metadata PASSED [ 8%] 2026-02-20T12:05:53.674 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_config_list PASSED [ 9%] 2026-02-20T12:05:53.700 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_pool_config_set_and_get_and_remove PASSED [ 9%] 2026-02-20T12:05:53.819 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_namespaces PASSED [ 10%] 2026-02-20T12:05:53.820 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_pool_stats SKIPPED [ 10%] 2026-02-20T12:05:53.820 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_features_to_string SKIPPED [ 11%] 2026-02-20T12:05:53.821 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_features_from_string SKIPPED [ 11%] 2026-02-20T12:05:54.193 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_update_features SKIPPED [ 12%] 2026-02-20T12:05:54.536 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_create_with_params SKIPPED [ 12%] 2026-02-20T12:05:54.896 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_id SKIPPED [ 13%] 2026-02-20T12:05:55.265 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_block_name_prefix PASSED [ 13%] 2026-02-20T12:05:55.631 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_data_pool_id PASSED [ 14%] 2026-02-20T12:05:56.005 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_create_timestamp PASSED [ 14%] 2026-02-20T12:05:56.364 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_access_timestamp PASSED [ 15%] 2026-02-20T12:05:56.767 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_modify_timestamp PASSED [ 15%] 2026-02-20T12:05:57.200 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_invalidate_cache PASSED [ 16%] 2026-02-20T12:05:57.576 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_stat PASSED [ 16%] 2026-02-20T12:05:57.951 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_flags PASSED [ 17%] 2026-02-20T12:05:58.348 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_image_auto_close PASSED [ 17%] 2026-02-20T12:05:58.706 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_use_after_close PASSED [ 18%] 2026-02-20T12:05:59.129 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_write PASSED [ 18%] 2026-02-20T12:05:59.549 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_write_with_fadvise_flags PASSED [ 19%] 2026-02-20T12:06:00.002 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_write_zeroes PASSED [ 19%] 2026-02-20T12:06:00.440 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_write_zeroes_thick_provision PASSED [ 20%] 2026-02-20T12:06:00.808 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_read PASSED [ 20%] 2026-02-20T12:06:01.166 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_read_with_fadvise_flags PASSED [ 21%] 2026-02-20T12:06:01.662 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_large_write PASSED [ 21%] 2026-02-20T12:06:02.033 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_large_read PASSED [ 22%] 2026-02-20T12:06:02.449 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_write_read PASSED [ 22%] 2026-02-20T12:06:02.832 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_read_bad_offset PASSED [ 23%] 2026-02-20T12:06:03.248 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_resize PASSED [ 23%] 2026-02-20T12:06:03.661 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_resize_allow_shrink_False PASSED [ 24%] 2026-02-20T12:06:08.042 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_size PASSED [ 25%] 2026-02-20T12:06:08.523 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_resize_down PASSED [ 25%] 2026-02-20T12:06:09.052 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_resize_bytes PASSED [ 26%] 2026-02-20T12:06:09.991 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_copy PASSED [ 26%] 2026-02-20T12:06:10.918 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_copy2 PASSED [ 27%] 2026-02-20T12:06:11.294 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_copy3 SKIPPED [ 27%] 2026-02-20T12:06:15.389 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_deep_copy PASSED [ 28%] 2026-02-20T12:06:15.757 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_deep_copy_clone_v1_to_v1 SKIPPED [ 28%] 2026-02-20T12:06:16.118 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_deep_copy_clone_v1_to_v2 SKIPPED [ 29%] 2026-02-20T12:06:16.486 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_deep_copy_clone_v2_to_v1 SKIPPED [ 29%] 2026-02-20T12:06:16.869 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_deep_copy_clone_v2_to_v2 SKIPPED [ 30%] 2026-02-20T12:06:17.244 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_deep_copy_clone_v1_flatten SKIPPED [ 30%] 2026-02-20T12:06:17.618 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_deep_copy_clone_v2_flatten SKIPPED [ 31%] 2026-02-20T12:06:20.054 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_create_snap PASSED [ 31%] 2026-02-20T12:06:22.071 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_create_snap_exists PASSED [ 32%] 2026-02-20T12:06:28.078 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_create_snap_flags PASSED [ 32%] 2026-02-20T12:06:32.084 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_list_snaps PASSED [ 33%] 2026-02-20T12:06:34.114 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_list_snaps_iterator_auto_close PASSED [ 33%] 2026-02-20T12:06:36.138 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_remove_snap PASSED [ 34%] 2026-02-20T12:06:36.497 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_remove_snap_not_found PASSED [ 34%] 2026-02-20T12:06:36.912 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_remove_snap2 SKIPPED [ 35%] 2026-02-20T12:06:39.134 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_remove_snap_by_id PASSED [ 35%] 2026-02-20T12:06:41.155 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_rename_snap PASSED [ 36%] 2026-02-20T12:06:41.533 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_protect_snap SKIPPED [ 36%] 2026-02-20T12:06:43.165 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_snap_exists PASSED [ 37%] 2026-02-20T12:06:45.135 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_snap_timestamp PASSED [ 37%] 2026-02-20T12:06:53.167 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_limit_snaps PASSED [ 38%] 2026-02-20T12:06:53.516 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_remove_with_exclusive_lock SKIPPED [ 38%] 2026-02-20T12:06:55.910 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_remove_with_snap PASSED [ 39%] 2026-02-20T12:06:56.443 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_remove_with_watcher PASSED [ 39%] 2026-02-20T12:06:57.913 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_rollback_to_snap PASSED [ 40%] 2026-02-20T12:06:59.923 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_rollback_to_snap_sparse PASSED [ 40%] 2026-02-20T12:07:03.940 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_rollback_with_resize PASSED [ 41%] 2026-02-20T12:07:05.947 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_set_snap PASSED [ 41%] 2026-02-20T12:07:07.965 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_set_no_snap PASSED [ 42%] 2026-02-20T12:07:09.990 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_set_snap_by_id PASSED [ 42%] 2026-02-20T12:07:15.974 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_snap_get_name PASSED [ 43%] 2026-02-20T12:07:21.993 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_snap_get_id PASSED [ 43%] 2026-02-20T12:07:24.010 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_set_snap_sparse PASSED [ 44%] 2026-02-20T12:14:04.012 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_many_snaps PASSED [ 44%] 2026-02-20T12:14:06.039 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_set_snap_deleted PASSED [ 45%] 2026-02-20T12:14:10.033 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_set_snap_recreated PASSED [ 45%] 2026-02-20T12:14:10.485 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_lock_unlock PASSED [ 46%] 2026-02-20T12:14:11.349 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_list_lockers PASSED [ 46%] 2026-02-20T12:14:17.085 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_diff_iterate PASSED [ 47%] 2026-02-20T12:14:17.503 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_diff_iterate_from_trash_snap SKIPPED [ 47%] 2026-02-20T12:14:17.868 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_diff_iterate_exclude_parent SKIPPED [ 48%] 2026-02-20T12:14:18.252 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_aio_read PASSED [ 48%] 2026-02-20T12:14:18.719 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_aio_write PASSED [ 49%] 2026-02-20T12:14:19.162 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_aio_discard PASSED [ 50%] 2026-02-20T12:14:19.597 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_aio_write_zeroes PASSED [ 50%] 2026-02-20T12:14:20.039 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_aio_flush PASSED [ 51%] 2026-02-20T12:14:24.221 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_metadata PASSED [ 51%] 2026-02-20T12:14:24.605 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_watchers_list PASSED [ 52%] 2026-02-20T12:14:25.169 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_config_list PASSED [ 52%] 2026-02-20T12:14:25.682 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_image_config_set_and_get_and_remove PASSED [ 53%] 2026-02-20T12:14:26.076 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_sparsify PASSED [ 53%] 2026-02-20T12:14:34.925 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_encryption_luks1 PASSED [ 54%] 2026-02-20T12:14:48.773 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImage::test_encryption_luks2 PASSED [ 54%] 2026-02-20T12:14:49.198 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImageId::test_read PASSED [ 55%] 2026-02-20T12:14:49.706 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImageId::test_write PASSED [ 55%] 2026-02-20T12:14:50.194 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestImageId::test_resize PASSED [ 56%] 2026-02-20T12:14:50.195 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_with_params SKIPPED [ 56%] 2026-02-20T12:14:50.196 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_with_params2 SKIPPED [ 57%] 2026-02-20T12:14:50.196 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_with_params3 SKIPPED [ 57%] 2026-02-20T12:14:50.197 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_stripe_unit_and_count SKIPPED [ 58%] 2026-02-20T12:14:50.197 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_clone_format SKIPPED [ 58%] 2026-02-20T12:14:50.198 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_unprotected SKIPPED [ 59%] 2026-02-20T12:14:50.198 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_unprotect_with_children SKIPPED [ 59%] 2026-02-20T12:14:50.198 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_clone_by_snap_id SKIPPED [ 60%] 2026-02-20T12:14:50.201 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_stat SKIPPED [ 60%] 2026-02-20T12:14:50.201 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_resize_stat SKIPPED [ 61%] 2026-02-20T12:14:50.201 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_resize_io SKIPPED [ 61%] 2026-02-20T12:14:50.201 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_read SKIPPED [ 62%] 2026-02-20T12:14:50.201 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_write SKIPPED [ 62%] 2026-02-20T12:14:50.201 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_list_children SKIPPED [ 63%] 2026-02-20T12:14:50.201 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_flatten_errors SKIPPED [ 63%] 2026-02-20T12:14:50.203 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_flatten_basic SKIPPED [ 64%] 2026-02-20T12:14:50.203 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_flatten_smaller_order SKIPPED [ 64%] 2026-02-20T12:14:50.203 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_flatten_larger_order SKIPPED [ 65%] 2026-02-20T12:14:50.203 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_flatten_drops_cache SKIPPED [ 65%] 2026-02-20T12:14:50.203 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_flatten_multi_level SKIPPED [ 66%] 2026-02-20T12:14:50.203 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_flatten_with_progress SKIPPED [ 66%] 2026-02-20T12:14:50.205 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_resize_flatten_multi_level SKIPPED [ 67%] 2026-02-20T12:14:50.205 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_trash_snapshot SKIPPED [ 67%] 2026-02-20T12:14:50.205 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_encryption_luks1 SKIPPED [ 68%] 2026-02-20T12:14:50.205 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestClone::test_encryption_luks2 SKIPPED [ 68%] 2026-02-20T12:14:50.205 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestExclusiveLock::test_ownership SKIPPED [ 69%] 2026-02-20T12:14:50.206 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestExclusiveLock::test_snapshot_leadership SKIPPED [ 69%] 2026-02-20T12:14:50.206 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestExclusiveLock::test_read_only_leadership SKIPPED [ 70%] 2026-02-20T12:14:50.207 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestExclusiveLock::test_follower_flatten SKIPPED [ 70%] 2026-02-20T12:14:50.207 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestExclusiveLock::test_follower_resize SKIPPED [ 71%] 2026-02-20T12:14:50.208 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestExclusiveLock::test_follower_snap_create SKIPPED [ 71%] 2026-02-20T12:14:50.208 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestExclusiveLock::test_follower_snap_rollback SKIPPED [ 72%] 2026-02-20T12:14:50.208 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestExclusiveLock::test_follower_discard SKIPPED [ 72%] 2026-02-20T12:14:50.208 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestExclusiveLock::test_follower_write SKIPPED [ 73%] 2026-02-20T12:14:50.209 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestExclusiveLock::test_acquire_release_lock SKIPPED [ 73%] 2026-02-20T12:14:50.209 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestExclusiveLock::test_break_lock SKIPPED [ 74%] 2026-02-20T12:14:50.641 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMirroring::test_uuid PASSED [ 75%] 2026-02-20T12:14:51.072 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMirroring::test_site_name PASSED [ 75%] 2026-02-20T12:14:51.901 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMirroring::test_mirror_remote_namespace PASSED [ 76%] 2026-02-20T12:14:52.387 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMirroring::test_mirror_peer_bootstrap PASSED [ 76%] 2026-02-20T12:14:52.893 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMirroring::test_mirror_peer PASSED [ 77%] 2026-02-20T12:14:53.335 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMirroring::test_mirror_image SKIPPED [ 77%] 2026-02-20T12:14:53.788 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMirroring::test_mirror_image_status SKIPPED [ 78%] 2026-02-20T12:15:02.285 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMirroring::test_mirror_image_create_snapshot PASSED [ 78%] 2026-02-20T12:15:06.373 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMirroring::test_aio_mirror_image_create_snapshot PASSED [ 79%] 2026-02-20T12:15:06.705 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestTrash::test_move PASSED [ 79%] 2026-02-20T12:15:07.380 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestTrash::test_purge PASSED [ 80%] 2026-02-20T12:15:07.727 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestTrash::test_remove_denied PASSED [ 80%] 2026-02-20T12:15:08.049 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestTrash::test_remove PASSED [ 81%] 2026-02-20T12:15:08.376 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestTrash::test_remove_with_progress PASSED [ 81%] 2026-02-20T12:15:08.710 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestTrash::test_get PASSED [ 82%] 2026-02-20T12:15:09.353 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestTrash::test_list PASSED [ 82%] 2026-02-20T12:15:09.889 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestTrash::test_restore PASSED [ 83%] 2026-02-20T12:15:09.922 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_create_group PASSED [ 83%] 2026-02-20T12:15:09.977 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_rename_group PASSED [ 84%] 2026-02-20T12:15:09.980 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_list_groups_empty PASSED [ 84%] 2026-02-20T12:15:10.013 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_list_groups PASSED [ 85%] 2026-02-20T12:15:10.050 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::test_list_groups_after_removed PASSED [ 85%] 2026-02-20T12:15:10.520 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_image_add PASSED [ 86%] 2026-02-20T12:15:10.935 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_image_list_empty PASSED [ 86%] 2026-02-20T12:15:11.419 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_image_list PASSED [ 87%] 2026-02-20T12:15:12.001 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_image_list_move_to_trash PASSED [ 87%] 2026-02-20T12:15:12.933 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_image_list_remove PASSED [ 88%] 2026-02-20T12:15:13.360 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_get_id PASSED [ 88%] 2026-02-20T12:15:22.015 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_image_many_images PASSED [ 89%] 2026-02-20T12:15:22.615 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_image_remove PASSED [ 89%] 2026-02-20T12:15:25.524 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_snap_get_info PASSED [ 90%] 2026-02-20T12:15:25.973 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_snap_get_info_no_member_images PASSED [ 90%] 2026-02-20T12:15:26.456 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_snap PASSED [ 91%] 2026-02-20T12:15:26.996 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_snap_flags PASSED [ 91%] 2026-02-20T12:16:07.621 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_snap_list_many PASSED [ 92%] 2026-02-20T12:16:10.172 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_snap_namespace PASSED [ 92%] 2026-02-20T12:16:10.703 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_snap_rename PASSED [ 93%] 2026-02-20T12:16:11.165 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_snap_clone SKIPPED [ 93%] 2026-02-20T12:16:11.629 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_snap_clone_flatten SKIPPED [ 94%] 2026-02-20T12:16:14.257 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_snap_diff_iterate PASSED [ 94%] 2026-02-20T12:16:24.881 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestGroups::test_group_snap_rollback PASSED [ 95%] 2026-02-20T12:16:26.278 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMigration::test_migration PASSED [ 95%] 2026-02-20T12:16:26.280 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMigration::test_migration_clone_v1_to_v1 SKIPPED [ 96%] 2026-02-20T12:16:26.280 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMigration::test_migration_clone_v1_to_v2 SKIPPED [ 96%] 2026-02-20T12:16:26.280 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMigration::test_migration_clone_v2_to_v1 SKIPPED [ 97%] 2026-02-20T12:16:26.281 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMigration::test_migration_clone_v2_to_v2 SKIPPED [ 97%] 2026-02-20T12:16:30.339 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMigration::test_migration_import PASSED [ 98%] 2026-02-20T12:16:31.541 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMigration::test_migration_with_progress PASSED [ 98%] 2026-02-20T12:16:32.581 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMigration::test_migrate_abort PASSED [ 99%] 2026-02-20T12:16:33.648 INFO:tasks.workunit.client.0.trial058.stdout:../../../clone.client.0/src/test/pybind/test_rbd.py::TestMigration::test_migrate_abort_with_progress PASSED [100%] 2026-02-20T12:16:33.648 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-20T12:16:33.648 INFO:tasks.workunit.client.0.trial058.stdout:=============================== warnings summary =============================== 2026-02-20T12:16:33.648 INFO:tasks.workunit.client.0.trial058.stdout:test_rbd.py::test_remove_with_progress_except 2026-02-20T12:16:33.648 INFO:tasks.workunit.client.0.trial058.stdout: /usr/lib/python3.9/site-packages/_pytest/unraisableexception.py:78: PytestUnraisableExceptionWarning: Exception ignored in: 'rbd.progress_callback' 2026-02-20T12:16:33.648 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-20T12:16:33.648 INFO:tasks.workunit.client.0.trial058.stdout: Traceback (most recent call last): 2026-02-20T12:16:33.648 INFO:tasks.workunit.client.0.trial058.stdout: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 430, in progress_cb 2026-02-20T12:16:33.649 INFO:tasks.workunit.client.0.trial058.stdout: raise Exception() 2026-02-20T12:16:33.649 INFO:tasks.workunit.client.0.trial058.stdout: Exception 2026-02-20T12:16:33.649 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-20T12:16:33.649 INFO:tasks.workunit.client.0.trial058.stdout: warnings.warn(pytest.PytestUnraisableExceptionWarning(msg)) 2026-02-20T12:16:33.649 INFO:tasks.workunit.client.0.trial058.stdout: 2026-02-20T12:16:33.649 INFO:tasks.workunit.client.0.trial058.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2026-02-20T12:16:33.649 INFO:tasks.workunit.client.0.trial058.stdout:============ 133 passed, 63 skipped, 1 warning in 654.38s (0:10:54) ============ 2026-02-20T12:16:33.695 INFO:tasks.workunit.client.0.trial058.stderr:+ exit 0 2026-02-20T12:16:33.695 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-20T12:16:33.696 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-20T12:16:33.770 INFO:tasks.workunit:Stopping ['rbd/test_librbd_python.sh'] on client.0... 2026-02-20T12:16:33.770 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-20T12:16:34.162 DEBUG:teuthology.parallel:result is None 2026-02-20T12:16:34.163 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-20T12:16:34.188 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-20T12:16:34.189 DEBUG:teuthology.orchestra.run.trial058:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-20T12:16:34.244 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-20T12:16:34.244 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-20T12:16:34.258 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T12:16:34.258 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T12:16:34.361 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:34.356+0000 7f897c7dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:34.363 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:34.361+0000 7f897c7dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:34.475 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:16:34.476 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-20T12:16:34.484 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":920,"stamp":"2026-02-20T12:16:34.091626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":82264,"kb_used_data":1960,"kb_used_omap":4892,"kb_used_meta":75363,"kb_avail":283033256,"statfs":{"total":289910292480,"available":289826054144,"internally_reserved":0,"allocated":2007040,"data_stored":1968691,"data_compressed":61146,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":5009930,"internal_metadata":77172214},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-105,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":-1,"num_read":-338744,"num_read_kb":-37458,"num_write":-8058,"num_write_kb":-41396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000936"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1689,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.648080+0000","last_change":"2026-02-20T12:05:02.620099+0000","last_active":"2026-02-20T12:16:28.648080+0000","last_peered":"2026-02-20T12:16:28.648080+0000","last_clean":"2026-02-20T12:16:28.648080+0000","last_became_active":"2026-02-20T12:05:00.637133+0000","last_became_peered":"2026-02-20T12:05:00.637133+0000","last_unstale":"2026-02-20T12:16:28.648080+0000","last_undegraded":"2026-02-20T12:16:28.648080+0000","last_fullsized":"2026-02-20T12:16:28.648080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1689,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.648748+0000","last_change":"2026-02-20T12:05:02.617908+0000","last_active":"2026-02-20T12:16:28.648748+0000","last_peered":"2026-02-20T12:16:28.648748+0000","last_clean":"2026-02-20T12:16:28.648748+0000","last_became_active":"2026-02-20T12:05:00.644220+0000","last_became_peered":"2026-02-20T12:05:00.644220+0000","last_unstale":"2026-02-20T12:16:28.648748+0000","last_undegraded":"2026-02-20T12:16:28.648748+0000","last_fullsized":"2026-02-20T12:16:28.648748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1689,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.652254+0000","last_change":"2026-02-20T12:05:02.619693+0000","last_active":"2026-02-20T12:16:28.652254+0000","last_peered":"2026-02-20T12:16:28.652254+0000","last_clean":"2026-02-20T12:16:28.652254+0000","last_became_active":"2026-02-20T12:05:00.631189+0000","last_became_peered":"2026-02-20T12:05:00.631189+0000","last_unstale":"2026-02-20T12:16:28.652254+0000","last_undegraded":"2026-02-20T12:16:28.652254+0000","last_fullsized":"2026-02-20T12:16:28.652254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1689,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.653792+0000","last_change":"2026-02-20T12:05:02.616706+0000","last_active":"2026-02-20T12:16:28.653792+0000","last_peered":"2026-02-20T12:16:28.653792+0000","last_clean":"2026-02-20T12:16:28.653792+0000","last_became_active":"2026-02-20T12:05:00.646307+0000","last_became_peered":"2026-02-20T12:05:00.646307+0000","last_unstale":"2026-02-20T12:16:28.653792+0000","last_undegraded":"2026-02-20T12:16:28.653792+0000","last_fullsized":"2026-02-20T12:16:28.653792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":1694,"reported_epoch":576,"state":"active+clean","last_fresh":"2026-02-20T12:16:29.655285+0000","last_change":"2026-02-20T12:05:02.616462+0000","last_active":"2026-02-20T12:16:29.655285+0000","last_peered":"2026-02-20T12:16:29.655285+0000","last_clean":"2026-02-20T12:16:29.655285+0000","last_became_active":"2026-02-20T12:05:00.637028+0000","last_became_peered":"2026-02-20T12:05:00.637028+0000","last_unstale":"2026-02-20T12:16:29.655285+0000","last_undegraded":"2026-02-20T12:16:29.655285+0000","last_fullsized":"2026-02-20T12:16:29.655285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1692,"reported_epoch":576,"state":"active+clean","last_fresh":"2026-02-20T12:16:29.650033+0000","last_change":"2026-02-20T12:05:02.615379+0000","last_active":"2026-02-20T12:16:29.650033+0000","last_peered":"2026-02-20T12:16:29.650033+0000","last_clean":"2026-02-20T12:16:29.650033+0000","last_became_active":"2026-02-20T12:05:00.636679+0000","last_became_peered":"2026-02-20T12:05:00.636679+0000","last_unstale":"2026-02-20T12:16:29.650033+0000","last_undegraded":"2026-02-20T12:16:29.650033+0000","last_fullsized":"2026-02-20T12:16:29.650033+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1692,"reported_epoch":576,"state":"active+clean","last_fresh":"2026-02-20T12:16:29.646082+0000","last_change":"2026-02-20T12:05:02.614235+0000","last_active":"2026-02-20T12:16:29.646082+0000","last_peered":"2026-02-20T12:16:29.646082+0000","last_clean":"2026-02-20T12:16:29.646082+0000","last_became_active":"2026-02-20T12:05:00.630351+0000","last_became_peered":"2026-02-20T12:05:00.630351+0000","last_unstale":"2026-02-20T12:16:29.646082+0000","last_undegraded":"2026-02-20T12:16:29.646082+0000","last_fullsized":"2026-02-20T12:16:29.646082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":1690,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.649643+0000","last_change":"2026-02-20T12:05:02.616884+0000","last_active":"2026-02-20T12:16:28.649643+0000","last_peered":"2026-02-20T12:16:28.649643+0000","last_clean":"2026-02-20T12:16:28.649643+0000","last_became_active":"2026-02-20T12:05:00.629266+0000","last_became_peered":"2026-02-20T12:05:00.629266+0000","last_unstale":"2026-02-20T12:16:28.649643+0000","last_undegraded":"2026-02-20T12:16:28.649643+0000","last_fullsized":"2026-02-20T12:16:28.649643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":1764,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.647874+0000","last_change":"2026-02-20T12:04:57.360938+0000","last_active":"2026-02-20T12:16:28.647874+0000","last_peered":"2026-02-20T12:16:28.647874+0000","last_clean":"2026-02-20T12:16:28.647874+0000","last_became_active":"2026-02-20T12:04:57.357761+0000","last_became_peered":"2026-02-20T12:04:57.357761+0000","last_unstale":"2026-02-20T12:16:28.647874+0000","last_undegraded":"2026-02-20T12:16:28.647874+0000","last_fullsized":"2026-02-20T12:16:28.647874+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:56.337799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:56.337799+0000","last_clean_scrub_stamp":"2026-02-20T12:04:56.337799+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654706358,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":692224,"data_stored":850692,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":616,"kb_used_omap":2083,"kb_used_meta":24668,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":630784,"data_stored":263854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2133000,"internal_metadata":25261048},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":668,"kb_used_omap":2809,"kb_used_meta":23942,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":684032,"data_stored":854145,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":2876930,"internal_metadata":24517118},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T12:16:34.485 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T12:16:34.561 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:34.557+0000 7f431503d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:34.564 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:34.562+0000 7f431503d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:34.674 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:16:34.675 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-20T12:16:34.684 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":920,"stamp":"2026-02-20T12:16:34.091626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":82264,"kb_used_data":1960,"kb_used_omap":4892,"kb_used_meta":75363,"kb_avail":283033256,"statfs":{"total":289910292480,"available":289826054144,"internally_reserved":0,"allocated":2007040,"data_stored":1968691,"data_compressed":61146,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":5009930,"internal_metadata":77172214},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-105,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":-1,"num_read":-338744,"num_read_kb":-37458,"num_write":-8058,"num_write_kb":-41396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000936"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1689,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.648080+0000","last_change":"2026-02-20T12:05:02.620099+0000","last_active":"2026-02-20T12:16:28.648080+0000","last_peered":"2026-02-20T12:16:28.648080+0000","last_clean":"2026-02-20T12:16:28.648080+0000","last_became_active":"2026-02-20T12:05:00.637133+0000","last_became_peered":"2026-02-20T12:05:00.637133+0000","last_unstale":"2026-02-20T12:16:28.648080+0000","last_undegraded":"2026-02-20T12:16:28.648080+0000","last_fullsized":"2026-02-20T12:16:28.648080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1689,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.648748+0000","last_change":"2026-02-20T12:05:02.617908+0000","last_active":"2026-02-20T12:16:28.648748+0000","last_peered":"2026-02-20T12:16:28.648748+0000","last_clean":"2026-02-20T12:16:28.648748+0000","last_became_active":"2026-02-20T12:05:00.644220+0000","last_became_peered":"2026-02-20T12:05:00.644220+0000","last_unstale":"2026-02-20T12:16:28.648748+0000","last_undegraded":"2026-02-20T12:16:28.648748+0000","last_fullsized":"2026-02-20T12:16:28.648748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1689,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.652254+0000","last_change":"2026-02-20T12:05:02.619693+0000","last_active":"2026-02-20T12:16:28.652254+0000","last_peered":"2026-02-20T12:16:28.652254+0000","last_clean":"2026-02-20T12:16:28.652254+0000","last_became_active":"2026-02-20T12:05:00.631189+0000","last_became_peered":"2026-02-20T12:05:00.631189+0000","last_unstale":"2026-02-20T12:16:28.652254+0000","last_undegraded":"2026-02-20T12:16:28.652254+0000","last_fullsized":"2026-02-20T12:16:28.652254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1689,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.653792+0000","last_change":"2026-02-20T12:05:02.616706+0000","last_active":"2026-02-20T12:16:28.653792+0000","last_peered":"2026-02-20T12:16:28.653792+0000","last_clean":"2026-02-20T12:16:28.653792+0000","last_became_active":"2026-02-20T12:05:00.646307+0000","last_became_peered":"2026-02-20T12:05:00.646307+0000","last_unstale":"2026-02-20T12:16:28.653792+0000","last_undegraded":"2026-02-20T12:16:28.653792+0000","last_fullsized":"2026-02-20T12:16:28.653792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":1694,"reported_epoch":576,"state":"active+clean","last_fresh":"2026-02-20T12:16:29.655285+0000","last_change":"2026-02-20T12:05:02.616462+0000","last_active":"2026-02-20T12:16:29.655285+0000","last_peered":"2026-02-20T12:16:29.655285+0000","last_clean":"2026-02-20T12:16:29.655285+0000","last_became_active":"2026-02-20T12:05:00.637028+0000","last_became_peered":"2026-02-20T12:05:00.637028+0000","last_unstale":"2026-02-20T12:16:29.655285+0000","last_undegraded":"2026-02-20T12:16:29.655285+0000","last_fullsized":"2026-02-20T12:16:29.655285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1692,"reported_epoch":576,"state":"active+clean","last_fresh":"2026-02-20T12:16:29.650033+0000","last_change":"2026-02-20T12:05:02.615379+0000","last_active":"2026-02-20T12:16:29.650033+0000","last_peered":"2026-02-20T12:16:29.650033+0000","last_clean":"2026-02-20T12:16:29.650033+0000","last_became_active":"2026-02-20T12:05:00.636679+0000","last_became_peered":"2026-02-20T12:05:00.636679+0000","last_unstale":"2026-02-20T12:16:29.650033+0000","last_undegraded":"2026-02-20T12:16:29.650033+0000","last_fullsized":"2026-02-20T12:16:29.650033+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1692,"reported_epoch":576,"state":"active+clean","last_fresh":"2026-02-20T12:16:29.646082+0000","last_change":"2026-02-20T12:05:02.614235+0000","last_active":"2026-02-20T12:16:29.646082+0000","last_peered":"2026-02-20T12:16:29.646082+0000","last_clean":"2026-02-20T12:16:29.646082+0000","last_became_active":"2026-02-20T12:05:00.630351+0000","last_became_peered":"2026-02-20T12:05:00.630351+0000","last_unstale":"2026-02-20T12:16:29.646082+0000","last_undegraded":"2026-02-20T12:16:29.646082+0000","last_fullsized":"2026-02-20T12:16:29.646082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":1690,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.649643+0000","last_change":"2026-02-20T12:05:02.616884+0000","last_active":"2026-02-20T12:16:28.649643+0000","last_peered":"2026-02-20T12:16:28.649643+0000","last_clean":"2026-02-20T12:16:28.649643+0000","last_became_active":"2026-02-20T12:05:00.629266+0000","last_became_peered":"2026-02-20T12:05:00.629266+0000","last_unstale":"2026-02-20T12:16:28.649643+0000","last_undegraded":"2026-02-20T12:16:28.649643+0000","last_fullsized":"2026-02-20T12:16:28.649643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":1764,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.647874+0000","last_change":"2026-02-20T12:04:57.360938+0000","last_active":"2026-02-20T12:16:28.647874+0000","last_peered":"2026-02-20T12:16:28.647874+0000","last_clean":"2026-02-20T12:16:28.647874+0000","last_became_active":"2026-02-20T12:04:57.357761+0000","last_became_peered":"2026-02-20T12:04:57.357761+0000","last_unstale":"2026-02-20T12:16:28.647874+0000","last_undegraded":"2026-02-20T12:16:28.647874+0000","last_fullsized":"2026-02-20T12:16:28.647874+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:56.337799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:56.337799+0000","last_clean_scrub_stamp":"2026-02-20T12:04:56.337799+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654706358,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":692224,"data_stored":850692,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":616,"kb_used_omap":2083,"kb_used_meta":24668,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":630784,"data_stored":263854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2133000,"internal_metadata":25261048},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":668,"kb_used_omap":2809,"kb_used_meta":23942,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":684032,"data_stored":854145,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":2876930,"internal_metadata":24517118},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T12:16:34.685 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T12:16:34.686 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T12:16:34.762 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:34.757+0000 7f19d2c1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:34.764 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:34.762+0000 7f19d2c1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:34.873 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:16:34.874 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-20T12:16:34.883 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":920,"stamp":"2026-02-20T12:16:34.091626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":82264,"kb_used_data":1960,"kb_used_omap":4892,"kb_used_meta":75363,"kb_avail":283033256,"statfs":{"total":289910292480,"available":289826054144,"internally_reserved":0,"allocated":2007040,"data_stored":1968691,"data_compressed":61146,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":5009930,"internal_metadata":77172214},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-105,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":-1,"num_read":-338744,"num_read_kb":-37458,"num_write":-8058,"num_write_kb":-41396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000936"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1689,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.648080+0000","last_change":"2026-02-20T12:05:02.620099+0000","last_active":"2026-02-20T12:16:28.648080+0000","last_peered":"2026-02-20T12:16:28.648080+0000","last_clean":"2026-02-20T12:16:28.648080+0000","last_became_active":"2026-02-20T12:05:00.637133+0000","last_became_peered":"2026-02-20T12:05:00.637133+0000","last_unstale":"2026-02-20T12:16:28.648080+0000","last_undegraded":"2026-02-20T12:16:28.648080+0000","last_fullsized":"2026-02-20T12:16:28.648080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1689,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.648748+0000","last_change":"2026-02-20T12:05:02.617908+0000","last_active":"2026-02-20T12:16:28.648748+0000","last_peered":"2026-02-20T12:16:28.648748+0000","last_clean":"2026-02-20T12:16:28.648748+0000","last_became_active":"2026-02-20T12:05:00.644220+0000","last_became_peered":"2026-02-20T12:05:00.644220+0000","last_unstale":"2026-02-20T12:16:28.648748+0000","last_undegraded":"2026-02-20T12:16:28.648748+0000","last_fullsized":"2026-02-20T12:16:28.648748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1689,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.652254+0000","last_change":"2026-02-20T12:05:02.619693+0000","last_active":"2026-02-20T12:16:28.652254+0000","last_peered":"2026-02-20T12:16:28.652254+0000","last_clean":"2026-02-20T12:16:28.652254+0000","last_became_active":"2026-02-20T12:05:00.631189+0000","last_became_peered":"2026-02-20T12:05:00.631189+0000","last_unstale":"2026-02-20T12:16:28.652254+0000","last_undegraded":"2026-02-20T12:16:28.652254+0000","last_fullsized":"2026-02-20T12:16:28.652254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1689,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.653792+0000","last_change":"2026-02-20T12:05:02.616706+0000","last_active":"2026-02-20T12:16:28.653792+0000","last_peered":"2026-02-20T12:16:28.653792+0000","last_clean":"2026-02-20T12:16:28.653792+0000","last_became_active":"2026-02-20T12:05:00.646307+0000","last_became_peered":"2026-02-20T12:05:00.646307+0000","last_unstale":"2026-02-20T12:16:28.653792+0000","last_undegraded":"2026-02-20T12:16:28.653792+0000","last_fullsized":"2026-02-20T12:16:28.653792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":1694,"reported_epoch":576,"state":"active+clean","last_fresh":"2026-02-20T12:16:29.655285+0000","last_change":"2026-02-20T12:05:02.616462+0000","last_active":"2026-02-20T12:16:29.655285+0000","last_peered":"2026-02-20T12:16:29.655285+0000","last_clean":"2026-02-20T12:16:29.655285+0000","last_became_active":"2026-02-20T12:05:00.637028+0000","last_became_peered":"2026-02-20T12:05:00.637028+0000","last_unstale":"2026-02-20T12:16:29.655285+0000","last_undegraded":"2026-02-20T12:16:29.655285+0000","last_fullsized":"2026-02-20T12:16:29.655285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1692,"reported_epoch":576,"state":"active+clean","last_fresh":"2026-02-20T12:16:29.650033+0000","last_change":"2026-02-20T12:05:02.615379+0000","last_active":"2026-02-20T12:16:29.650033+0000","last_peered":"2026-02-20T12:16:29.650033+0000","last_clean":"2026-02-20T12:16:29.650033+0000","last_became_active":"2026-02-20T12:05:00.636679+0000","last_became_peered":"2026-02-20T12:05:00.636679+0000","last_unstale":"2026-02-20T12:16:29.650033+0000","last_undegraded":"2026-02-20T12:16:29.650033+0000","last_fullsized":"2026-02-20T12:16:29.650033+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1692,"reported_epoch":576,"state":"active+clean","last_fresh":"2026-02-20T12:16:29.646082+0000","last_change":"2026-02-20T12:05:02.614235+0000","last_active":"2026-02-20T12:16:29.646082+0000","last_peered":"2026-02-20T12:16:29.646082+0000","last_clean":"2026-02-20T12:16:29.646082+0000","last_became_active":"2026-02-20T12:05:00.630351+0000","last_became_peered":"2026-02-20T12:05:00.630351+0000","last_unstale":"2026-02-20T12:16:29.646082+0000","last_undegraded":"2026-02-20T12:16:29.646082+0000","last_fullsized":"2026-02-20T12:16:29.646082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":1690,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.649643+0000","last_change":"2026-02-20T12:05:02.616884+0000","last_active":"2026-02-20T12:16:28.649643+0000","last_peered":"2026-02-20T12:16:28.649643+0000","last_clean":"2026-02-20T12:16:28.649643+0000","last_became_active":"2026-02-20T12:05:00.629266+0000","last_became_peered":"2026-02-20T12:05:00.629266+0000","last_unstale":"2026-02-20T12:16:28.649643+0000","last_undegraded":"2026-02-20T12:16:28.649643+0000","last_fullsized":"2026-02-20T12:16:28.649643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":1764,"reported_epoch":575,"state":"active+clean","last_fresh":"2026-02-20T12:16:28.647874+0000","last_change":"2026-02-20T12:04:57.360938+0000","last_active":"2026-02-20T12:16:28.647874+0000","last_peered":"2026-02-20T12:16:28.647874+0000","last_clean":"2026-02-20T12:16:28.647874+0000","last_became_active":"2026-02-20T12:04:57.357761+0000","last_became_peered":"2026-02-20T12:04:57.357761+0000","last_unstale":"2026-02-20T12:16:28.647874+0000","last_undegraded":"2026-02-20T12:16:28.647874+0000","last_fullsized":"2026-02-20T12:16:28.647874+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:56.337799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:56.337799+0000","last_clean_scrub_stamp":"2026-02-20T12:04:56.337799+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654706358,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":692224,"data_stored":850692,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":616,"kb_used_omap":2083,"kb_used_meta":24668,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":630784,"data_stored":263854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2133000,"internal_metadata":25261048},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":668,"kb_used_omap":2809,"kb_used_meta":23942,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":684032,"data_stored":854145,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":2876930,"internal_metadata":24517118},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T12:16:34.885 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T12:16:34.962 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:34.957+0000 7f57ace46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:34.964 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:34.962+0000 7f57ace46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:35.076 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:16:35.077 INFO:teuthology.orchestra.run.trial058.stdout:{"epoch":577,"fsid":"21851b77-bde8-4289-9cff-a647d5e308c7","created":"2026-02-20T12:04:43.538448+0000","modified":"2026-02-20T12:16:33.639714+0000","last_up_change":"2026-02-20T12:04:55.332193+0000","last_in_change":"2026-02-20T12:04:45.299504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T12:04:56.003566+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T12:04:59.238977+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c03c48db-00dc-4ccb-8179-68227b5ef076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6805","nonce":227985633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6804","nonce":227985633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6810","nonce":227985633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6812","nonce":227985633}]},"public_addr":"10.20.193.58:6805/227985633","cluster_addr":"10.20.193.58:6804/227985633","heartbeat_back_addr":"10.20.193.58:6810/227985633","heartbeat_front_addr":"10.20.193.58:6812/227985633","state":["exists","up"]},{"osd":1,"uuid":"f6cdcbc7-bbb2-4c63-a8b6-5cc616a122ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6802","nonce":1329192065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6803","nonce":1329192065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6806","nonce":1329192065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6809","nonce":1329192065}]},"public_addr":"10.20.193.58:6802/1329192065","cluster_addr":"10.20.193.58:6803/1329192065","heartbeat_back_addr":"10.20.193.58:6806/1329192065","heartbeat_front_addr":"10.20.193.58:6809/1329192065","state":["exists","up"]},{"osd":2,"uuid":"4c8b41a2-6cb9-450d-8833-a7a78d405999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6807","nonce":2976858905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6808","nonce":2976858905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6811","nonce":2976858905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.58:6813","nonce":2976858905}]},"public_addr":"10.20.193.58:6807/2976858905","cluster_addr":"10.20.193.58:6808/2976858905","heartbeat_back_addr":"10.20.193.58:6811/2976858905","heartbeat_front_addr":"10.20.193.58:6813/2976858905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":3,"snaps":[{"begin":2,"length":302}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T12:16:36.087 INFO:tasks.ceph:Scrubbing osd.0 2026-02-20T12:16:36.088 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-20T12:16:36.167 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:36.160+0000 7f60b3b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:36.169 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:36.167+0000 7f60b3b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:36.180 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-20T12:16:36.180 INFO:teuthology.orchestra.run.trial058.stdout: "success": "" 2026-02-20T12:16:36.180 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-20T12:16:36.187 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-20T12:16:36.265 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:36.260+0000 7fb13015b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:36.267 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:36.265+0000 7fb13015b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:36.380 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 0 to deep-scrub 2026-02-20T12:16:36.392 INFO:tasks.ceph:Scrubbing osd.1 2026-02-20T12:16:36.392 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-20T12:16:36.471 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:36.464+0000 7ffb10b9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:36.473 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:36.471+0000 7ffb10b9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:36.482 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-20T12:16:36.482 INFO:teuthology.orchestra.run.trial058.stdout: "success": "" 2026-02-20T12:16:36.483 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-20T12:16:36.490 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-20T12:16:36.568 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:36.562+0000 7f1a51d6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:36.570 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:36.568+0000 7f1a51d6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:36.682 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 1 to deep-scrub 2026-02-20T12:16:36.695 INFO:tasks.ceph:Scrubbing osd.2 2026-02-20T12:16:36.696 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-20T12:16:36.775 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:36.767+0000 7f708eacb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:36.777 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:36.775+0000 7f708eacb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:36.786 INFO:teuthology.orchestra.run.trial058.stdout:{ 2026-02-20T12:16:36.786 INFO:teuthology.orchestra.run.trial058.stdout: "success": "" 2026-02-20T12:16:36.787 INFO:teuthology.orchestra.run.trial058.stdout:} 2026-02-20T12:16:36.795 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-20T12:16:36.873 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:36.867+0000 7f6e22bec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:36.875 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:36.873+0000 7f6e22bec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:36.985 INFO:teuthology.orchestra.run.trial058.stderr:instructed osd(s) 2 to deep-scrub 2026-02-20T12:16:36.996 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T12:16:37.073 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:37.069+0000 7f78f35dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:37.075 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:37.074+0000 7f78f35dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:37.185 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:16:37.185 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-20T12:16:37.195 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":921,"stamp":"2026-02-20T12:16:36.091884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":82276,"kb_used_data":1972,"kb_used_omap":4446,"kb_used_meta":75809,"kb_avail":283033244,"statfs":{"total":289910292480,"available":289826041856,"internally_reserved":0,"allocated":2019328,"data_stored":1989081,"data_compressed":61146,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4553202,"internal_metadata":77628942},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-105,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":-1,"num_read":-338744,"num_read_kb":-37458,"num_write":-8058,"num_write_kb":-41396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.452084"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1695,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:33.654037+0000","last_change":"2026-02-20T12:05:02.620099+0000","last_active":"2026-02-20T12:16:33.654037+0000","last_peered":"2026-02-20T12:16:33.654037+0000","last_clean":"2026-02-20T12:16:33.654037+0000","last_became_active":"2026-02-20T12:05:00.637133+0000","last_became_peered":"2026-02-20T12:05:00.637133+0000","last_unstale":"2026-02-20T12:16:33.654037+0000","last_undegraded":"2026-02-20T12:16:33.654037+0000","last_fullsized":"2026-02-20T12:16:33.654037+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1695,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:33.669060+0000","last_change":"2026-02-20T12:05:02.617908+0000","last_active":"2026-02-20T12:16:33.669060+0000","last_peered":"2026-02-20T12:16:33.669060+0000","last_clean":"2026-02-20T12:16:33.669060+0000","last_became_active":"2026-02-20T12:05:00.644220+0000","last_became_peered":"2026-02-20T12:05:00.644220+0000","last_unstale":"2026-02-20T12:16:33.669060+0000","last_undegraded":"2026-02-20T12:16:33.669060+0000","last_fullsized":"2026-02-20T12:16:33.669060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1695,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:33.663782+0000","last_change":"2026-02-20T12:05:02.619693+0000","last_active":"2026-02-20T12:16:33.663782+0000","last_peered":"2026-02-20T12:16:33.663782+0000","last_clean":"2026-02-20T12:16:33.663782+0000","last_became_active":"2026-02-20T12:05:00.631189+0000","last_became_peered":"2026-02-20T12:05:00.631189+0000","last_unstale":"2026-02-20T12:16:33.663782+0000","last_undegraded":"2026-02-20T12:16:33.663782+0000","last_fullsized":"2026-02-20T12:16:33.663782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1695,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:33.661372+0000","last_change":"2026-02-20T12:05:02.616706+0000","last_active":"2026-02-20T12:16:33.661372+0000","last_peered":"2026-02-20T12:16:33.661372+0000","last_clean":"2026-02-20T12:16:33.661372+0000","last_became_active":"2026-02-20T12:05:00.646307+0000","last_became_peered":"2026-02-20T12:05:00.646307+0000","last_unstale":"2026-02-20T12:16:33.661372+0000","last_undegraded":"2026-02-20T12:16:33.661372+0000","last_fullsized":"2026-02-20T12:16:33.661372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":1697,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:33.666378+0000","last_change":"2026-02-20T12:05:02.616462+0000","last_active":"2026-02-20T12:16:33.666378+0000","last_peered":"2026-02-20T12:16:33.666378+0000","last_clean":"2026-02-20T12:16:33.666378+0000","last_became_active":"2026-02-20T12:05:00.637028+0000","last_became_peered":"2026-02-20T12:05:00.637028+0000","last_unstale":"2026-02-20T12:16:33.666378+0000","last_undegraded":"2026-02-20T12:16:33.666378+0000","last_fullsized":"2026-02-20T12:16:33.666378+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1695,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:33.657240+0000","last_change":"2026-02-20T12:05:02.615379+0000","last_active":"2026-02-20T12:16:33.657240+0000","last_peered":"2026-02-20T12:16:33.657240+0000","last_clean":"2026-02-20T12:16:33.657240+0000","last_became_active":"2026-02-20T12:05:00.636679+0000","last_became_peered":"2026-02-20T12:05:00.636679+0000","last_unstale":"2026-02-20T12:16:33.657240+0000","last_undegraded":"2026-02-20T12:16:33.657240+0000","last_fullsized":"2026-02-20T12:16:33.657240+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1695,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:33.656815+0000","last_change":"2026-02-20T12:05:02.614235+0000","last_active":"2026-02-20T12:16:33.656815+0000","last_peered":"2026-02-20T12:16:33.656815+0000","last_clean":"2026-02-20T12:16:33.656815+0000","last_became_active":"2026-02-20T12:05:00.630351+0000","last_became_peered":"2026-02-20T12:05:00.630351+0000","last_unstale":"2026-02-20T12:16:33.656815+0000","last_undegraded":"2026-02-20T12:16:33.656815+0000","last_fullsized":"2026-02-20T12:16:33.656815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":1696,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:33.663788+0000","last_change":"2026-02-20T12:05:02.616884+0000","last_active":"2026-02-20T12:16:33.663788+0000","last_peered":"2026-02-20T12:16:33.663788+0000","last_clean":"2026-02-20T12:16:33.663788+0000","last_became_active":"2026-02-20T12:05:00.629266+0000","last_became_peered":"2026-02-20T12:05:00.629266+0000","last_unstale":"2026-02-20T12:16:33.663788+0000","last_undegraded":"2026-02-20T12:16:33.663788+0000","last_fullsized":"2026-02-20T12:16:33.663788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:59.598419+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":1770,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:33.649933+0000","last_change":"2026-02-20T12:04:57.360938+0000","last_active":"2026-02-20T12:16:33.649933+0000","last_peered":"2026-02-20T12:16:33.649933+0000","last_clean":"2026-02-20T12:16:33.649933+0000","last_became_active":"2026-02-20T12:04:57.357761+0000","last_became_peered":"2026-02-20T12:04:57.357761+0000","last_unstale":"2026-02-20T12:16:33.649933+0000","last_undegraded":"2026-02-20T12:16:33.649933+0000","last_fullsized":"2026-02-20T12:16:33.649933+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:04:56.337799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:04:56.337799+0000","last_clean_scrub_stamp":"2026-02-20T12:04:56.337799+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654706363,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":26752,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":692224,"data_stored":857724,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27394048},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":616,"kb_used_omap":2111,"kb_used_meta":24640,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":630784,"data_stored":270485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2162160,"internal_metadata":25231888},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":680,"kb_used_omap":2335,"kb_used_meta":24416,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":696320,"data_stored":860872,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":2391042,"internal_metadata":25003006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T12:16:37.198 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-20T12:04:59.598419+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=59, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=16, tm_sec=35, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T12:16:37.198 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-20T12:04:59.598419+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=59, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=16, tm_sec=35, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T12:16:37.199 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-20T12:04:59.598419+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=59, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=16, tm_sec=35, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T12:16:37.199 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-20T12:04:59.598419+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=59, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=16, tm_sec=35, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T12:16:37.199 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-20T12:04:59.598419+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=59, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=16, tm_sec=35, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T12:16:37.199 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-20T12:04:59.598419+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=59, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=16, tm_sec=35, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T12:16:37.199 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-20T12:04:59.598419+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=59, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=16, tm_sec=35, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T12:16:37.199 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-20T12:04:59.598419+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=59, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=16, tm_sec=35, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T12:16:37.199 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-20T12:04:56.337799+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=56, tm_wday=4, tm_yday=51, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=20, tm_hour=12, tm_min=16, tm_sec=35, tm_wday=4, tm_yday=51, tm_isdst=0) 2026-02-20T12:16:37.199 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-20T12:16:57.200 DEBUG:teuthology.orchestra.run.trial058:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T12:16:57.280 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:57.277+0000 7fcaa835c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:57.282 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:57.281+0000 7fcaa835c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:57.392 INFO:teuthology.orchestra.run.trial058.stdout: 2026-02-20T12:16:57.392 INFO:teuthology.orchestra.run.trial058.stderr:dumped all 2026-02-20T12:16:57.403 INFO:teuthology.orchestra.run.trial058.stdout:{"pg_ready":true,"pg_map":{"version":931,"stamp":"2026-02-20T12:16:56.095051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":283115520,"kb_used":82280,"kb_used_data":1976,"kb_used_omap":6971,"kb_used_meta":73284,"kb_avail":283033240,"statfs":{"total":289910292480,"available":289826037760,"internally_reserved":0,"allocated":2023424,"data_stored":1992229,"data_compressed":61146,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":7138582,"internal_metadata":75043562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001866"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":1697,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:36.685502+0000","last_change":"2026-02-20T12:16:36.698058+0000","last_active":"2026-02-20T12:16:36.685502+0000","last_peered":"2026-02-20T12:16:36.685502+0000","last_clean":"2026-02-20T12:16:36.685502+0000","last_became_active":"2026-02-20T12:05:00.637133+0000","last_became_peered":"2026-02-20T12:05:00.637133+0000","last_unstale":"2026-02-20T12:16:36.685502+0000","last_undegraded":"2026-02-20T12:16:36.685502+0000","last_fullsized":"2026-02-20T12:16:36.685502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:16:36.698004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:16:36.698004+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1697,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:36.683487+0000","last_change":"2026-02-20T12:16:36.693443+0000","last_active":"2026-02-20T12:16:36.683487+0000","last_peered":"2026-02-20T12:16:36.683487+0000","last_clean":"2026-02-20T12:16:36.683487+0000","last_became_active":"2026-02-20T12:05:00.644220+0000","last_became_peered":"2026-02-20T12:05:00.644220+0000","last_unstale":"2026-02-20T12:16:36.683487+0000","last_undegraded":"2026-02-20T12:16:36.683487+0000","last_fullsized":"2026-02-20T12:16:36.683487+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:16:36.693333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:16:36.693333+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1697,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:36.683014+0000","last_change":"2026-02-20T12:16:36.693691+0000","last_active":"2026-02-20T12:16:36.683014+0000","last_peered":"2026-02-20T12:16:36.683014+0000","last_clean":"2026-02-20T12:16:36.683014+0000","last_became_active":"2026-02-20T12:05:00.631189+0000","last_became_peered":"2026-02-20T12:05:00.631189+0000","last_unstale":"2026-02-20T12:16:36.683014+0000","last_undegraded":"2026-02-20T12:16:36.683014+0000","last_fullsized":"2026-02-20T12:16:36.683014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:16:36.693584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:16:36.693584+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1697,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:36.683363+0000","last_change":"2026-02-20T12:16:36.692717+0000","last_active":"2026-02-20T12:16:36.683363+0000","last_peered":"2026-02-20T12:16:36.683363+0000","last_clean":"2026-02-20T12:16:36.683363+0000","last_became_active":"2026-02-20T12:05:00.646307+0000","last_became_peered":"2026-02-20T12:05:00.646307+0000","last_unstale":"2026-02-20T12:16:36.683363+0000","last_undegraded":"2026-02-20T12:16:36.683363+0000","last_fullsized":"2026-02-20T12:16:36.683363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:16:36.692609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:16:36.692609+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":1699,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:36.379926+0000","last_change":"2026-02-20T12:16:36.385055+0000","last_active":"2026-02-20T12:16:36.379926+0000","last_peered":"2026-02-20T12:16:36.379926+0000","last_clean":"2026-02-20T12:16:36.379926+0000","last_became_active":"2026-02-20T12:05:00.637028+0000","last_became_peered":"2026-02-20T12:05:00.637028+0000","last_unstale":"2026-02-20T12:16:36.379926+0000","last_undegraded":"2026-02-20T12:16:36.379926+0000","last_fullsized":"2026-02-20T12:16:36.379926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'2","last_scrub_stamp":"2026-02-20T12:16:36.384949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:16:36.384949+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1697,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:36.986065+0000","last_change":"2026-02-20T12:16:36.990284+0000","last_active":"2026-02-20T12:16:36.986065+0000","last_peered":"2026-02-20T12:16:36.986065+0000","last_clean":"2026-02-20T12:16:36.986065+0000","last_became_active":"2026-02-20T12:05:00.636679+0000","last_became_peered":"2026-02-20T12:05:00.636679+0000","last_unstale":"2026-02-20T12:16:36.986065+0000","last_undegraded":"2026-02-20T12:16:36.986065+0000","last_fullsized":"2026-02-20T12:16:36.986065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:16:36.990214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:16:36.990214+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1697,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:36.985624+0000","last_change":"2026-02-20T12:16:36.990563+0000","last_active":"2026-02-20T12:16:36.985624+0000","last_peered":"2026-02-20T12:16:36.985624+0000","last_clean":"2026-02-20T12:16:36.985624+0000","last_became_active":"2026-02-20T12:05:00.630351+0000","last_became_peered":"2026-02-20T12:05:00.630351+0000","last_unstale":"2026-02-20T12:16:36.985624+0000","last_undegraded":"2026-02-20T12:16:36.985624+0000","last_fullsized":"2026-02-20T12:16:36.985624+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T12:16:36.990483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:16:36.990483+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":1698,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:36.682873+0000","last_change":"2026-02-20T12:16:36.695494+0000","last_active":"2026-02-20T12:16:36.682873+0000","last_peered":"2026-02-20T12:16:36.682873+0000","last_clean":"2026-02-20T12:16:36.682873+0000","last_became_active":"2026-02-20T12:05:00.629266+0000","last_became_peered":"2026-02-20T12:05:00.629266+0000","last_unstale":"2026-02-20T12:16:36.682873+0000","last_undegraded":"2026-02-20T12:16:36.682873+0000","last_fullsized":"2026-02-20T12:16:36.682873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2026-02-20T12:16:36.695429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:16:36.695429+0000","last_clean_scrub_stamp":"2026-02-20T12:04:59.598419+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":1772,"reported_epoch":577,"state":"active+clean","last_fresh":"2026-02-20T12:16:36.682401+0000","last_change":"2026-02-20T12:16:36.695977+0000","last_active":"2026-02-20T12:16:36.682401+0000","last_peered":"2026-02-20T12:16:36.682401+0000","last_clean":"2026-02-20T12:16:36.682401+0000","last_became_active":"2026-02-20T12:04:57.357761+0000","last_became_peered":"2026-02-20T12:04:57.357761+0000","last_unstale":"2026-02-20T12:16:36.682401+0000","last_undegraded":"2026-02-20T12:16:36.682401+0000","last_fullsized":"2026-02-20T12:16:36.682401+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'52","last_scrub_stamp":"2026-02-20T12:16:36.695886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T12:16:36.695886+0000","last_clean_scrub_stamp":"2026-02-20T12:04:56.337799+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654706383,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":680,"kb_used_omap":2524,"kb_used_meta":24227,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":696320,"data_stored":860872,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":2585380,"internal_metadata":24808668},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":616,"kb_used_omap":2111,"kb_used_meta":24640,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":630784,"data_stored":270485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2162160,"internal_metadata":25231888},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":680,"kb_used_omap":2335,"kb_used_meta":24416,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":696320,"data_stored":860872,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":2391042,"internal_metadata":25003006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30573,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T12:16:57.405 DEBUG:teuthology.orchestra.run.trial058:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-20T12:16:57.480 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:57.475+0000 7fb563d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:57.482 INFO:teuthology.orchestra.run.trial058.stderr:2026-02-20T12:16:57.481+0000 7fb563d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:16:57.606 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-20T12:16:57.607 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-20T12:16:57.607 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T12:16:57.607 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:16:57.687 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T12:16:57.687 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T12:16:57.687 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:16:57.756 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T12:16:57.756 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T12:16:57.756 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:16:57.831 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T12:16:57.831 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-20T12:16:57.831 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-20T12:16:57.832 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:16:57.865 INFO:tasks.ceph.mgr.x:Stopped 2026-02-20T12:16:57.865 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-20T12:16:57.865 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-20T12:16:57.866 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:16:57.917 INFO:tasks.ceph.mon.a:Stopped 2026-02-20T12:16:57.917 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-20T12:16:57.917 DEBUG:teuthology.orchestra.run.trial058:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v '\(SLOW_OPS\)' | grep -E -v 'slow request' | head -n 1 2026-02-20T12:16:57.984 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial058.front.sepia.ceph.com 2026-02-20T12:16:57.984 DEBUG:teuthology.orchestra.run.trial058:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-20T12:16:58.072 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial058.front.sepia.ceph.com 2026-02-20T12:16:58.072 DEBUG:teuthology.orchestra.run.trial058:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-20T12:16:58.099 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial058.front.sepia.ceph.com 2026-02-20T12:16:58.099 DEBUG:teuthology.orchestra.run.trial058:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-20T12:16:58.167 INFO:tasks.ceph:Archiving mon data... 2026-02-20T12:16:58.169 DEBUG:teuthology.misc:Transferring archived files from trial058:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60610/data/mon.a.tgz 2026-02-20T12:16:58.170 DEBUG:teuthology.orchestra.run.trial058:> mktemp 2026-02-20T12:16:58.223 INFO:teuthology.orchestra.run.trial058.stdout:/tmp/tmp.COzsrmzF49 2026-02-20T12:16:58.224 DEBUG:teuthology.orchestra.run.trial058:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.COzsrmzF49 2026-02-20T12:16:58.318 DEBUG:teuthology.orchestra.run.trial058:> sudo chmod 0666 /tmp/tmp.COzsrmzF49 2026-02-20T12:16:58.400 DEBUG:teuthology.orchestra.remote:trial058:/tmp/tmp.COzsrmzF49 is 253KB 2026-02-20T12:16:58.493 DEBUG:teuthology.orchestra.run.trial058:> rm -fr /tmp/tmp.COzsrmzF49 2026-02-20T12:16:58.510 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-20T12:16:58.510 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T12:16:58.630 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T12:16:58.630 INFO:tasks.ceph:Archiving crash dumps... 2026-02-20T12:16:58.632 DEBUG:teuthology.misc:Transferring archived files from trial058:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60610/remote/trial058/crash 2026-02-20T12:16:58.633 DEBUG:teuthology.orchestra.run.trial058:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T12:16:58.695 INFO:tasks.ceph:Compressing logs... 2026-02-20T12:16:58.695 DEBUG:teuthology.orchestra.run.trial058:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T12:16:58.759 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-20T12:16:58.759 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-20T12:16:58.760 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42163.log 2026-02-20T12:16:58.760 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42310.log 2026-02-20T12:16:58.760 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.42163.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42163.log.gz 2026-02-20T12:16:58.760 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42065.log 2026-02-20T12:16:58.761 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.42310.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-20T12:16:58.761 INFO:teuthology.orchestra.run.trial058.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42310.log.gz 2026-02-20T12:16:58.761 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.42065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39286.log 2026-02-20T12:16:58.761 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42065.log.gz 2026-02-20T12:16:58.761 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37683.log 2026-02-20T12:16:58.761 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.39286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38731.log 2026-02-20T12:16:58.761 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39286.log.gz 2026-02-20T12:16:58.762 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38508.log 2026-02-20T12:16:58.762 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.37683.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37683.log.gz 2026-02-20T12:16:58.762 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.38731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38636.log 2026-02-20T12:16:58.762 INFO:teuthology.orchestra.run.trial058.stderr: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.38731.log.gz 2026-02-20T12:16:58.762 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.38508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39433.log 2026-02-20T12:16:58.762 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38508.log.gz 2026-02-20T12:16:58.762 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.38636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41918.log 2026-02-20T12:16:58.762 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38636.log.gz 2026-02-20T12:16:58.763 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.39433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39044.log 2026-02-20T12:16:58.763 INFO:teuthology.orchestra.run.trial058.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.39433.log.gz 2026-02-20T12:16:58.763 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.41918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42261.log 2026-02-20T12:16:58.763 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41918.log.gz 2026-02-20T12:16:58.763 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.39044.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39044.log.gz 2026-02-20T12:16:58.763 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37636.log 2026-02-20T12:16:58.763 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.42261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41869.log 2026-02-20T12:16:58.764 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42261.log.gz 2026-02-20T12:16:58.764 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.37636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42359.log 2026-02-20T12:16:58.764 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37636.log.gz 2026-02-20T12:16:58.764 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.41869.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41869.log.gz 2026-02-20T12:16:58.764 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38133.log 2026-02-20T12:16:58.764 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.42359.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42359.log.gz 2026-02-20T12:16:58.764 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37541.log 2026-02-20T12:16:58.764 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.38133.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38133.log.gz 2026-02-20T12:16:58.765 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37867.log 2026-02-20T12:16:58.765 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.37541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39192.log 2026-02-20T12:16:58.765 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37541.log.gz 2026-02-20T12:16:58.765 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.37867.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37867.log.gz 2026-02-20T12:16:58.765 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38163.log 2026-02-20T12:16:58.765 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.39192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38943.log 2026-02-20T12:16:58.765 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39192.log.gz 2026-02-20T12:16:58.766 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.38163.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38163.log.gz 2026-02-20T12:16:58.766 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39046.log 2026-02-20T12:16:58.766 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.38943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39190.log 2026-02-20T12:16:58.766 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38943.log.gz 2026-02-20T12:16:58.766 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.39046.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39046.log.gz 2026-02-20T12:16:58.766 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-20T12:16:58.766 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.39190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39193.log 2026-02-20T12:16:58.766 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39190.log.gz 2026-02-20T12:16:58.767 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39384.log 2026-02-20T12:16:58.767 INFO:teuthology.orchestra.run.trial058.stderr: 86.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-20T12:16:58.767 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.39193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38894.log 2026-02-20T12:16:58.767 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39193.log.gz 2026-02-20T12:16:58.767 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.39384.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39384.log.gz 2026-02-20T12:16:58.767 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-20T12:16:58.767 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.38894.log: gzip 50.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.38894.log.gz --verbose 2026-02-20T12:16:58.767 INFO:teuthology.orchestra.run.trial058.stderr: -- /var/log/ceph/ceph-client.admin.38706.log 2026-02-20T12:16:58.768 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37914.log 2026-02-20T12:16:58.768 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.38706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39045.log 2026-02-20T12:16:58.768 INFO:teuthology.orchestra.run.trial058.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38706.log.gz 2026-02-20T12:16:58.768 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.37914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42406.log 2026-02-20T12:16:58.768 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37914.log.gz 2026-02-20T12:16:58.769 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.39045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42016.log 2026-02-20T12:16:58.769 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39045.log.gz 2026-02-20T12:16:58.769 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.42406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41967.log 2026-02-20T12:16:58.769 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42406.log.gz 2026-02-20T12:16:58.769 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.42016.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42016.log.gzgzip 2026-02-20T12:16:58.769 INFO:teuthology.orchestra.run.trial058.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39335.log 2026-02-20T12:16:58.769 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.41967.log: gzip 50.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.41967.log.gz --verbose 2026-02-20T12:16:58.769 INFO:teuthology.orchestra.run.trial058.stderr: -- /var/log/ceph/ceph-mgr.x.log 2026-02-20T12:16:58.770 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.39335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42212.log 2026-02-20T12:16:58.770 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39335.log.gz 2026-02-20T12:16:58.770 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38796.log 2026-02-20T12:16:58.770 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.42212.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-20T12:16:58.770 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42212.log.gz 2026-02-20T12:16:58.771 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.38796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39710.log 2026-02-20T12:16:58.771 INFO:teuthology.orchestra.run.trial058.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38796.log.gz 2026-02-20T12:16:58.771 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37820.log 2026-02-20T12:16:58.771 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.39710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42114.log 2026-02-20T12:16:58.771 INFO:teuthology.orchestra.run.trial058.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39710.log.gz 2026-02-20T12:16:58.771 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.37820.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37820.log.gz 2026-02-20T12:16:58.771 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41820.log 2026-02-20T12:16:58.772 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.42114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38845.log 2026-02-20T12:16:58.772 INFO:teuthology.orchestra.run.trial058.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42114.log.gz 2026-02-20T12:16:58.772 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.41820.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.35842.log 2026-02-20T12:16:58.772 INFO:teuthology.orchestra.run.trial058.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41820.log.gz 2026-02-20T12:16:58.772 INFO:teuthology.orchestra.run.trial058.stderr: 86.9% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-20T12:16:58.772 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph-client.admin.38845.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38845.log.gz 2026-02-20T12:16:58.773 INFO:teuthology.orchestra.run.trial058.stderr:/var/log/ceph/ceph.tmp-client.admin.35842.log: 68.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.35842.log.gz 2026-02-20T12:16:58.809 INFO:teuthology.orchestra.run.trial058.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-20T12:16:58.990 INFO:teuthology.orchestra.run.trial058.stderr: 89.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-20T12:17:01.129 INFO:teuthology.orchestra.run.trial058.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-20T12:17:01.925 INFO:teuthology.orchestra.run.trial058.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-20T12:17:03.909 INFO:teuthology.orchestra.run.trial058.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-20T12:17:03.911 INFO:teuthology.orchestra.run.trial058.stderr: 2026-02-20T12:17:03.911 INFO:teuthology.orchestra.run.trial058.stderr:real 0m5.159s 2026-02-20T12:17:03.911 INFO:teuthology.orchestra.run.trial058.stderr:user 0m10.303s 2026-02-20T12:17:03.911 INFO:teuthology.orchestra.run.trial058.stderr:sys 0m0.662s 2026-02-20T12:17:03.912 INFO:tasks.ceph:Archiving logs... 2026-02-20T12:17:03.912 DEBUG:teuthology.misc:Transferring archived files from trial058:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60610/remote/trial058/log 2026-02-20T12:17:03.913 DEBUG:teuthology.orchestra.run.trial058:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T12:17:04.848 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T12:17:04.918 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T12:17:04.925 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T12:17:04.925 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T12:17:04.950 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T12:17:04.956 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T12:17:04.956 DEBUG:teuthology.orchestra.run.trial058:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T12:17:05.005 INFO:teuthology.orchestra.run.trial058.stderr:bash: line 1: ntpq: command not found 2026-02-20T12:17:05.360 INFO:teuthology.orchestra.run.trial058.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T12:17:05.360 INFO:teuthology.orchestra.run.trial058.stdout:=============================================================================== 2026-02-20T12:17:05.360 INFO:teuthology.orchestra.run.trial058.stdout:^- 139-177-202-26.ip.linode> 2 6 377 15 -8882us[-8893us] +/- 80ms 2026-02-20T12:17:05.360 INFO:teuthology.orchestra.run.trial058.stdout:^- time-he.den.codehof.net 2 6 377 16 +21ms[ +21ms] +/- 37ms 2026-02-20T12:17:05.360 INFO:teuthology.orchestra.run.trial058.stdout:^* nyc3.us.ntp.li 2 6 377 14 -48us[ -59us] +/- 2347us 2026-02-20T12:17:05.360 INFO:teuthology.orchestra.run.trial058.stdout:^- time-h.den.codehof.net 2 6 377 15 +14ms[ +14ms] +/- 28ms 2026-02-20T12:17:05.361 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T12:17:05.377 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T12:17:05.377 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T12:17:05.393 DEBUG:teuthology.orchestra.run.trial058:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T12:17:05.454 DEBUG:teuthology.orchestra.run.trial058:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T12:17:05.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:17:05.481 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T12:17:05.497 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T12:17:05.513 INFO:teuthology.task.internal:Duration was 1095.007334 seconds 2026-02-20T12:17:05.513 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T12:17:05.529 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T12:17:05.530 DEBUG:teuthology.orchestra.run.trial058:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T12:17:05.566 INFO:teuthology.orchestra.run.trial058.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T12:17:05.798 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T12:17:05.798 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial058.front.sepia.ceph.com 2026-02-20T12:17:05.798 DEBUG:teuthology.orchestra.run.trial058:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T12:17:05.857 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T12:17:05.857 DEBUG:teuthology.orchestra.run.trial058:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T12:17:05.958 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T12:17:05.958 DEBUG:teuthology.orchestra.run.trial058:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T12:17:05.980 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T12:17:05.981 INFO:teuthology.orchestra.run.trial058.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T12:17:05.981 INFO:teuthology.orchestra.run.trial058.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gzgzip 2026-02-20T12:17:05.981 INFO:teuthology.orchestra.run.trial058.stderr: -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T12:17:05.981 INFO:teuthology.orchestra.run.trial058.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T12:17:05.991 INFO:teuthology.orchestra.run.trial058.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T12:17:05.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T12:17:06.010 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T12:17:06.010 DEBUG:teuthology.orchestra.run.trial058:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T12:17:06.056 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T12:17:06.077 DEBUG:teuthology.orchestra.run.trial058:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T12:17:06.119 INFO:teuthology.orchestra.run.trial058.stdout:kernel.core_pattern = core 2026-02-20T12:17:06.130 DEBUG:teuthology.orchestra.run.trial058:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T12:17:06.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:17:06.187 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T12:17:06.203 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T12:17:06.204 DEBUG:teuthology.misc:Transferring archived files from trial058:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60610/remote/trial058 2026-02-20T12:17:06.204 DEBUG:teuthology.orchestra.run.trial058:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T12:17:06.258 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T12:17:06.258 DEBUG:teuthology.orchestra.run.trial058:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T12:17:06.311 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T12:17:06.327 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T12:17:06.327 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T12:17:06.338 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T12:17:06.338 DEBUG:teuthology.orchestra.run.trial058:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T12:17:06.366 INFO:teuthology.orchestra.run.trial058.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 12:17 /home/ubuntu/cephtest 2026-02-20T12:17:06.367 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T12:17:06.378 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T12:17:06.403 INFO:teuthology.run:Summary data: description: crimson-rados/rbd/{0-crimson_install clusters/crimson-fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/crimson_bluestore tasks/rbd_python_api_tests_old_format} duration: 1095.0073335170746 flavor: debug owner: scheduled_jjperez@soko04.front.sepia.ceph.com success: true 2026-02-20T12:17:06.403 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T12:17:06.495 INFO:teuthology.run:pass